=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-474598 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0
E0701 15:09:02.765115 3713725 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19166-3708336/.minikube/profiles/addons-929335/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-474598 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0: exit status 102 (6m15.773194692s)
-- stdout --
* [old-k8s-version-474598] minikube v1.33.1 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=19166
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19166-3708336/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19166-3708336/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.30.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.2
* Using the docker driver based on existing profile
* Starting "old-k8s-version-474598" primary control-plane node in "old-k8s-version-474598" cluster
* Pulling base image v0.0.44-1719413016-19142 ...
* Restarting existing docker container for "old-k8s-version-474598" ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.24.6 ...
* Verifying Kubernetes components...
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-474598 addons enable metrics-server
* Enabled addons: default-storageclass, dashboard, storage-provisioner, metrics-server
-- /stdout --
** stderr **
I0701 15:09:01.677757 3906202 out.go:291] Setting OutFile to fd 1 ...
I0701 15:09:01.677906 3906202 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0701 15:09:01.677913 3906202 out.go:304] Setting ErrFile to fd 2...
I0701 15:09:01.677917 3906202 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0701 15:09:01.678177 3906202 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19166-3708336/.minikube/bin
I0701 15:09:01.678567 3906202 out.go:298] Setting JSON to false
I0701 15:09:01.679548 3906202 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":168693,"bootTime":1719677849,"procs":198,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1063-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
I0701 15:09:01.679618 3906202 start.go:139] virtualization:
I0701 15:09:01.683283 3906202 out.go:177] * [old-k8s-version-474598] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0701 15:09:01.685715 3906202 out.go:177] - MINIKUBE_LOCATION=19166
I0701 15:09:01.685758 3906202 notify.go:220] Checking for updates...
I0701 15:09:01.688384 3906202 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0701 15:09:01.690386 3906202 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19166-3708336/kubeconfig
I0701 15:09:01.692391 3906202 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19166-3708336/.minikube
I0701 15:09:01.694233 3906202 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0701 15:09:01.696705 3906202 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0701 15:09:01.699344 3906202 config.go:182] Loaded profile config "old-k8s-version-474598": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0701 15:09:01.701424 3906202 out.go:177] * Kubernetes 1.30.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.2
I0701 15:09:01.703274 3906202 driver.go:392] Setting default libvirt URI to qemu:///system
I0701 15:09:01.731484 3906202 docker.go:122] docker version: linux-27.0.3:Docker Engine - Community
I0701 15:09:01.731612 3906202 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0701 15:09:01.853936 3906202 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:54 OomKillDisable:true NGoroutines:66 SystemTime:2024-07-01 15:09:01.843721214 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1063-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae71819c4f5e67bb4d5ae76a6b735f29cc25774e Expected:ae71819c4f5e67bb4d5ae76a6b735f29cc25774e} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
I0701 15:09:01.854048 3906202 docker.go:295] overlay module found
I0701 15:09:01.856484 3906202 out.go:177] * Using the docker driver based on existing profile
I0701 15:09:01.859114 3906202 start.go:297] selected driver: docker
I0701 15:09:01.859140 3906202 start.go:901] validating driver "docker" against &{Name:old-k8s-version-474598 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-474598 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountStr
ing:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0701 15:09:01.859284 3906202 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0701 15:09:01.859897 3906202 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0701 15:09:01.953856 3906202 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:54 OomKillDisable:true NGoroutines:66 SystemTime:2024-07-01 15:09:01.935697305 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1063-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae71819c4f5e67bb4d5ae76a6b735f29cc25774e Expected:ae71819c4f5e67bb4d5ae76a6b735f29cc25774e} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
I0701 15:09:01.954205 3906202 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0701 15:09:01.954242 3906202 cni.go:84] Creating CNI manager for ""
I0701 15:09:01.954251 3906202 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0701 15:09:01.954297 3906202 start.go:340] cluster config:
{Name:old-k8s-version-474598 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-474598 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP
: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0701 15:09:01.957782 3906202 out.go:177] * Starting "old-k8s-version-474598" primary control-plane node in "old-k8s-version-474598" cluster
I0701 15:09:01.959945 3906202 cache.go:121] Beginning downloading kic base image for docker with crio
I0701 15:09:01.962558 3906202 out.go:177] * Pulling base image v0.0.44-1719413016-19142 ...
I0701 15:09:01.965126 3906202 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0701 15:09:01.965144 3906202 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d in local docker daemon
I0701 15:09:01.965186 3906202 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19166-3708336/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4
I0701 15:09:01.965196 3906202 cache.go:56] Caching tarball of preloaded images
I0701 15:09:01.965272 3906202 preload.go:173] Found /home/jenkins/minikube-integration/19166-3708336/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4 in cache, skipping download
I0701 15:09:01.965281 3906202 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0701 15:09:01.965401 3906202 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-3708336/.minikube/profiles/old-k8s-version-474598/config.json ...
I0701 15:09:02.003468 3906202 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d in local docker daemon, skipping pull
I0701 15:09:02.003504 3906202 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d exists in daemon, skipping load
I0701 15:09:02.003528 3906202 cache.go:194] Successfully downloaded all kic artifacts
I0701 15:09:02.003571 3906202 start.go:360] acquireMachinesLock for old-k8s-version-474598: {Name:mk291aa16770196f372f19ad91bae726dd814e84 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0701 15:09:02.003661 3906202 start.go:364] duration metric: took 54.187µs to acquireMachinesLock for "old-k8s-version-474598"
I0701 15:09:02.003702 3906202 start.go:96] Skipping create...Using existing machine configuration
I0701 15:09:02.003712 3906202 fix.go:54] fixHost starting:
I0701 15:09:02.004044 3906202 cli_runner.go:164] Run: docker container inspect old-k8s-version-474598 --format={{.State.Status}}
I0701 15:09:02.029861 3906202 fix.go:112] recreateIfNeeded on old-k8s-version-474598: state=Stopped err=<nil>
W0701 15:09:02.029898 3906202 fix.go:138] unexpected machine state, will restart: <nil>
I0701 15:09:02.032925 3906202 out.go:177] * Restarting existing docker container for "old-k8s-version-474598" ...
I0701 15:09:02.044334 3906202 cli_runner.go:164] Run: docker start old-k8s-version-474598
I0701 15:09:02.411369 3906202 cli_runner.go:164] Run: docker container inspect old-k8s-version-474598 --format={{.State.Status}}
I0701 15:09:02.434530 3906202 kic.go:430] container "old-k8s-version-474598" state is running.
I0701 15:09:02.435363 3906202 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-474598
I0701 15:09:02.466693 3906202 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-3708336/.minikube/profiles/old-k8s-version-474598/config.json ...
I0701 15:09:02.466930 3906202 machine.go:94] provisionDockerMachine start ...
I0701 15:09:02.466994 3906202 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-474598
I0701 15:09:02.492552 3906202 main.go:141] libmachine: Using SSH client type: native
I0701 15:09:02.492846 3906202 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2ba0] 0x3e5400 <nil> [] 0s} 127.0.0.1 34190 <nil> <nil>}
I0701 15:09:02.492859 3906202 main.go:141] libmachine: About to run SSH command:
hostname
I0701 15:09:02.493487 3906202 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0701 15:09:05.652655 3906202 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-474598
I0701 15:09:05.652682 3906202 ubuntu.go:169] provisioning hostname "old-k8s-version-474598"
I0701 15:09:05.652758 3906202 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-474598
I0701 15:09:05.671338 3906202 main.go:141] libmachine: Using SSH client type: native
I0701 15:09:05.671619 3906202 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2ba0] 0x3e5400 <nil> [] 0s} 127.0.0.1 34190 <nil> <nil>}
I0701 15:09:05.671640 3906202 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-474598 && echo "old-k8s-version-474598" | sudo tee /etc/hostname
I0701 15:09:05.841639 3906202 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-474598
I0701 15:09:05.841816 3906202 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-474598
I0701 15:09:05.868249 3906202 main.go:141] libmachine: Using SSH client type: native
I0701 15:09:05.868548 3906202 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2ba0] 0x3e5400 <nil> [] 0s} 127.0.0.1 34190 <nil> <nil>}
I0701 15:09:05.868566 3906202 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-474598' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-474598/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-474598' | sudo tee -a /etc/hosts;
fi
fi
I0701 15:09:06.018002 3906202 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0701 15:09:06.018041 3906202 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19166-3708336/.minikube CaCertPath:/home/jenkins/minikube-integration/19166-3708336/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19166-3708336/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19166-3708336/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19166-3708336/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19166-3708336/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19166-3708336/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19166-3708336/.minikube}
I0701 15:09:06.018062 3906202 ubuntu.go:177] setting up certificates
I0701 15:09:06.018071 3906202 provision.go:84] configureAuth start
I0701 15:09:06.018136 3906202 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-474598
I0701 15:09:06.040513 3906202 provision.go:143] copyHostCerts
I0701 15:09:06.040592 3906202 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-3708336/.minikube/ca.pem, removing ...
I0701 15:09:06.040601 3906202 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-3708336/.minikube/ca.pem
I0701 15:09:06.040671 3906202 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-3708336/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19166-3708336/.minikube/ca.pem (1082 bytes)
I0701 15:09:06.040760 3906202 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-3708336/.minikube/cert.pem, removing ...
I0701 15:09:06.040765 3906202 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-3708336/.minikube/cert.pem
I0701 15:09:06.040803 3906202 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-3708336/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19166-3708336/.minikube/cert.pem (1123 bytes)
I0701 15:09:06.040859 3906202 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-3708336/.minikube/key.pem, removing ...
I0701 15:09:06.040864 3906202 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-3708336/.minikube/key.pem
I0701 15:09:06.040888 3906202 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-3708336/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19166-3708336/.minikube/key.pem (1675 bytes)
I0701 15:09:06.040935 3906202 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19166-3708336/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19166-3708336/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19166-3708336/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-474598 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-474598]
I0701 15:09:06.626479 3906202 provision.go:177] copyRemoteCerts
I0701 15:09:06.626606 3906202 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0701 15:09:06.626668 3906202 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-474598
I0701 15:09:06.658766 3906202 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34190 SSHKeyPath:/home/jenkins/minikube-integration/19166-3708336/.minikube/machines/old-k8s-version-474598/id_rsa Username:docker}
I0701 15:09:06.767310 3906202 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-3708336/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0701 15:09:06.804266 3906202 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-3708336/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0701 15:09:06.840371 3906202 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-3708336/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0701 15:09:06.875602 3906202 provision.go:87] duration metric: took 857.517761ms to configureAuth
I0701 15:09:06.875708 3906202 ubuntu.go:193] setting minikube options for container-runtime
I0701 15:09:06.876055 3906202 config.go:182] Loaded profile config "old-k8s-version-474598": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0701 15:09:06.876715 3906202 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-474598
I0701 15:09:06.906927 3906202 main.go:141] libmachine: Using SSH client type: native
I0701 15:09:06.907205 3906202 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2ba0] 0x3e5400 <nil> [] 0s} 127.0.0.1 34190 <nil> <nil>}
I0701 15:09:06.907223 3906202 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0701 15:09:07.338248 3906202 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0701 15:09:07.338269 3906202 machine.go:97] duration metric: took 4.871329343s to provisionDockerMachine
I0701 15:09:07.338281 3906202 start.go:293] postStartSetup for "old-k8s-version-474598" (driver="docker")
I0701 15:09:07.338292 3906202 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0701 15:09:07.338374 3906202 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0701 15:09:07.338414 3906202 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-474598
I0701 15:09:07.370406 3906202 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34190 SSHKeyPath:/home/jenkins/minikube-integration/19166-3708336/.minikube/machines/old-k8s-version-474598/id_rsa Username:docker}
I0701 15:09:07.494418 3906202 ssh_runner.go:195] Run: cat /etc/os-release
I0701 15:09:07.497714 3906202 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0701 15:09:07.497747 3906202 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0701 15:09:07.497767 3906202 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0701 15:09:07.497774 3906202 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0701 15:09:07.497784 3906202 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-3708336/.minikube/addons for local assets ...
I0701 15:09:07.497840 3906202 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-3708336/.minikube/files for local assets ...
I0701 15:09:07.497931 3906202 filesync.go:149] local asset: /home/jenkins/minikube-integration/19166-3708336/.minikube/files/etc/ssl/certs/37137252.pem -> 37137252.pem in /etc/ssl/certs
I0701 15:09:07.498036 3906202 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0701 15:09:07.511732 3906202 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-3708336/.minikube/files/etc/ssl/certs/37137252.pem --> /etc/ssl/certs/37137252.pem (1708 bytes)
I0701 15:09:07.545999 3906202 start.go:296] duration metric: took 207.703515ms for postStartSetup
I0701 15:09:07.546083 3906202 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0701 15:09:07.546136 3906202 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-474598
I0701 15:09:07.570223 3906202 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34190 SSHKeyPath:/home/jenkins/minikube-integration/19166-3708336/.minikube/machines/old-k8s-version-474598/id_rsa Username:docker}
I0701 15:09:07.671197 3906202 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0701 15:09:07.675975 3906202 fix.go:56] duration metric: took 5.672256685s for fixHost
I0701 15:09:07.675997 3906202 start.go:83] releasing machines lock for "old-k8s-version-474598", held for 5.67232076s
I0701 15:09:07.676070 3906202 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-474598
I0701 15:09:07.714635 3906202 ssh_runner.go:195] Run: cat /version.json
I0701 15:09:07.714683 3906202 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-474598
I0701 15:09:07.714907 3906202 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0701 15:09:07.714967 3906202 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-474598
I0701 15:09:07.732100 3906202 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34190 SSHKeyPath:/home/jenkins/minikube-integration/19166-3708336/.minikube/machines/old-k8s-version-474598/id_rsa Username:docker}
I0701 15:09:07.745467 3906202 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34190 SSHKeyPath:/home/jenkins/minikube-integration/19166-3708336/.minikube/machines/old-k8s-version-474598/id_rsa Username:docker}
I0701 15:09:07.852582 3906202 ssh_runner.go:195] Run: systemctl --version
I0701 15:09:08.003165 3906202 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0701 15:09:08.175804 3906202 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0701 15:09:08.187783 3906202 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0701 15:09:08.209641 3906202 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
I0701 15:09:08.209805 3906202 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0701 15:09:08.222839 3906202 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0701 15:09:08.222924 3906202 start.go:494] detecting cgroup driver to use...
I0701 15:09:08.223018 3906202 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0701 15:09:08.223117 3906202 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0701 15:09:08.244481 3906202 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0701 15:09:08.263953 3906202 docker.go:217] disabling cri-docker service (if available) ...
I0701 15:09:08.264110 3906202 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0701 15:09:08.285473 3906202 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0701 15:09:08.304888 3906202 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0701 15:09:08.436734 3906202 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0701 15:09:08.588100 3906202 docker.go:233] disabling docker service ...
I0701 15:09:08.588273 3906202 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0701 15:09:08.611343 3906202 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0701 15:09:08.629722 3906202 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0701 15:09:08.775984 3906202 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0701 15:09:08.904266 3906202 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0701 15:09:08.917286 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0701 15:09:08.934559 3906202 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0701 15:09:08.934628 3906202 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0701 15:09:08.944614 3906202 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0701 15:09:08.944683 3906202 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0701 15:09:08.954932 3906202 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0701 15:09:08.964941 3906202 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0701 15:09:08.976570 3906202 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0701 15:09:08.986263 3906202 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0701 15:09:08.996264 3906202 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0701 15:09:09.007557 3906202 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0701 15:09:09.118586 3906202 ssh_runner.go:195] Run: sudo systemctl restart crio
I0701 15:09:10.139665 3906202 ssh_runner.go:235] Completed: sudo systemctl restart crio: (1.021043865s)
I0701 15:09:10.139694 3906202 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0701 15:09:10.139747 3906202 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0701 15:09:10.144710 3906202 start.go:562] Will wait 60s for crictl version
I0701 15:09:10.144776 3906202 ssh_runner.go:195] Run: which crictl
I0701 15:09:10.148951 3906202 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0701 15:09:10.238889 3906202 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.6
RuntimeApiVersion: v1
I0701 15:09:10.238972 3906202 ssh_runner.go:195] Run: crio --version
I0701 15:09:10.296396 3906202 ssh_runner.go:195] Run: crio --version
I0701 15:09:10.355685 3906202 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.24.6 ...
I0701 15:09:10.357601 3906202 cli_runner.go:164] Run: docker network inspect old-k8s-version-474598 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0701 15:09:10.383234 3906202 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0701 15:09:10.387801 3906202 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0701 15:09:10.402832 3906202 kubeadm.go:877] updating cluster {Name:old-k8s-version-474598 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-474598 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins
:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0701 15:09:10.402950 3906202 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0701 15:09:10.403004 3906202 ssh_runner.go:195] Run: sudo crictl images --output json
I0701 15:09:10.484922 3906202 crio.go:514] all images are preloaded for cri-o runtime.
I0701 15:09:10.484942 3906202 crio.go:433] Images already preloaded, skipping extraction
I0701 15:09:10.484997 3906202 ssh_runner.go:195] Run: sudo crictl images --output json
I0701 15:09:10.569414 3906202 crio.go:514] all images are preloaded for cri-o runtime.
I0701 15:09:10.569434 3906202 cache_images.go:84] Images are preloaded, skipping loading
I0701 15:09:10.569441 3906202 kubeadm.go:928] updating node { 192.168.76.2 8443 v1.20.0 crio true true} ...
I0701 15:09:10.569562 3906202 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --enforce-node-allocatable= --hostname-override=old-k8s-version-474598 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-474598 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0701 15:09:10.569640 3906202 ssh_runner.go:195] Run: crio config
I0701 15:09:10.717297 3906202 cni.go:84] Creating CNI manager for ""
I0701 15:09:10.717358 3906202 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0701 15:09:10.717382 3906202 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0701 15:09:10.717417 3906202 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-474598 NodeName:old-k8s-version-474598 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0701 15:09:10.717615 3906202 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-474598"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0701 15:09:10.717701 3906202 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0701 15:09:10.727063 3906202 binaries.go:44] Found k8s binaries, skipping transfer
I0701 15:09:10.727198 3906202 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0701 15:09:10.735755 3906202 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (480 bytes)
I0701 15:09:10.753593 3906202 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0701 15:09:10.771959 3906202 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2117 bytes)
I0701 15:09:10.789841 3906202 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0701 15:09:10.793496 3906202 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0701 15:09:10.804019 3906202 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0701 15:09:10.939462 3906202 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0701 15:09:10.967434 3906202 certs.go:68] Setting up /home/jenkins/minikube-integration/19166-3708336/.minikube/profiles/old-k8s-version-474598 for IP: 192.168.76.2
I0701 15:09:10.967451 3906202 certs.go:194] generating shared ca certs ...
I0701 15:09:10.967468 3906202 certs.go:226] acquiring lock for ca certs: {Name:mkef61a10d340f62d4856e4c226678a7bd970ee7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0701 15:09:10.967608 3906202 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19166-3708336/.minikube/ca.key
I0701 15:09:10.967650 3906202 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19166-3708336/.minikube/proxy-client-ca.key
I0701 15:09:10.967657 3906202 certs.go:256] generating profile certs ...
I0701 15:09:10.967739 3906202 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19166-3708336/.minikube/profiles/old-k8s-version-474598/client.key
I0701 15:09:10.967798 3906202 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19166-3708336/.minikube/profiles/old-k8s-version-474598/apiserver.key.5190c0f1
I0701 15:09:10.967839 3906202 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19166-3708336/.minikube/profiles/old-k8s-version-474598/proxy-client.key
I0701 15:09:10.967975 3906202 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-3708336/.minikube/certs/3713725.pem (1338 bytes)
W0701 15:09:10.968002 3906202 certs.go:480] ignoring /home/jenkins/minikube-integration/19166-3708336/.minikube/certs/3713725_empty.pem, impossibly tiny 0 bytes
I0701 15:09:10.968010 3906202 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-3708336/.minikube/certs/ca-key.pem (1675 bytes)
I0701 15:09:10.968033 3906202 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-3708336/.minikube/certs/ca.pem (1082 bytes)
I0701 15:09:10.968058 3906202 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-3708336/.minikube/certs/cert.pem (1123 bytes)
I0701 15:09:10.968080 3906202 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-3708336/.minikube/certs/key.pem (1675 bytes)
I0701 15:09:10.968121 3906202 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-3708336/.minikube/files/etc/ssl/certs/37137252.pem (1708 bytes)
I0701 15:09:10.968725 3906202 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-3708336/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0701 15:09:11.023705 3906202 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-3708336/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0701 15:09:11.145532 3906202 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-3708336/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0701 15:09:11.234858 3906202 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-3708336/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0701 15:09:11.297229 3906202 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-3708336/.minikube/profiles/old-k8s-version-474598/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0701 15:09:11.358416 3906202 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-3708336/.minikube/profiles/old-k8s-version-474598/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0701 15:09:11.408658 3906202 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-3708336/.minikube/profiles/old-k8s-version-474598/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0701 15:09:11.448986 3906202 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-3708336/.minikube/profiles/old-k8s-version-474598/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0701 15:09:11.474510 3906202 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-3708336/.minikube/files/etc/ssl/certs/37137252.pem --> /usr/share/ca-certificates/37137252.pem (1708 bytes)
I0701 15:09:11.501956 3906202 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-3708336/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0701 15:09:11.530561 3906202 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-3708336/.minikube/certs/3713725.pem --> /usr/share/ca-certificates/3713725.pem (1338 bytes)
I0701 15:09:11.558286 3906202 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0701 15:09:11.578798 3906202 ssh_runner.go:195] Run: openssl version
I0701 15:09:11.585579 3906202 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0701 15:09:11.596404 3906202 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0701 15:09:11.600850 3906202 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 1 14:16 /usr/share/ca-certificates/minikubeCA.pem
I0701 15:09:11.600910 3906202 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0701 15:09:11.609070 3906202 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0701 15:09:11.619308 3906202 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3713725.pem && ln -fs /usr/share/ca-certificates/3713725.pem /etc/ssl/certs/3713725.pem"
I0701 15:09:11.629872 3906202 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3713725.pem
I0701 15:09:11.634291 3906202 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 1 14:25 /usr/share/ca-certificates/3713725.pem
I0701 15:09:11.634359 3906202 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3713725.pem
I0701 15:09:11.642541 3906202 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/3713725.pem /etc/ssl/certs/51391683.0"
I0701 15:09:11.652346 3906202 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/37137252.pem && ln -fs /usr/share/ca-certificates/37137252.pem /etc/ssl/certs/37137252.pem"
I0701 15:09:11.667414 3906202 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/37137252.pem
I0701 15:09:11.676251 3906202 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 1 14:25 /usr/share/ca-certificates/37137252.pem
I0701 15:09:11.676314 3906202 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/37137252.pem
I0701 15:09:11.691425 3906202 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/37137252.pem /etc/ssl/certs/3ec20f2e.0"
I0701 15:09:11.714305 3906202 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0701 15:09:11.718790 3906202 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0701 15:09:11.726958 3906202 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0701 15:09:11.735374 3906202 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0701 15:09:11.743779 3906202 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0701 15:09:11.752065 3906202 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0701 15:09:11.760303 3906202 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0701 15:09:11.768255 3906202 kubeadm.go:391] StartCluster: {Name:old-k8s-version-474598 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-474598 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/m
inikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0701 15:09:11.768350 3906202 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0701 15:09:11.768406 3906202 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0701 15:09:11.832617 3906202 cri.go:89] found id: ""
I0701 15:09:11.832685 3906202 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0701 15:09:11.843543 3906202 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0701 15:09:11.843560 3906202 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0701 15:09:11.843565 3906202 kubeadm.go:587] restartPrimaryControlPlane start ...
I0701 15:09:11.843614 3906202 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0701 15:09:11.853507 3906202 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0701 15:09:11.853983 3906202 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-474598" does not appear in /home/jenkins/minikube-integration/19166-3708336/kubeconfig
I0701 15:09:11.854132 3906202 kubeconfig.go:62] /home/jenkins/minikube-integration/19166-3708336/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-474598" cluster setting kubeconfig missing "old-k8s-version-474598" context setting]
I0701 15:09:11.854514 3906202 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19166-3708336/kubeconfig: {Name:mk4d5838a81c57a1d9ec9a509328664588dd34aa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0701 15:09:11.855942 3906202 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0701 15:09:11.865908 3906202 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.76.2
I0701 15:09:11.865976 3906202 kubeadm.go:591] duration metric: took 22.404851ms to restartPrimaryControlPlane
I0701 15:09:11.865999 3906202 kubeadm.go:393] duration metric: took 97.752619ms to StartCluster
I0701 15:09:11.866040 3906202 settings.go:142] acquiring lock: {Name:mke9008d6920f4be65eddeda5d60c738ed3823ff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0701 15:09:11.866113 3906202 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19166-3708336/kubeconfig
I0701 15:09:11.866748 3906202 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19166-3708336/kubeconfig: {Name:mk4d5838a81c57a1d9ec9a509328664588dd34aa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0701 15:09:11.866981 3906202 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0701 15:09:11.867344 3906202 config.go:182] Loaded profile config "old-k8s-version-474598": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0701 15:09:11.867410 3906202 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0701 15:09:11.867540 3906202 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-474598"
I0701 15:09:11.867593 3906202 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-474598"
W0701 15:09:11.867617 3906202 addons.go:243] addon storage-provisioner should already be in state true
I0701 15:09:11.867772 3906202 host.go:66] Checking if "old-k8s-version-474598" exists ...
I0701 15:09:11.868417 3906202 cli_runner.go:164] Run: docker container inspect old-k8s-version-474598 --format={{.State.Status}}
I0701 15:09:11.868632 3906202 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-474598"
I0701 15:09:11.868782 3906202 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-474598"
I0701 15:09:11.868879 3906202 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-474598"
I0701 15:09:11.868907 3906202 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-474598"
W0701 15:09:11.868920 3906202 addons.go:243] addon metrics-server should already be in state true
I0701 15:09:11.868957 3906202 host.go:66] Checking if "old-k8s-version-474598" exists ...
I0701 15:09:11.869184 3906202 addons.go:69] Setting dashboard=true in profile "old-k8s-version-474598"
I0701 15:09:11.869205 3906202 addons.go:234] Setting addon dashboard=true in "old-k8s-version-474598"
W0701 15:09:11.869211 3906202 addons.go:243] addon dashboard should already be in state true
I0701 15:09:11.869229 3906202 host.go:66] Checking if "old-k8s-version-474598" exists ...
I0701 15:09:11.869380 3906202 cli_runner.go:164] Run: docker container inspect old-k8s-version-474598 --format={{.State.Status}}
I0701 15:09:11.869587 3906202 cli_runner.go:164] Run: docker container inspect old-k8s-version-474598 --format={{.State.Status}}
I0701 15:09:11.870222 3906202 out.go:177] * Verifying Kubernetes components...
I0701 15:09:11.870434 3906202 cli_runner.go:164] Run: docker container inspect old-k8s-version-474598 --format={{.State.Status}}
I0701 15:09:11.874138 3906202 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0701 15:09:11.979559 3906202 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0701 15:09:11.982990 3906202 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0701 15:09:11.983013 3906202 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0701 15:09:11.983079 3906202 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-474598
I0701 15:09:11.988024 3906202 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-474598"
W0701 15:09:11.988051 3906202 addons.go:243] addon default-storageclass should already be in state true
I0701 15:09:11.988360 3906202 host.go:66] Checking if "old-k8s-version-474598" exists ...
I0701 15:09:11.991337 3906202 cli_runner.go:164] Run: docker container inspect old-k8s-version-474598 --format={{.State.Status}}
I0701 15:09:11.988630 3906202 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0701 15:09:11.997616 3906202 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0701 15:09:11.999689 3906202 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0701 15:09:11.999713 3906202 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0701 15:09:11.999812 3906202 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-474598
I0701 15:09:12.033359 3906202 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0701 15:09:12.037703 3906202 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0701 15:09:12.037725 3906202 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0701 15:09:12.037904 3906202 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-474598
I0701 15:09:12.095199 3906202 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34190 SSHKeyPath:/home/jenkins/minikube-integration/19166-3708336/.minikube/machines/old-k8s-version-474598/id_rsa Username:docker}
I0701 15:09:12.100417 3906202 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34190 SSHKeyPath:/home/jenkins/minikube-integration/19166-3708336/.minikube/machines/old-k8s-version-474598/id_rsa Username:docker}
I0701 15:09:12.141204 3906202 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0701 15:09:12.141228 3906202 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0701 15:09:12.141293 3906202 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-474598
I0701 15:09:12.159207 3906202 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34190 SSHKeyPath:/home/jenkins/minikube-integration/19166-3708336/.minikube/machines/old-k8s-version-474598/id_rsa Username:docker}
I0701 15:09:12.191788 3906202 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34190 SSHKeyPath:/home/jenkins/minikube-integration/19166-3708336/.minikube/machines/old-k8s-version-474598/id_rsa Username:docker}
I0701 15:09:12.229378 3906202 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0701 15:09:12.267096 3906202 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-474598" to be "Ready" ...
I0701 15:09:12.315389 3906202 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0701 15:09:12.315460 3906202 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0701 15:09:12.340448 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0701 15:09:12.352455 3906202 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0701 15:09:12.352522 3906202 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0701 15:09:12.357546 3906202 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0701 15:09:12.357616 3906202 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0701 15:09:12.432286 3906202 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0701 15:09:12.432359 3906202 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0701 15:09:12.451905 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0701 15:09:12.468322 3906202 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0701 15:09:12.468368 3906202 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0701 15:09:12.558467 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0701 15:09:12.597468 3906202 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0701 15:09:12.597542 3906202 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
W0701 15:09:12.614590 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:12.614673 3906202 retry.go:31] will retry after 357.209433ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:12.647339 3906202 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0701 15:09:12.647408 3906202 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0701 15:09:12.739515 3906202 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0701 15:09:12.739586 3906202 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0701 15:09:12.808675 3906202 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0701 15:09:12.808747 3906202 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
W0701 15:09:12.812612 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:12.812678 3906202 retry.go:31] will retry after 345.536076ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0701 15:09:12.821501 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:12.821530 3906202 retry.go:31] will retry after 362.949228ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:12.834493 3906202 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0701 15:09:12.834564 3906202 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0701 15:09:12.853880 3906202 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0701 15:09:12.853901 3906202 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0701 15:09:12.872298 3906202 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0701 15:09:12.872365 3906202 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0701 15:09:12.891347 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0701 15:09:12.972736 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0701 15:09:12.985596 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:12.985677 3906202 retry.go:31] will retry after 297.375167ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0701 15:09:13.081182 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:13.081260 3906202 retry.go:31] will retry after 284.62434ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:13.159451 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0701 15:09:13.184836 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0701 15:09:13.283830 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0701 15:09:13.325195 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:13.325223 3906202 retry.go:31] will retry after 234.387438ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:13.366446 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0701 15:09:13.403186 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:13.403262 3906202 retry.go:31] will retry after 383.173801ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0701 15:09:13.528717 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:13.528814 3906202 retry.go:31] will retry after 354.525254ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:13.559975 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0701 15:09:13.666441 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:13.666520 3906202 retry.go:31] will retry after 358.890286ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0701 15:09:13.731538 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:13.731618 3906202 retry.go:31] will retry after 659.086324ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:13.787365 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0701 15:09:13.882062 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:13.882092 3906202 retry.go:31] will retry after 705.441353ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:13.884406 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0701 15:09:13.984395 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:13.984433 3906202 retry.go:31] will retry after 316.135865ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:14.025701 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0701 15:09:14.124519 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:14.124599 3906202 retry.go:31] will retry after 960.14679ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:14.268385 3906202 node_ready.go:53] error getting node "old-k8s-version-474598": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-474598": dial tcp 192.168.76.2:8443: connect: connection refused
I0701 15:09:14.301492 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0701 15:09:14.391772 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0701 15:09:14.427334 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:14.427364 3906202 retry.go:31] will retry after 1.17722557s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0701 15:09:14.546447 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:14.546476 3906202 retry.go:31] will retry after 427.230173ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:14.587684 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0701 15:09:14.684019 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:14.684050 3906202 retry.go:31] will retry after 671.112521ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:14.973931 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0701 15:09:15.077463 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:15.077495 3906202 retry.go:31] will retry after 964.8899ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:15.085784 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0701 15:09:15.179580 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:15.179674 3906202 retry.go:31] will retry after 686.44516ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:15.355304 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0701 15:09:15.452630 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:15.452659 3906202 retry.go:31] will retry after 1.637853749s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:15.605166 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0701 15:09:15.686830 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:15.686864 3906202 retry.go:31] will retry after 1.672480075s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:15.866744 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0701 15:09:15.980658 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:15.980687 3906202 retry.go:31] will retry after 1.357492873s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:16.042995 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0701 15:09:16.166003 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:16.166032 3906202 retry.go:31] will retry after 973.029141ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:16.767707 3906202 node_ready.go:53] error getting node "old-k8s-version-474598": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-474598": dial tcp 192.168.76.2:8443: connect: connection refused
I0701 15:09:17.091282 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0701 15:09:17.139758 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0701 15:09:17.215107 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:17.215144 3906202 retry.go:31] will retry after 1.988228676s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0701 15:09:17.302930 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:17.302962 3906202 retry.go:31] will retry after 3.000188701s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:17.339345 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0701 15:09:17.359694 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0701 15:09:17.455106 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:17.455136 3906202 retry.go:31] will retry after 3.691289677s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0701 15:09:17.509465 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:17.509557 3906202 retry.go:31] will retry after 2.237985683s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:18.768681 3906202 node_ready.go:53] error getting node "old-k8s-version-474598": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-474598": dial tcp 192.168.76.2:8443: connect: connection refused
I0701 15:09:19.204252 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0701 15:09:19.322106 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:19.322155 3906202 retry.go:31] will retry after 1.528811418s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:19.747781 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0701 15:09:19.870069 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:19.870099 3906202 retry.go:31] will retry after 4.216522237s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:20.303881 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0701 15:09:20.513547 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:20.513581 3906202 retry.go:31] will retry after 2.379794824s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 15:09:20.851860 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0701 15:09:21.147544 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0701 15:09:22.894177 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0701 15:09:24.087382 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0701 15:09:30.768558 3906202 node_ready.go:53] error getting node "old-k8s-version-474598": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-474598": net/http: TLS handshake timeout
I0701 15:09:31.080339 3906202 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (10.228425741s)
W0701 15:09:31.080406 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
I0701 15:09:31.080425 3906202 retry.go:31] will retry after 4.385239598s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
I0701 15:09:31.306485 3906202 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (10.158897481s)
W0701 15:09:31.306521 3906202 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
I0701 15:09:31.306539 3906202 retry.go:31] will retry after 2.697456663s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
I0701 15:09:32.115541 3906202 node_ready.go:49] node "old-k8s-version-474598" has status "Ready":"True"
I0701 15:09:32.115568 3906202 node_ready.go:38] duration metric: took 19.84838605s for node "old-k8s-version-474598" to be "Ready" ...
I0701 15:09:32.115578 3906202 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0701 15:09:32.291389 3906202 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-6nqwr" in "kube-system" namespace to be "Ready" ...
I0701 15:09:32.576951 3906202 pod_ready.go:92] pod "coredns-74ff55c5b-6nqwr" in "kube-system" namespace has status "Ready":"True"
I0701 15:09:32.577042 3906202 pod_ready.go:81] duration metric: took 285.579767ms for pod "coredns-74ff55c5b-6nqwr" in "kube-system" namespace to be "Ready" ...
I0701 15:09:32.577069 3906202 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-474598" in "kube-system" namespace to be "Ready" ...
I0701 15:09:32.810058 3906202 pod_ready.go:92] pod "etcd-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"True"
I0701 15:09:32.810133 3906202 pod_ready.go:81] duration metric: took 233.030566ms for pod "etcd-old-k8s-version-474598" in "kube-system" namespace to be "Ready" ...
I0701 15:09:32.810168 3906202 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-474598" in "kube-system" namespace to be "Ready" ...
I0701 15:09:33.051602 3906202 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"True"
I0701 15:09:33.051679 3906202 pod_ready.go:81] duration metric: took 241.477041ms for pod "kube-apiserver-old-k8s-version-474598" in "kube-system" namespace to be "Ready" ...
I0701 15:09:33.051706 3906202 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace to be "Ready" ...
I0701 15:09:33.162911 3906202 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (10.268691549s)
I0701 15:09:34.004576 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0701 15:09:34.044833 3906202 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (9.957381544s)
I0701 15:09:34.047307 3906202 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-474598 addons enable metrics-server
I0701 15:09:35.063260 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:09:35.466175 3906202 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0701 15:09:36.375030 3906202 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-474598"
I0701 15:09:36.376974 3906202 out.go:177] * Enabled addons: default-storageclass, dashboard, storage-provisioner, metrics-server
I0701 15:09:36.378642 3906202 addons.go:510] duration metric: took 24.511227374s for enable addons: enabled=[default-storageclass dashboard storage-provisioner metrics-server]
I0701 15:09:37.557804 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:09:39.558339 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:09:41.558822 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:09:44.058377 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:09:46.059155 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:09:48.063338 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:09:50.558137 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:09:52.615150 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:09:55.120189 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:09:57.572023 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:00.142509 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:02.565761 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:05.057576 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:07.059985 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:09.558332 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:11.558437 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:13.559934 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:16.058504 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:18.059181 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:20.558058 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:22.569860 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:25.058557 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:27.058892 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:29.559645 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:32.059335 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:34.558538 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:37.061118 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:39.061294 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:41.558049 3906202 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:44.058060 3906202 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"True"
I0701 15:10:44.058086 3906202 pod_ready.go:81] duration metric: took 1m11.006359043s for pod "kube-controller-manager-old-k8s-version-474598" in "kube-system" namespace to be "Ready" ...
I0701 15:10:44.058098 3906202 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-prspm" in "kube-system" namespace to be "Ready" ...
I0701 15:10:44.063364 3906202 pod_ready.go:92] pod "kube-proxy-prspm" in "kube-system" namespace has status "Ready":"True"
I0701 15:10:44.063397 3906202 pod_ready.go:81] duration metric: took 5.291149ms for pod "kube-proxy-prspm" in "kube-system" namespace to be "Ready" ...
I0701 15:10:44.063411 3906202 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-474598" in "kube-system" namespace to be "Ready" ...
I0701 15:10:46.070669 3906202 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:48.569239 3906202 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:50.569451 3906202 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:52.572695 3906202 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:54.070611 3906202 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-474598" in "kube-system" namespace has status "Ready":"True"
I0701 15:10:54.070707 3906202 pod_ready.go:81] duration metric: took 10.007287393s for pod "kube-scheduler-old-k8s-version-474598" in "kube-system" namespace to be "Ready" ...
I0701 15:10:54.070744 3906202 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace to be "Ready" ...
I0701 15:10:56.079401 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:10:58.577888 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:01.077916 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:03.576820 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:05.577699 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:07.577964 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:10.077998 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:12.577103 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:15.078134 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:17.584150 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:19.587174 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:22.078160 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:24.079040 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:26.579218 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:29.077183 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:31.078355 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:33.576933 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:35.577405 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:38.078279 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:40.577719 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:43.148891 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:45.577503 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:48.077680 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:50.077973 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:52.082437 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:54.576971 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:57.076824 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:11:59.077453 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:01.577685 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:04.077180 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:06.576336 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:09.078151 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:11.078311 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:13.577047 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:15.578147 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:18.078193 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:20.078494 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:22.078748 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:24.577061 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:26.577155 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:29.078529 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:31.577158 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:33.591640 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:36.077644 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:38.077968 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:40.576579 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:43.076520 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:45.078699 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:47.577164 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:49.577441 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:52.077829 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:54.077924 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:56.078544 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:12:58.577401 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:01.077485 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:03.576429 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:05.578123 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:08.077803 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:10.577432 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:13.075853 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:15.080264 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:17.576825 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:19.586164 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:22.077877 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:24.577203 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:27.077351 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:29.077606 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:31.078489 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:33.577126 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:35.577527 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:38.076765 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:40.578894 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:43.077084 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:45.078975 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:47.577058 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:49.578738 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:52.077852 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:54.078069 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:56.575947 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:13:58.577348 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:01.078896 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:03.578211 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:06.077520 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:08.077803 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:10.576581 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:13.077515 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:15.085147 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:17.576991 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:19.584768 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:22.077378 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:24.576609 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:26.577209 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:28.577287 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:31.077898 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:33.577279 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:35.577336 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:38.078620 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:40.577043 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:42.582701 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:45.077960 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:47.577525 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:49.577576 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:51.584631 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:54.077742 3906202 pod_ready.go:102] pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace has status "Ready":"False"
I0701 15:14:54.077779 3906202 pod_ready.go:81] duration metric: took 4m0.006996429s for pod "metrics-server-9975d5f86-99tkb" in "kube-system" namespace to be "Ready" ...
E0701 15:14:54.077790 3906202 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0701 15:14:54.077799 3906202 pod_ready.go:38] duration metric: took 5m21.962210827s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0701 15:14:54.077812 3906202 api_server.go:52] waiting for apiserver process to appear ...
I0701 15:14:54.077842 3906202 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0701 15:14:54.077907 3906202 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0701 15:14:54.119528 3906202 cri.go:89] found id: "29ff1e584547a3f1954c3b3bc8d86133f9f8821165607c401129fbb1ad25343b"
I0701 15:14:54.119554 3906202 cri.go:89] found id: ""
I0701 15:14:54.119563 3906202 logs.go:276] 1 containers: [29ff1e584547a3f1954c3b3bc8d86133f9f8821165607c401129fbb1ad25343b]
I0701 15:14:54.119623 3906202 ssh_runner.go:195] Run: which crictl
I0701 15:14:54.123844 3906202 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0701 15:14:54.123924 3906202 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0701 15:14:54.162439 3906202 cri.go:89] found id: "8937951752f8cf91f00237b6ccb23193fd6ae6e0c75a210a7eb01e45df33434f"
I0701 15:14:54.162470 3906202 cri.go:89] found id: ""
I0701 15:14:54.162479 3906202 logs.go:276] 1 containers: [8937951752f8cf91f00237b6ccb23193fd6ae6e0c75a210a7eb01e45df33434f]
I0701 15:14:54.162537 3906202 ssh_runner.go:195] Run: which crictl
I0701 15:14:54.166433 3906202 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0701 15:14:54.166510 3906202 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0701 15:14:54.211577 3906202 cri.go:89] found id: "585eb048d28eef3f91142d493ebacd44932dc6beaeb62efc44eef6e21a027d29"
I0701 15:14:54.211605 3906202 cri.go:89] found id: ""
I0701 15:14:54.211613 3906202 logs.go:276] 1 containers: [585eb048d28eef3f91142d493ebacd44932dc6beaeb62efc44eef6e21a027d29]
I0701 15:14:54.211672 3906202 ssh_runner.go:195] Run: which crictl
I0701 15:14:54.215370 3906202 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0701 15:14:54.215444 3906202 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0701 15:14:54.255491 3906202 cri.go:89] found id: "99b47a1789a53fcc22fad9c608f7e9a89470909c3bed1f74b857b5da84b94f8c"
I0701 15:14:54.255520 3906202 cri.go:89] found id: ""
I0701 15:14:54.255528 3906202 logs.go:276] 1 containers: [99b47a1789a53fcc22fad9c608f7e9a89470909c3bed1f74b857b5da84b94f8c]
I0701 15:14:54.255585 3906202 ssh_runner.go:195] Run: which crictl
I0701 15:14:54.259420 3906202 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0701 15:14:54.259493 3906202 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0701 15:14:54.297278 3906202 cri.go:89] found id: "4f612ce98e504e45b0b7d45ab196646d112950fff7af0818ed6b6ae20f451730"
I0701 15:14:54.297301 3906202 cri.go:89] found id: ""
I0701 15:14:54.297309 3906202 logs.go:276] 1 containers: [4f612ce98e504e45b0b7d45ab196646d112950fff7af0818ed6b6ae20f451730]
I0701 15:14:54.297364 3906202 ssh_runner.go:195] Run: which crictl
I0701 15:14:54.300930 3906202 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0701 15:14:54.300999 3906202 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0701 15:14:54.341713 3906202 cri.go:89] found id: "6f249a20156ffcc8d1b05a5a0133a0476123eab1338f65400a301afe0851c461"
I0701 15:14:54.341737 3906202 cri.go:89] found id: ""
I0701 15:14:54.341746 3906202 logs.go:276] 1 containers: [6f249a20156ffcc8d1b05a5a0133a0476123eab1338f65400a301afe0851c461]
I0701 15:14:54.341801 3906202 ssh_runner.go:195] Run: which crictl
I0701 15:14:54.345546 3906202 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0701 15:14:54.345633 3906202 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0701 15:14:54.394185 3906202 cri.go:89] found id: "d6c47f5e5c008f8c4904f4fab278a0c43bd06a808a8fc9f67cc24c2e47316d28"
I0701 15:14:54.394216 3906202 cri.go:89] found id: ""
I0701 15:14:54.394225 3906202 logs.go:276] 1 containers: [d6c47f5e5c008f8c4904f4fab278a0c43bd06a808a8fc9f67cc24c2e47316d28]
I0701 15:14:54.394321 3906202 ssh_runner.go:195] Run: which crictl
I0701 15:14:54.398017 3906202 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0701 15:14:54.398133 3906202 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0701 15:14:54.438425 3906202 cri.go:89] found id: "25c8776f1771df2532ca9cb51b3c40a3778154fec4f38ce0727c6e4b29adc787"
I0701 15:14:54.438448 3906202 cri.go:89] found id: ""
I0701 15:14:54.438456 3906202 logs.go:276] 1 containers: [25c8776f1771df2532ca9cb51b3c40a3778154fec4f38ce0727c6e4b29adc787]
I0701 15:14:54.438543 3906202 ssh_runner.go:195] Run: which crictl
I0701 15:14:54.441956 3906202 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0701 15:14:54.442024 3906202 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0701 15:14:54.487181 3906202 cri.go:89] found id: "870578f023cca426ce7d3f51bb2af8cb79612ae25002a652dcbcb30bc1690ed1"
I0701 15:14:54.487201 3906202 cri.go:89] found id: ""
I0701 15:14:54.487208 3906202 logs.go:276] 1 containers: [870578f023cca426ce7d3f51bb2af8cb79612ae25002a652dcbcb30bc1690ed1]
I0701 15:14:54.487262 3906202 ssh_runner.go:195] Run: which crictl
I0701 15:14:54.490937 3906202 logs.go:123] Gathering logs for dmesg ...
I0701 15:14:54.490964 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0701 15:14:54.511878 3906202 logs.go:123] Gathering logs for coredns [585eb048d28eef3f91142d493ebacd44932dc6beaeb62efc44eef6e21a027d29] ...
I0701 15:14:54.511921 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 585eb048d28eef3f91142d493ebacd44932dc6beaeb62efc44eef6e21a027d29"
I0701 15:14:54.553470 3906202 logs.go:123] Gathering logs for kindnet [d6c47f5e5c008f8c4904f4fab278a0c43bd06a808a8fc9f67cc24c2e47316d28] ...
I0701 15:14:54.553498 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d6c47f5e5c008f8c4904f4fab278a0c43bd06a808a8fc9f67cc24c2e47316d28"
I0701 15:14:54.602162 3906202 logs.go:123] Gathering logs for container status ...
I0701 15:14:54.602218 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0701 15:14:54.653815 3906202 logs.go:123] Gathering logs for describe nodes ...
I0701 15:14:54.653846 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0701 15:14:54.882785 3906202 logs.go:123] Gathering logs for kube-apiserver [29ff1e584547a3f1954c3b3bc8d86133f9f8821165607c401129fbb1ad25343b] ...
I0701 15:14:54.882821 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 29ff1e584547a3f1954c3b3bc8d86133f9f8821165607c401129fbb1ad25343b"
I0701 15:14:54.953309 3906202 logs.go:123] Gathering logs for kube-scheduler [99b47a1789a53fcc22fad9c608f7e9a89470909c3bed1f74b857b5da84b94f8c] ...
I0701 15:14:54.953342 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 99b47a1789a53fcc22fad9c608f7e9a89470909c3bed1f74b857b5da84b94f8c"
I0701 15:14:54.999177 3906202 logs.go:123] Gathering logs for kube-controller-manager [6f249a20156ffcc8d1b05a5a0133a0476123eab1338f65400a301afe0851c461] ...
I0701 15:14:54.999207 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6f249a20156ffcc8d1b05a5a0133a0476123eab1338f65400a301afe0851c461"
I0701 15:14:55.072749 3906202 logs.go:123] Gathering logs for storage-provisioner [25c8776f1771df2532ca9cb51b3c40a3778154fec4f38ce0727c6e4b29adc787] ...
I0701 15:14:55.072785 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 25c8776f1771df2532ca9cb51b3c40a3778154fec4f38ce0727c6e4b29adc787"
I0701 15:14:55.113887 3906202 logs.go:123] Gathering logs for kubelet ...
I0701 15:14:55.113914 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0701 15:14:55.167005 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:32 old-k8s-version-474598 kubelet[731]: E0701 15:09:32.099443 731 reflector.go:138] object-"kube-system"/"kube-proxy-token-klmzs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-klmzs" is forbidden: User "system:node:old-k8s-version-474598" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-474598' and this object
W0701 15:14:55.167235 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:32 old-k8s-version-474598 kubelet[731]: E0701 15:09:32.099649 731 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-474598" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-474598' and this object
W0701 15:14:55.167449 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:32 old-k8s-version-474598 kubelet[731]: E0701 15:09:32.113876 731 reflector.go:138] object-"kube-system"/"kindnet-token-9sd5n": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-9sd5n" is forbidden: User "system:node:old-k8s-version-474598" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-474598' and this object
W0701 15:14:55.167676 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:32 old-k8s-version-474598 kubelet[731]: E0701 15:09:32.114117 731 reflector.go:138] object-"kube-system"/"metrics-server-token-tnwnp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-tnwnp" is forbidden: User "system:node:old-k8s-version-474598" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-474598' and this object
W0701 15:14:55.167907 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:32 old-k8s-version-474598 kubelet[731]: E0701 15:09:32.114192 731 reflector.go:138] object-"kube-system"/"storage-provisioner-token-r599k": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-r599k" is forbidden: User "system:node:old-k8s-version-474598" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-474598' and this object
W0701 15:14:55.168138 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:32 old-k8s-version-474598 kubelet[731]: E0701 15:09:32.114241 731 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-474598" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-474598' and this object
W0701 15:14:55.168355 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:32 old-k8s-version-474598 kubelet[731]: E0701 15:09:32.114287 731 reflector.go:138] object-"kube-system"/"coredns-token-n8gzt": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-n8gzt" is forbidden: User "system:node:old-k8s-version-474598" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-474598' and this object
W0701 15:14:55.168565 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:32 old-k8s-version-474598 kubelet[731]: E0701 15:09:32.114343 731 reflector.go:138] object-"default"/"default-token-x4wpk": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-x4wpk" is forbidden: User "system:node:old-k8s-version-474598" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-474598' and this object
W0701 15:14:55.176812 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:33 old-k8s-version-474598 kubelet[731]: E0701 15:09:33.615070 731 pod_workers.go:191] Error syncing pod 6efc2390-ffa6-4d25-bc86-2270ae775d16 ("storage-provisioner_kube-system(6efc2390-ffa6-4d25-bc86-2270ae775d16)"), skipping: failed to "StartContainer" for "storage-provisioner" with CreateContainerConfigError: "services have not yet been read at least once, cannot construct envvars"
W0701 15:14:55.177809 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:33 old-k8s-version-474598 kubelet[731]: E0701 15:09:33.671634 731 pod_workers.go:191] Error syncing pod 6efc2390-ffa6-4d25-bc86-2270ae775d16 ("storage-provisioner_kube-system(6efc2390-ffa6-4d25-bc86-2270ae775d16)"), skipping: failed to "StartContainer" for "storage-provisioner" with CreateContainerConfigError: "services have not yet been read at least once, cannot construct envvars"
W0701 15:14:55.179042 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:34 old-k8s-version-474598 kubelet[731]: E0701 15:09:34.307484 731 pod_workers.go:191] Error syncing pod 91e015d1-1afc-4016-8924-d4032065550c ("busybox_default(91e015d1-1afc-4016-8924-d4032065550c)"), skipping: failed to "StartContainer" for "busybox" with CreateContainerConfigError: "services have not yet been read at least once, cannot construct envvars"
W0701 15:14:55.180068 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:34 old-k8s-version-474598 kubelet[731]: E0701 15:09:34.687641 731 pod_workers.go:191] Error syncing pod 91e015d1-1afc-4016-8924-d4032065550c ("busybox_default(91e015d1-1afc-4016-8924-d4032065550c)"), skipping: failed to "StartContainer" for "busybox" with CreateContainerConfigError: "services have not yet been read at least once, cannot construct envvars"
W0701 15:14:55.181728 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:34 old-k8s-version-474598 kubelet[731]: E0701 15:09:34.820470 731 pod_workers.go:191] Error syncing pod f29baf52-c4df-4915-b79f-078a24cb4a9f ("kindnet-4k4lt_kube-system(f29baf52-c4df-4915-b79f-078a24cb4a9f)"), skipping: failed to "StartContainer" for "kindnet-cni" with CreateContainerConfigError: "services have not yet been read at least once, cannot construct envvars"
W0701 15:14:55.185623 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:34 old-k8s-version-474598 kubelet[731]: E0701 15:09:34.917343 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0701 15:14:55.187449 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:35 old-k8s-version-474598 kubelet[731]: E0701 15:09:35.689857 731 pod_workers.go:191] Error syncing pod f29baf52-c4df-4915-b79f-078a24cb4a9f ("kindnet-4k4lt_kube-system(f29baf52-c4df-4915-b79f-078a24cb4a9f)"), skipping: failed to "StartContainer" for "kindnet-cni" with CreateContainerConfigError: "services have not yet been read at least once, cannot construct envvars"
W0701 15:14:55.187638 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:35 old-k8s-version-474598 kubelet[731]: E0701 15:09:35.698534 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.190105 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:48 old-k8s-version-474598 kubelet[731]: E0701 15:09:48.631681 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0701 15:14:55.191581 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:59 old-k8s-version-474598 kubelet[731]: E0701 15:09:59.621836 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.191907 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:59 old-k8s-version-474598 kubelet[731]: E0701 15:09:59.941603 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.192378 3906202 logs.go:138] Found kubelet problem: Jul 01 15:10:00 old-k8s-version-474598 kubelet[731]: E0701 15:10:00.943885 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.192718 3906202 logs.go:138] Found kubelet problem: Jul 01 15:10:01 old-k8s-version-474598 kubelet[731]: E0701 15:10:01.945146 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.194795 3906202 logs.go:138] Found kubelet problem: Jul 01 15:10:13 old-k8s-version-474598 kubelet[731]: E0701 15:10:13.631502 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0701 15:14:55.195400 3906202 logs.go:138] Found kubelet problem: Jul 01 15:10:15 old-k8s-version-474598 kubelet[731]: E0701 15:10:15.965751 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.195728 3906202 logs.go:138] Found kubelet problem: Jul 01 15:10:20 old-k8s-version-474598 kubelet[731]: E0701 15:10:20.353758 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.195912 3906202 logs.go:138] Found kubelet problem: Jul 01 15:10:27 old-k8s-version-474598 kubelet[731]: E0701 15:10:27.621155 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.196240 3906202 logs.go:138] Found kubelet problem: Jul 01 15:10:32 old-k8s-version-474598 kubelet[731]: E0701 15:10:32.620846 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.196425 3906202 logs.go:138] Found kubelet problem: Jul 01 15:10:42 old-k8s-version-474598 kubelet[731]: E0701 15:10:42.621573 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.197007 3906202 logs.go:138] Found kubelet problem: Jul 01 15:10:47 old-k8s-version-474598 kubelet[731]: E0701 15:10:47.017959 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.197338 3906202 logs.go:138] Found kubelet problem: Jul 01 15:10:50 old-k8s-version-474598 kubelet[731]: E0701 15:10:50.358024 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.199400 3906202 logs.go:138] Found kubelet problem: Jul 01 15:10:54 old-k8s-version-474598 kubelet[731]: E0701 15:10:54.630563 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0701 15:14:55.199724 3906202 logs.go:138] Found kubelet problem: Jul 01 15:11:01 old-k8s-version-474598 kubelet[731]: E0701 15:11:01.621361 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.199909 3906202 logs.go:138] Found kubelet problem: Jul 01 15:11:07 old-k8s-version-474598 kubelet[731]: E0701 15:11:07.623694 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.200233 3906202 logs.go:138] Found kubelet problem: Jul 01 15:11:16 old-k8s-version-474598 kubelet[731]: E0701 15:11:16.620700 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.200418 3906202 logs.go:138] Found kubelet problem: Jul 01 15:11:18 old-k8s-version-474598 kubelet[731]: E0701 15:11:18.621707 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.201018 3906202 logs.go:138] Found kubelet problem: Jul 01 15:11:28 old-k8s-version-474598 kubelet[731]: E0701 15:11:28.082520 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.201201 3906202 logs.go:138] Found kubelet problem: Jul 01 15:11:29 old-k8s-version-474598 kubelet[731]: E0701 15:11:29.621991 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.201526 3906202 logs.go:138] Found kubelet problem: Jul 01 15:11:30 old-k8s-version-474598 kubelet[731]: E0701 15:11:30.353335 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.201713 3906202 logs.go:138] Found kubelet problem: Jul 01 15:11:41 old-k8s-version-474598 kubelet[731]: E0701 15:11:41.622209 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.202038 3906202 logs.go:138] Found kubelet problem: Jul 01 15:11:42 old-k8s-version-474598 kubelet[731]: E0701 15:11:42.620768 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.202247 3906202 logs.go:138] Found kubelet problem: Jul 01 15:11:56 old-k8s-version-474598 kubelet[731]: E0701 15:11:56.621364 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.202609 3906202 logs.go:138] Found kubelet problem: Jul 01 15:11:56 old-k8s-version-474598 kubelet[731]: E0701 15:11:56.622121 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.202795 3906202 logs.go:138] Found kubelet problem: Jul 01 15:12:07 old-k8s-version-474598 kubelet[731]: E0701 15:12:07.622340 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.203121 3906202 logs.go:138] Found kubelet problem: Jul 01 15:12:08 old-k8s-version-474598 kubelet[731]: E0701 15:12:08.621109 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.203962 3906202 logs.go:138] Found kubelet problem: Jul 01 15:12:20 old-k8s-version-474598 kubelet[731]: E0701 15:12:20.620702 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.206012 3906202 logs.go:138] Found kubelet problem: Jul 01 15:12:20 old-k8s-version-474598 kubelet[731]: E0701 15:12:20.631313 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0701 15:14:55.206345 3906202 logs.go:138] Found kubelet problem: Jul 01 15:12:34 old-k8s-version-474598 kubelet[731]: E0701 15:12:34.620973 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.206529 3906202 logs.go:138] Found kubelet problem: Jul 01 15:12:34 old-k8s-version-474598 kubelet[731]: E0701 15:12:34.622005 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.206754 3906202 logs.go:138] Found kubelet problem: Jul 01 15:12:48 old-k8s-version-474598 kubelet[731]: E0701 15:12:48.621512 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.207342 3906202 logs.go:138] Found kubelet problem: Jul 01 15:12:51 old-k8s-version-474598 kubelet[731]: E0701 15:12:51.233147 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.207669 3906202 logs.go:138] Found kubelet problem: Jul 01 15:13:00 old-k8s-version-474598 kubelet[731]: E0701 15:13:00.353139 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.207856 3906202 logs.go:138] Found kubelet problem: Jul 01 15:13:00 old-k8s-version-474598 kubelet[731]: E0701 15:13:00.621289 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.208183 3906202 logs.go:138] Found kubelet problem: Jul 01 15:13:12 old-k8s-version-474598 kubelet[731]: E0701 15:13:12.621008 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.208369 3906202 logs.go:138] Found kubelet problem: Jul 01 15:13:12 old-k8s-version-474598 kubelet[731]: E0701 15:13:12.621572 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.208556 3906202 logs.go:138] Found kubelet problem: Jul 01 15:13:24 old-k8s-version-474598 kubelet[731]: E0701 15:13:24.621230 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.208994 3906202 logs.go:138] Found kubelet problem: Jul 01 15:13:25 old-k8s-version-474598 kubelet[731]: E0701 15:13:25.620763 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.209195 3906202 logs.go:138] Found kubelet problem: Jul 01 15:13:37 old-k8s-version-474598 kubelet[731]: E0701 15:13:37.621574 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.209522 3906202 logs.go:138] Found kubelet problem: Jul 01 15:13:39 old-k8s-version-474598 kubelet[731]: E0701 15:13:39.621765 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.209705 3906202 logs.go:138] Found kubelet problem: Jul 01 15:13:50 old-k8s-version-474598 kubelet[731]: E0701 15:13:50.621437 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.210097 3906202 logs.go:138] Found kubelet problem: Jul 01 15:13:54 old-k8s-version-474598 kubelet[731]: E0701 15:13:54.620755 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.210286 3906202 logs.go:138] Found kubelet problem: Jul 01 15:14:01 old-k8s-version-474598 kubelet[731]: E0701 15:14:01.621745 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.210618 3906202 logs.go:138] Found kubelet problem: Jul 01 15:14:07 old-k8s-version-474598 kubelet[731]: E0701 15:14:07.620754 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.210809 3906202 logs.go:138] Found kubelet problem: Jul 01 15:14:16 old-k8s-version-474598 kubelet[731]: E0701 15:14:16.622062 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.211382 3906202 logs.go:138] Found kubelet problem: Jul 01 15:14:22 old-k8s-version-474598 kubelet[731]: E0701 15:14:22.620813 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.211567 3906202 logs.go:138] Found kubelet problem: Jul 01 15:14:31 old-k8s-version-474598 kubelet[731]: E0701 15:14:31.621391 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.211892 3906202 logs.go:138] Found kubelet problem: Jul 01 15:14:33 old-k8s-version-474598 kubelet[731]: E0701 15:14:33.620802 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.212077 3906202 logs.go:138] Found kubelet problem: Jul 01 15:14:44 old-k8s-version-474598 kubelet[731]: E0701 15:14:44.621361 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.212401 3906202 logs.go:138] Found kubelet problem: Jul 01 15:14:48 old-k8s-version-474598 kubelet[731]: E0701 15:14:48.620740 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
I0701 15:14:55.212412 3906202 logs.go:123] Gathering logs for CRI-O ...
I0701 15:14:55.212426 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0701 15:14:55.302737 3906202 logs.go:123] Gathering logs for etcd [8937951752f8cf91f00237b6ccb23193fd6ae6e0c75a210a7eb01e45df33434f] ...
I0701 15:14:55.302775 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8937951752f8cf91f00237b6ccb23193fd6ae6e0c75a210a7eb01e45df33434f"
I0701 15:14:55.347870 3906202 logs.go:123] Gathering logs for kube-proxy [4f612ce98e504e45b0b7d45ab196646d112950fff7af0818ed6b6ae20f451730] ...
I0701 15:14:55.347898 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4f612ce98e504e45b0b7d45ab196646d112950fff7af0818ed6b6ae20f451730"
I0701 15:14:55.398009 3906202 logs.go:123] Gathering logs for kubernetes-dashboard [870578f023cca426ce7d3f51bb2af8cb79612ae25002a652dcbcb30bc1690ed1] ...
I0701 15:14:55.398046 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 870578f023cca426ce7d3f51bb2af8cb79612ae25002a652dcbcb30bc1690ed1"
I0701 15:14:55.452518 3906202 out.go:304] Setting ErrFile to fd 2...
I0701 15:14:55.452598 3906202 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0701 15:14:55.452657 3906202 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0701 15:14:55.452672 3906202 out.go:239] Jul 01 15:14:22 old-k8s-version-474598 kubelet[731]: E0701 15:14:22.620813 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
Jul 01 15:14:22 old-k8s-version-474598 kubelet[731]: E0701 15:14:22.620813 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.452685 3906202 out.go:239] Jul 01 15:14:31 old-k8s-version-474598 kubelet[731]: E0701 15:14:31.621391 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 15:14:31 old-k8s-version-474598 kubelet[731]: E0701 15:14:31.621391 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.452698 3906202 out.go:239] Jul 01 15:14:33 old-k8s-version-474598 kubelet[731]: E0701 15:14:33.620802 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
Jul 01 15:14:33 old-k8s-version-474598 kubelet[731]: E0701 15:14:33.620802 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:14:55.452827 3906202 out.go:239] Jul 01 15:14:44 old-k8s-version-474598 kubelet[731]: E0701 15:14:44.621361 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 15:14:44 old-k8s-version-474598 kubelet[731]: E0701 15:14:44.621361 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:14:55.452844 3906202 out.go:239] Jul 01 15:14:48 old-k8s-version-474598 kubelet[731]: E0701 15:14:48.620740 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
Jul 01 15:14:48 old-k8s-version-474598 kubelet[731]: E0701 15:14:48.620740 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
I0701 15:14:55.452851 3906202 out.go:304] Setting ErrFile to fd 2...
I0701 15:14:55.452858 3906202 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0701 15:15:05.454233 3906202 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0701 15:15:05.473885 3906202 api_server.go:72] duration metric: took 5m53.606849813s to wait for apiserver process to appear ...
I0701 15:15:05.473914 3906202 api_server.go:88] waiting for apiserver healthz status ...
I0701 15:15:05.473951 3906202 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0701 15:15:05.474013 3906202 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0701 15:15:05.524560 3906202 cri.go:89] found id: "29ff1e584547a3f1954c3b3bc8d86133f9f8821165607c401129fbb1ad25343b"
I0701 15:15:05.524587 3906202 cri.go:89] found id: ""
I0701 15:15:05.524596 3906202 logs.go:276] 1 containers: [29ff1e584547a3f1954c3b3bc8d86133f9f8821165607c401129fbb1ad25343b]
I0701 15:15:05.524652 3906202 ssh_runner.go:195] Run: which crictl
I0701 15:15:05.529846 3906202 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0701 15:15:05.529919 3906202 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0701 15:15:05.600339 3906202 cri.go:89] found id: "8937951752f8cf91f00237b6ccb23193fd6ae6e0c75a210a7eb01e45df33434f"
I0701 15:15:05.600365 3906202 cri.go:89] found id: ""
I0701 15:15:05.600374 3906202 logs.go:276] 1 containers: [8937951752f8cf91f00237b6ccb23193fd6ae6e0c75a210a7eb01e45df33434f]
I0701 15:15:05.600428 3906202 ssh_runner.go:195] Run: which crictl
I0701 15:15:05.604351 3906202 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0701 15:15:05.604425 3906202 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0701 15:15:05.664812 3906202 cri.go:89] found id: "585eb048d28eef3f91142d493ebacd44932dc6beaeb62efc44eef6e21a027d29"
I0701 15:15:05.664837 3906202 cri.go:89] found id: ""
I0701 15:15:05.664845 3906202 logs.go:276] 1 containers: [585eb048d28eef3f91142d493ebacd44932dc6beaeb62efc44eef6e21a027d29]
I0701 15:15:05.664902 3906202 ssh_runner.go:195] Run: which crictl
I0701 15:15:05.669275 3906202 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0701 15:15:05.669349 3906202 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0701 15:15:05.728723 3906202 cri.go:89] found id: "99b47a1789a53fcc22fad9c608f7e9a89470909c3bed1f74b857b5da84b94f8c"
I0701 15:15:05.728749 3906202 cri.go:89] found id: ""
I0701 15:15:05.728758 3906202 logs.go:276] 1 containers: [99b47a1789a53fcc22fad9c608f7e9a89470909c3bed1f74b857b5da84b94f8c]
I0701 15:15:05.728814 3906202 ssh_runner.go:195] Run: which crictl
I0701 15:15:05.733409 3906202 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0701 15:15:05.733482 3906202 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0701 15:15:05.784731 3906202 cri.go:89] found id: "4f612ce98e504e45b0b7d45ab196646d112950fff7af0818ed6b6ae20f451730"
I0701 15:15:05.784755 3906202 cri.go:89] found id: ""
I0701 15:15:05.784764 3906202 logs.go:276] 1 containers: [4f612ce98e504e45b0b7d45ab196646d112950fff7af0818ed6b6ae20f451730]
I0701 15:15:05.784822 3906202 ssh_runner.go:195] Run: which crictl
I0701 15:15:05.789125 3906202 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0701 15:15:05.789194 3906202 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0701 15:15:05.839383 3906202 cri.go:89] found id: "6f249a20156ffcc8d1b05a5a0133a0476123eab1338f65400a301afe0851c461"
I0701 15:15:05.839407 3906202 cri.go:89] found id: ""
I0701 15:15:05.839416 3906202 logs.go:276] 1 containers: [6f249a20156ffcc8d1b05a5a0133a0476123eab1338f65400a301afe0851c461]
I0701 15:15:05.839469 3906202 ssh_runner.go:195] Run: which crictl
I0701 15:15:05.851445 3906202 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0701 15:15:05.851531 3906202 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0701 15:15:05.905999 3906202 cri.go:89] found id: "d6c47f5e5c008f8c4904f4fab278a0c43bd06a808a8fc9f67cc24c2e47316d28"
I0701 15:15:05.906020 3906202 cri.go:89] found id: ""
I0701 15:15:05.906028 3906202 logs.go:276] 1 containers: [d6c47f5e5c008f8c4904f4fab278a0c43bd06a808a8fc9f67cc24c2e47316d28]
I0701 15:15:05.906083 3906202 ssh_runner.go:195] Run: which crictl
I0701 15:15:05.910640 3906202 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0701 15:15:05.910712 3906202 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0701 15:15:05.976594 3906202 cri.go:89] found id: "870578f023cca426ce7d3f51bb2af8cb79612ae25002a652dcbcb30bc1690ed1"
I0701 15:15:05.976616 3906202 cri.go:89] found id: ""
I0701 15:15:05.976624 3906202 logs.go:276] 1 containers: [870578f023cca426ce7d3f51bb2af8cb79612ae25002a652dcbcb30bc1690ed1]
I0701 15:15:05.976682 3906202 ssh_runner.go:195] Run: which crictl
I0701 15:15:05.983254 3906202 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0701 15:15:05.983327 3906202 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0701 15:15:06.043175 3906202 cri.go:89] found id: "25c8776f1771df2532ca9cb51b3c40a3778154fec4f38ce0727c6e4b29adc787"
I0701 15:15:06.043193 3906202 cri.go:89] found id: ""
I0701 15:15:06.043201 3906202 logs.go:276] 1 containers: [25c8776f1771df2532ca9cb51b3c40a3778154fec4f38ce0727c6e4b29adc787]
I0701 15:15:06.043254 3906202 ssh_runner.go:195] Run: which crictl
I0701 15:15:06.047697 3906202 logs.go:123] Gathering logs for kube-scheduler [99b47a1789a53fcc22fad9c608f7e9a89470909c3bed1f74b857b5da84b94f8c] ...
I0701 15:15:06.047732 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 99b47a1789a53fcc22fad9c608f7e9a89470909c3bed1f74b857b5da84b94f8c"
I0701 15:15:06.119383 3906202 logs.go:123] Gathering logs for kube-proxy [4f612ce98e504e45b0b7d45ab196646d112950fff7af0818ed6b6ae20f451730] ...
I0701 15:15:06.119415 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4f612ce98e504e45b0b7d45ab196646d112950fff7af0818ed6b6ae20f451730"
I0701 15:15:06.194064 3906202 logs.go:123] Gathering logs for kindnet [d6c47f5e5c008f8c4904f4fab278a0c43bd06a808a8fc9f67cc24c2e47316d28] ...
I0701 15:15:06.194089 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d6c47f5e5c008f8c4904f4fab278a0c43bd06a808a8fc9f67cc24c2e47316d28"
I0701 15:15:06.249549 3906202 logs.go:123] Gathering logs for storage-provisioner [25c8776f1771df2532ca9cb51b3c40a3778154fec4f38ce0727c6e4b29adc787] ...
I0701 15:15:06.249627 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 25c8776f1771df2532ca9cb51b3c40a3778154fec4f38ce0727c6e4b29adc787"
I0701 15:15:06.315267 3906202 logs.go:123] Gathering logs for etcd [8937951752f8cf91f00237b6ccb23193fd6ae6e0c75a210a7eb01e45df33434f] ...
I0701 15:15:06.315293 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8937951752f8cf91f00237b6ccb23193fd6ae6e0c75a210a7eb01e45df33434f"
I0701 15:15:06.391378 3906202 logs.go:123] Gathering logs for kubernetes-dashboard [870578f023cca426ce7d3f51bb2af8cb79612ae25002a652dcbcb30bc1690ed1] ...
I0701 15:15:06.391421 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 870578f023cca426ce7d3f51bb2af8cb79612ae25002a652dcbcb30bc1690ed1"
I0701 15:15:06.455727 3906202 logs.go:123] Gathering logs for CRI-O ...
I0701 15:15:06.455753 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0701 15:15:06.566923 3906202 logs.go:123] Gathering logs for container status ...
I0701 15:15:06.566998 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0701 15:15:06.633327 3906202 logs.go:123] Gathering logs for coredns [585eb048d28eef3f91142d493ebacd44932dc6beaeb62efc44eef6e21a027d29] ...
I0701 15:15:06.633361 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 585eb048d28eef3f91142d493ebacd44932dc6beaeb62efc44eef6e21a027d29"
I0701 15:15:06.710802 3906202 logs.go:123] Gathering logs for dmesg ...
I0701 15:15:06.710830 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0701 15:15:06.734209 3906202 logs.go:123] Gathering logs for describe nodes ...
I0701 15:15:06.734303 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0701 15:15:06.935303 3906202 logs.go:123] Gathering logs for kube-apiserver [29ff1e584547a3f1954c3b3bc8d86133f9f8821165607c401129fbb1ad25343b] ...
I0701 15:15:06.935342 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 29ff1e584547a3f1954c3b3bc8d86133f9f8821165607c401129fbb1ad25343b"
I0701 15:15:07.053963 3906202 logs.go:123] Gathering logs for kubelet ...
I0701 15:15:07.054001 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0701 15:15:07.123967 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:32 old-k8s-version-474598 kubelet[731]: E0701 15:09:32.099443 731 reflector.go:138] object-"kube-system"/"kube-proxy-token-klmzs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-klmzs" is forbidden: User "system:node:old-k8s-version-474598" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-474598' and this object
W0701 15:15:07.124190 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:32 old-k8s-version-474598 kubelet[731]: E0701 15:09:32.099649 731 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-474598" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-474598' and this object
W0701 15:15:07.124402 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:32 old-k8s-version-474598 kubelet[731]: E0701 15:09:32.113876 731 reflector.go:138] object-"kube-system"/"kindnet-token-9sd5n": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-9sd5n" is forbidden: User "system:node:old-k8s-version-474598" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-474598' and this object
W0701 15:15:07.124626 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:32 old-k8s-version-474598 kubelet[731]: E0701 15:09:32.114117 731 reflector.go:138] object-"kube-system"/"metrics-server-token-tnwnp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-tnwnp" is forbidden: User "system:node:old-k8s-version-474598" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-474598' and this object
W0701 15:15:07.124851 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:32 old-k8s-version-474598 kubelet[731]: E0701 15:09:32.114192 731 reflector.go:138] object-"kube-system"/"storage-provisioner-token-r599k": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-r599k" is forbidden: User "system:node:old-k8s-version-474598" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-474598' and this object
W0701 15:15:07.125241 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:32 old-k8s-version-474598 kubelet[731]: E0701 15:09:32.114241 731 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-474598" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-474598' and this object
W0701 15:15:07.125462 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:32 old-k8s-version-474598 kubelet[731]: E0701 15:09:32.114287 731 reflector.go:138] object-"kube-system"/"coredns-token-n8gzt": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-n8gzt" is forbidden: User "system:node:old-k8s-version-474598" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-474598' and this object
W0701 15:15:07.125669 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:32 old-k8s-version-474598 kubelet[731]: E0701 15:09:32.114343 731 reflector.go:138] object-"default"/"default-token-x4wpk": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-x4wpk" is forbidden: User "system:node:old-k8s-version-474598" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-474598' and this object
W0701 15:15:07.139487 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:33 old-k8s-version-474598 kubelet[731]: E0701 15:09:33.615070 731 pod_workers.go:191] Error syncing pod 6efc2390-ffa6-4d25-bc86-2270ae775d16 ("storage-provisioner_kube-system(6efc2390-ffa6-4d25-bc86-2270ae775d16)"), skipping: failed to "StartContainer" for "storage-provisioner" with CreateContainerConfigError: "services have not yet been read at least once, cannot construct envvars"
W0701 15:15:07.140427 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:33 old-k8s-version-474598 kubelet[731]: E0701 15:09:33.671634 731 pod_workers.go:191] Error syncing pod 6efc2390-ffa6-4d25-bc86-2270ae775d16 ("storage-provisioner_kube-system(6efc2390-ffa6-4d25-bc86-2270ae775d16)"), skipping: failed to "StartContainer" for "storage-provisioner" with CreateContainerConfigError: "services have not yet been read at least once, cannot construct envvars"
W0701 15:15:07.141999 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:34 old-k8s-version-474598 kubelet[731]: E0701 15:09:34.307484 731 pod_workers.go:191] Error syncing pod 91e015d1-1afc-4016-8924-d4032065550c ("busybox_default(91e015d1-1afc-4016-8924-d4032065550c)"), skipping: failed to "StartContainer" for "busybox" with CreateContainerConfigError: "services have not yet been read at least once, cannot construct envvars"
W0701 15:15:07.143027 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:34 old-k8s-version-474598 kubelet[731]: E0701 15:09:34.687641 731 pod_workers.go:191] Error syncing pod 91e015d1-1afc-4016-8924-d4032065550c ("busybox_default(91e015d1-1afc-4016-8924-d4032065550c)"), skipping: failed to "StartContainer" for "busybox" with CreateContainerConfigError: "services have not yet been read at least once, cannot construct envvars"
W0701 15:15:07.144654 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:34 old-k8s-version-474598 kubelet[731]: E0701 15:09:34.820470 731 pod_workers.go:191] Error syncing pod f29baf52-c4df-4915-b79f-078a24cb4a9f ("kindnet-4k4lt_kube-system(f29baf52-c4df-4915-b79f-078a24cb4a9f)"), skipping: failed to "StartContainer" for "kindnet-cni" with CreateContainerConfigError: "services have not yet been read at least once, cannot construct envvars"
W0701 15:15:07.148368 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:34 old-k8s-version-474598 kubelet[731]: E0701 15:09:34.917343 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0701 15:15:07.150584 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:35 old-k8s-version-474598 kubelet[731]: E0701 15:09:35.689857 731 pod_workers.go:191] Error syncing pod f29baf52-c4df-4915-b79f-078a24cb4a9f ("kindnet-4k4lt_kube-system(f29baf52-c4df-4915-b79f-078a24cb4a9f)"), skipping: failed to "StartContainer" for "kindnet-cni" with CreateContainerConfigError: "services have not yet been read at least once, cannot construct envvars"
W0701 15:15:07.150784 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:35 old-k8s-version-474598 kubelet[731]: E0701 15:09:35.698534 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.153390 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:48 old-k8s-version-474598 kubelet[731]: E0701 15:09:48.631681 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0701 15:15:07.155221 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:59 old-k8s-version-474598 kubelet[731]: E0701 15:09:59.621836 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.155562 3906202 logs.go:138] Found kubelet problem: Jul 01 15:09:59 old-k8s-version-474598 kubelet[731]: E0701 15:09:59.941603 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.156018 3906202 logs.go:138] Found kubelet problem: Jul 01 15:10:00 old-k8s-version-474598 kubelet[731]: E0701 15:10:00.943885 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.156346 3906202 logs.go:138] Found kubelet problem: Jul 01 15:10:01 old-k8s-version-474598 kubelet[731]: E0701 15:10:01.945146 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.163341 3906202 logs.go:138] Found kubelet problem: Jul 01 15:10:13 old-k8s-version-474598 kubelet[731]: E0701 15:10:13.631502 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0701 15:15:07.163967 3906202 logs.go:138] Found kubelet problem: Jul 01 15:10:15 old-k8s-version-474598 kubelet[731]: E0701 15:10:15.965751 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.164296 3906202 logs.go:138] Found kubelet problem: Jul 01 15:10:20 old-k8s-version-474598 kubelet[731]: E0701 15:10:20.353758 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.164481 3906202 logs.go:138] Found kubelet problem: Jul 01 15:10:27 old-k8s-version-474598 kubelet[731]: E0701 15:10:27.621155 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.164806 3906202 logs.go:138] Found kubelet problem: Jul 01 15:10:32 old-k8s-version-474598 kubelet[731]: E0701 15:10:32.620846 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.164990 3906202 logs.go:138] Found kubelet problem: Jul 01 15:10:42 old-k8s-version-474598 kubelet[731]: E0701 15:10:42.621573 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.165591 3906202 logs.go:138] Found kubelet problem: Jul 01 15:10:47 old-k8s-version-474598 kubelet[731]: E0701 15:10:47.017959 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.165918 3906202 logs.go:138] Found kubelet problem: Jul 01 15:10:50 old-k8s-version-474598 kubelet[731]: E0701 15:10:50.358024 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.167963 3906202 logs.go:138] Found kubelet problem: Jul 01 15:10:54 old-k8s-version-474598 kubelet[731]: E0701 15:10:54.630563 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0701 15:15:07.168291 3906202 logs.go:138] Found kubelet problem: Jul 01 15:11:01 old-k8s-version-474598 kubelet[731]: E0701 15:11:01.621361 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.168475 3906202 logs.go:138] Found kubelet problem: Jul 01 15:11:07 old-k8s-version-474598 kubelet[731]: E0701 15:11:07.623694 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.168802 3906202 logs.go:138] Found kubelet problem: Jul 01 15:11:16 old-k8s-version-474598 kubelet[731]: E0701 15:11:16.620700 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.168989 3906202 logs.go:138] Found kubelet problem: Jul 01 15:11:18 old-k8s-version-474598 kubelet[731]: E0701 15:11:18.621707 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.169598 3906202 logs.go:138] Found kubelet problem: Jul 01 15:11:28 old-k8s-version-474598 kubelet[731]: E0701 15:11:28.082520 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.169782 3906202 logs.go:138] Found kubelet problem: Jul 01 15:11:29 old-k8s-version-474598 kubelet[731]: E0701 15:11:29.621991 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.170112 3906202 logs.go:138] Found kubelet problem: Jul 01 15:11:30 old-k8s-version-474598 kubelet[731]: E0701 15:11:30.353335 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.170300 3906202 logs.go:138] Found kubelet problem: Jul 01 15:11:41 old-k8s-version-474598 kubelet[731]: E0701 15:11:41.622209 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.170628 3906202 logs.go:138] Found kubelet problem: Jul 01 15:11:42 old-k8s-version-474598 kubelet[731]: E0701 15:11:42.620768 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.170813 3906202 logs.go:138] Found kubelet problem: Jul 01 15:11:56 old-k8s-version-474598 kubelet[731]: E0701 15:11:56.621364 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.171140 3906202 logs.go:138] Found kubelet problem: Jul 01 15:11:56 old-k8s-version-474598 kubelet[731]: E0701 15:11:56.622121 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.171323 3906202 logs.go:138] Found kubelet problem: Jul 01 15:12:07 old-k8s-version-474598 kubelet[731]: E0701 15:12:07.622340 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.171650 3906202 logs.go:138] Found kubelet problem: Jul 01 15:12:08 old-k8s-version-474598 kubelet[731]: E0701 15:12:08.621109 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.172491 3906202 logs.go:138] Found kubelet problem: Jul 01 15:12:20 old-k8s-version-474598 kubelet[731]: E0701 15:12:20.620702 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.175122 3906202 logs.go:138] Found kubelet problem: Jul 01 15:12:20 old-k8s-version-474598 kubelet[731]: E0701 15:12:20.631313 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0701 15:15:07.175500 3906202 logs.go:138] Found kubelet problem: Jul 01 15:12:34 old-k8s-version-474598 kubelet[731]: E0701 15:12:34.620973 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.175715 3906202 logs.go:138] Found kubelet problem: Jul 01 15:12:34 old-k8s-version-474598 kubelet[731]: E0701 15:12:34.622005 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.175925 3906202 logs.go:138] Found kubelet problem: Jul 01 15:12:48 old-k8s-version-474598 kubelet[731]: E0701 15:12:48.621512 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.176539 3906202 logs.go:138] Found kubelet problem: Jul 01 15:12:51 old-k8s-version-474598 kubelet[731]: E0701 15:12:51.233147 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.176947 3906202 logs.go:138] Found kubelet problem: Jul 01 15:13:00 old-k8s-version-474598 kubelet[731]: E0701 15:13:00.353139 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.177170 3906202 logs.go:138] Found kubelet problem: Jul 01 15:13:00 old-k8s-version-474598 kubelet[731]: E0701 15:13:00.621289 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.178700 3906202 logs.go:138] Found kubelet problem: Jul 01 15:13:12 old-k8s-version-474598 kubelet[731]: E0701 15:13:12.621008 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.178996 3906202 logs.go:138] Found kubelet problem: Jul 01 15:13:12 old-k8s-version-474598 kubelet[731]: E0701 15:13:12.621572 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.179219 3906202 logs.go:138] Found kubelet problem: Jul 01 15:13:24 old-k8s-version-474598 kubelet[731]: E0701 15:13:24.621230 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.179574 3906202 logs.go:138] Found kubelet problem: Jul 01 15:13:25 old-k8s-version-474598 kubelet[731]: E0701 15:13:25.620763 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.179785 3906202 logs.go:138] Found kubelet problem: Jul 01 15:13:37 old-k8s-version-474598 kubelet[731]: E0701 15:13:37.621574 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.180140 3906202 logs.go:138] Found kubelet problem: Jul 01 15:13:39 old-k8s-version-474598 kubelet[731]: E0701 15:13:39.621765 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.180353 3906202 logs.go:138] Found kubelet problem: Jul 01 15:13:50 old-k8s-version-474598 kubelet[731]: E0701 15:13:50.621437 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.180708 3906202 logs.go:138] Found kubelet problem: Jul 01 15:13:54 old-k8s-version-474598 kubelet[731]: E0701 15:13:54.620755 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.180922 3906202 logs.go:138] Found kubelet problem: Jul 01 15:14:01 old-k8s-version-474598 kubelet[731]: E0701 15:14:01.621745 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.181292 3906202 logs.go:138] Found kubelet problem: Jul 01 15:14:07 old-k8s-version-474598 kubelet[731]: E0701 15:14:07.620754 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.181507 3906202 logs.go:138] Found kubelet problem: Jul 01 15:14:16 old-k8s-version-474598 kubelet[731]: E0701 15:14:16.622062 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.182110 3906202 logs.go:138] Found kubelet problem: Jul 01 15:14:22 old-k8s-version-474598 kubelet[731]: E0701 15:14:22.620813 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.182330 3906202 logs.go:138] Found kubelet problem: Jul 01 15:14:31 old-k8s-version-474598 kubelet[731]: E0701 15:14:31.621391 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.182743 3906202 logs.go:138] Found kubelet problem: Jul 01 15:14:33 old-k8s-version-474598 kubelet[731]: E0701 15:14:33.620802 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.182974 3906202 logs.go:138] Found kubelet problem: Jul 01 15:14:44 old-k8s-version-474598 kubelet[731]: E0701 15:14:44.621361 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.183328 3906202 logs.go:138] Found kubelet problem: Jul 01 15:14:48 old-k8s-version-474598 kubelet[731]: E0701 15:14:48.620740 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.183540 3906202 logs.go:138] Found kubelet problem: Jul 01 15:14:58 old-k8s-version-474598 kubelet[731]: E0701 15:14:58.621427 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.183895 3906202 logs.go:138] Found kubelet problem: Jul 01 15:15:01 old-k8s-version-474598 kubelet[731]: E0701 15:15:01.620856 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
I0701 15:15:07.183925 3906202 logs.go:123] Gathering logs for kube-controller-manager [6f249a20156ffcc8d1b05a5a0133a0476123eab1338f65400a301afe0851c461] ...
I0701 15:15:07.183955 3906202 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6f249a20156ffcc8d1b05a5a0133a0476123eab1338f65400a301afe0851c461"
I0701 15:15:07.290973 3906202 out.go:304] Setting ErrFile to fd 2...
I0701 15:15:07.291010 3906202 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0701 15:15:07.291072 3906202 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0701 15:15:07.291086 3906202 out.go:239] Jul 01 15:14:33 old-k8s-version-474598 kubelet[731]: E0701 15:14:33.620802 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
Jul 01 15:14:33 old-k8s-version-474598 kubelet[731]: E0701 15:14:33.620802 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.291102 3906202 out.go:239] Jul 01 15:14:44 old-k8s-version-474598 kubelet[731]: E0701 15:14:44.621361 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 15:14:44 old-k8s-version-474598 kubelet[731]: E0701 15:14:44.621361 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.291111 3906202 out.go:239] Jul 01 15:14:48 old-k8s-version-474598 kubelet[731]: E0701 15:14:48.620740 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
Jul 01 15:14:48 old-k8s-version-474598 kubelet[731]: E0701 15:14:48.620740 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
W0701 15:15:07.291128 3906202 out.go:239] Jul 01 15:14:58 old-k8s-version-474598 kubelet[731]: E0701 15:14:58.621427 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 15:14:58 old-k8s-version-474598 kubelet[731]: E0701 15:14:58.621427 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 15:15:07.291136 3906202 out.go:239] Jul 01 15:15:01 old-k8s-version-474598 kubelet[731]: E0701 15:15:01.620856 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
Jul 01 15:15:01 old-k8s-version-474598 kubelet[731]: E0701 15:15:01.620856 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
I0701 15:15:07.291145 3906202 out.go:304] Setting ErrFile to fd 2...
I0701 15:15:07.291152 3906202 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0701 15:15:17.292251 3906202 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0701 15:15:17.303658 3906202 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0701 15:15:17.328014 3906202 out.go:177]
W0701 15:15:17.337150 3906202 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0701 15:15:17.337199 3906202 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0701 15:15:17.337218 3906202 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0701 15:15:17.337223 3906202 out.go:239] *
*
W0701 15:15:17.343698 3906202 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0701 15:15:17.365344 3906202 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-474598 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-474598
helpers_test.go:235: (dbg) docker inspect old-k8s-version-474598:
-- stdout --
[
{
"Id": "488c1c329e41a6bb8e3ea135435a6e0d150e1847d966df238e8563a0593d59d7",
"Created": "2024-07-01T15:05:54.416833834Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 3906423,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-07-01T15:09:02.20288182Z",
"FinishedAt": "2024-07-01T15:09:00.506059017Z"
},
"Image": "sha256:59cf53f54b1bed0b432ebf08c6ac817bec062867b90e25c5452b8e7c3276a7ff",
"ResolvConfPath": "/var/lib/docker/containers/488c1c329e41a6bb8e3ea135435a6e0d150e1847d966df238e8563a0593d59d7/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/488c1c329e41a6bb8e3ea135435a6e0d150e1847d966df238e8563a0593d59d7/hostname",
"HostsPath": "/var/lib/docker/containers/488c1c329e41a6bb8e3ea135435a6e0d150e1847d966df238e8563a0593d59d7/hosts",
"LogPath": "/var/lib/docker/containers/488c1c329e41a6bb8e3ea135435a6e0d150e1847d966df238e8563a0593d59d7/488c1c329e41a6bb8e3ea135435a6e0d150e1847d966df238e8563a0593d59d7-json.log",
"Name": "/old-k8s-version-474598",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-474598:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-474598",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/4932492edb194f292342ed064ba8025da93a6b16caa302563b74636432c145d3-init/diff:/var/lib/docker/overlay2/c3139abb5cf1c83f6f12f6a5f4a9c8df468321ed41d6e455d104ebf4c7d8657d/diff",
"MergedDir": "/var/lib/docker/overlay2/4932492edb194f292342ed064ba8025da93a6b16caa302563b74636432c145d3/merged",
"UpperDir": "/var/lib/docker/overlay2/4932492edb194f292342ed064ba8025da93a6b16caa302563b74636432c145d3/diff",
"WorkDir": "/var/lib/docker/overlay2/4932492edb194f292342ed064ba8025da93a6b16caa302563b74636432c145d3/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-474598",
"Source": "/var/lib/docker/volumes/old-k8s-version-474598/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-474598",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-474598",
"name.minikube.sigs.k8s.io": "old-k8s-version-474598",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "daaf3b39f7ca7c3c74b58e05510be09109fc2c1c045dd6b3d365a80d436931cc",
"SandboxKey": "/var/run/docker/netns/daaf3b39f7ca",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34190"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34191"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34194"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34192"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34193"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-474598": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null,
"NetworkID": "bdbc927c6f3536ac21b1dc3dc9118a3a9e931ac2a36d769b0f88b8fbb40dcc13",
"EndpointID": "9075df8a8153d26f5fae246d1285a160d011a4abbf57562e467b74aee0a14869",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-474598",
"488c1c329e41"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-474598 -n old-k8s-version-474598
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-474598 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-474598 logs -n 25: (2.328585869s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| delete | -p cilium-637965 | cilium-637965 | jenkins | v1.33.1 | 01 Jul 24 15:04 UTC | 01 Jul 24 15:04 UTC |
| start | -p cert-expiration-603938 | cert-expiration-603938 | jenkins | v1.33.1 | 01 Jul 24 15:04 UTC | 01 Jul 24 15:05 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p force-systemd-env-737034 | force-systemd-env-737034 | jenkins | v1.33.1 | 01 Jul 24 15:05 UTC | 01 Jul 24 15:05 UTC |
| start | -p cert-options-257243 | cert-options-257243 | jenkins | v1.33.1 | 01 Jul 24 15:05 UTC | 01 Jul 24 15:05 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| ssh | cert-options-257243 ssh | cert-options-257243 | jenkins | v1.33.1 | 01 Jul 24 15:05 UTC | 01 Jul 24 15:05 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-257243 -- sudo | cert-options-257243 | jenkins | v1.33.1 | 01 Jul 24 15:05 UTC | 01 Jul 24 15:05 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-257243 | cert-options-257243 | jenkins | v1.33.1 | 01 Jul 24 15:05 UTC | 01 Jul 24 15:05 UTC |
| start | -p old-k8s-version-474598 | old-k8s-version-474598 | jenkins | v1.33.1 | 01 Jul 24 15:05 UTC | 01 Jul 24 15:08 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-603938 | cert-expiration-603938 | jenkins | v1.33.1 | 01 Jul 24 15:08 UTC | 01 Jul 24 15:08 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p cert-expiration-603938 | cert-expiration-603938 | jenkins | v1.33.1 | 01 Jul 24 15:08 UTC | 01 Jul 24 15:08 UTC |
| addons | enable metrics-server -p old-k8s-version-474598 | old-k8s-version-474598 | jenkins | v1.33.1 | 01 Jul 24 15:08 UTC | 01 Jul 24 15:08 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-474598 | old-k8s-version-474598 | jenkins | v1.33.1 | 01 Jul 24 15:08 UTC | 01 Jul 24 15:09 UTC |
| | --alsologtostderr -v=3 | | | | | |
| start | -p no-preload-969646 | no-preload-969646 | jenkins | v1.33.1 | 01 Jul 24 15:08 UTC | 01 Jul 24 15:10 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.30.2 | | | | | |
| addons | enable dashboard -p old-k8s-version-474598 | old-k8s-version-474598 | jenkins | v1.33.1 | 01 Jul 24 15:09 UTC | 01 Jul 24 15:09 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-474598 | old-k8s-version-474598 | jenkins | v1.33.1 | 01 Jul 24 15:09 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-969646 | no-preload-969646 | jenkins | v1.33.1 | 01 Jul 24 15:10 UTC | 01 Jul 24 15:10 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-969646 | no-preload-969646 | jenkins | v1.33.1 | 01 Jul 24 15:10 UTC | 01 Jul 24 15:10 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-969646 | no-preload-969646 | jenkins | v1.33.1 | 01 Jul 24 15:10 UTC | 01 Jul 24 15:10 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-969646 | no-preload-969646 | jenkins | v1.33.1 | 01 Jul 24 15:10 UTC | 01 Jul 24 15:14 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.30.2 | | | | | |
| image | no-preload-969646 image list | no-preload-969646 | jenkins | v1.33.1 | 01 Jul 24 15:15 UTC | 01 Jul 24 15:15 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-969646 | no-preload-969646 | jenkins | v1.33.1 | 01 Jul 24 15:15 UTC | 01 Jul 24 15:15 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-969646 | no-preload-969646 | jenkins | v1.33.1 | 01 Jul 24 15:15 UTC | 01 Jul 24 15:15 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-969646 | no-preload-969646 | jenkins | v1.33.1 | 01 Jul 24 15:15 UTC | 01 Jul 24 15:15 UTC |
| delete | -p no-preload-969646 | no-preload-969646 | jenkins | v1.33.1 | 01 Jul 24 15:15 UTC | 01 Jul 24 15:15 UTC |
| start | -p embed-certs-207952 | embed-certs-207952 | jenkins | v1.33.1 | 01 Jul 24 15:15 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.30.2 | | | | | |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/07/01 15:15:11
Running on machine: ip-172-31-21-244
Binary: Built with gc go1.22.4 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0701 15:15:11.829289 3915475 out.go:291] Setting OutFile to fd 1 ...
I0701 15:15:11.829496 3915475 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0701 15:15:11.829530 3915475 out.go:304] Setting ErrFile to fd 2...
I0701 15:15:11.829550 3915475 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0701 15:15:11.829843 3915475 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19166-3708336/.minikube/bin
I0701 15:15:11.830349 3915475 out.go:298] Setting JSON to false
I0701 15:15:11.831406 3915475 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":169063,"bootTime":1719677849,"procs":221,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1063-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
I0701 15:15:11.831518 3915475 start.go:139] virtualization:
I0701 15:15:11.836663 3915475 out.go:177] * [embed-certs-207952] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0701 15:15:11.839670 3915475 out.go:177] - MINIKUBE_LOCATION=19166
I0701 15:15:11.839742 3915475 notify.go:220] Checking for updates...
I0701 15:15:11.843894 3915475 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0701 15:15:11.847069 3915475 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19166-3708336/kubeconfig
I0701 15:15:11.849194 3915475 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19166-3708336/.minikube
I0701 15:15:11.851384 3915475 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0701 15:15:11.853602 3915475 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0701 15:15:11.856624 3915475 config.go:182] Loaded profile config "old-k8s-version-474598": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0701 15:15:11.856725 3915475 driver.go:392] Setting default libvirt URI to qemu:///system
I0701 15:15:11.891992 3915475 docker.go:122] docker version: linux-27.0.3:Docker Engine - Community
I0701 15:15:11.892149 3915475 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0701 15:15:11.969774 3915475 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:51 SystemTime:2024-07-01 15:15:11.95868505 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1063-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae71819c4f5e67bb4d5ae76a6b735f29cc25774e Expected:ae71819c4f5e67bb4d5ae76a6b735f29cc25774e} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
I0701 15:15:11.969880 3915475 docker.go:295] overlay module found
I0701 15:15:11.972239 3915475 out.go:177] * Using the docker driver based on user configuration
I0701 15:15:11.973977 3915475 start.go:297] selected driver: docker
I0701 15:15:11.973995 3915475 start.go:901] validating driver "docker" against <nil>
I0701 15:15:11.974009 3915475 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0701 15:15:11.974728 3915475 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0701 15:15:12.030139 3915475 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:51 SystemTime:2024-07-01 15:15:12.019209244 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1063-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae71819c4f5e67bb4d5ae76a6b735f29cc25774e Expected:ae71819c4f5e67bb4d5ae76a6b735f29cc25774e} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
I0701 15:15:12.030341 3915475 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0701 15:15:12.030588 3915475 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0701 15:15:12.032906 3915475 out.go:177] * Using Docker driver with root privileges
I0701 15:15:12.035178 3915475 cni.go:84] Creating CNI manager for ""
I0701 15:15:12.035210 3915475 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0701 15:15:12.035222 3915475 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0701 15:15:12.035325 3915475 start.go:340] cluster config:
{Name:embed-certs-207952 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:embed-certs-207952 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuth
Sock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0701 15:15:12.037810 3915475 out.go:177] * Starting "embed-certs-207952" primary control-plane node in "embed-certs-207952" cluster
I0701 15:15:12.039811 3915475 cache.go:121] Beginning downloading kic base image for docker with crio
I0701 15:15:12.042117 3915475 out.go:177] * Pulling base image v0.0.44-1719413016-19142 ...
I0701 15:15:12.044242 3915475 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime crio
I0701 15:15:12.044303 3915475 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19166-3708336/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-cri-o-overlay-arm64.tar.lz4
I0701 15:15:12.044325 3915475 cache.go:56] Caching tarball of preloaded images
I0701 15:15:12.044346 3915475 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d in local docker daemon
I0701 15:15:12.044427 3915475 preload.go:173] Found /home/jenkins/minikube-integration/19166-3708336/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-cri-o-overlay-arm64.tar.lz4 in cache, skipping download
I0701 15:15:12.044437 3915475 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on crio
I0701 15:15:12.044614 3915475 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-3708336/.minikube/profiles/embed-certs-207952/config.json ...
I0701 15:15:12.044654 3915475 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19166-3708336/.minikube/profiles/embed-certs-207952/config.json: {Name:mka97fe2965e2135cf7b28239bc9a7c58ffd4b18 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0701 15:15:12.062039 3915475 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d in local docker daemon, skipping pull
I0701 15:15:12.062070 3915475 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d exists in daemon, skipping load
I0701 15:15:12.062090 3915475 cache.go:194] Successfully downloaded all kic artifacts
I0701 15:15:12.062126 3915475 start.go:360] acquireMachinesLock for embed-certs-207952: {Name:mkd776ba3e1a32390baf4d44c3ff28f10b20be29 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0701 15:15:12.062252 3915475 start.go:364] duration metric: took 101.827µs to acquireMachinesLock for "embed-certs-207952"
I0701 15:15:12.062294 3915475 start.go:93] Provisioning new machine with config: &{Name:embed-certs-207952 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:embed-certs-207952 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false
CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}
I0701 15:15:12.062378 3915475 start.go:125] createHost starting for "" (driver="docker")
I0701 15:15:12.066003 3915475 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0701 15:15:12.066327 3915475 start.go:159] libmachine.API.Create for "embed-certs-207952" (driver="docker")
I0701 15:15:12.066366 3915475 client.go:168] LocalClient.Create starting
I0701 15:15:12.066435 3915475 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19166-3708336/.minikube/certs/ca.pem
I0701 15:15:12.066518 3915475 main.go:141] libmachine: Decoding PEM data...
I0701 15:15:12.066540 3915475 main.go:141] libmachine: Parsing certificate...
I0701 15:15:12.066602 3915475 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19166-3708336/.minikube/certs/cert.pem
I0701 15:15:12.066635 3915475 main.go:141] libmachine: Decoding PEM data...
I0701 15:15:12.066647 3915475 main.go:141] libmachine: Parsing certificate...
I0701 15:15:12.067032 3915475 cli_runner.go:164] Run: docker network inspect embed-certs-207952 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0701 15:15:12.087214 3915475 cli_runner.go:211] docker network inspect embed-certs-207952 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0701 15:15:12.087340 3915475 network_create.go:284] running [docker network inspect embed-certs-207952] to gather additional debugging logs...
I0701 15:15:12.087361 3915475 cli_runner.go:164] Run: docker network inspect embed-certs-207952
W0701 15:15:12.112388 3915475 cli_runner.go:211] docker network inspect embed-certs-207952 returned with exit code 1
I0701 15:15:12.112446 3915475 network_create.go:287] error running [docker network inspect embed-certs-207952]: docker network inspect embed-certs-207952: exit status 1
stdout:
[]
stderr:
Error response from daemon: network embed-certs-207952 not found
I0701 15:15:12.112463 3915475 network_create.go:289] output of [docker network inspect embed-certs-207952]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network embed-certs-207952 not found
** /stderr **
I0701 15:15:12.112644 3915475 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0701 15:15:12.130547 3915475 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-3cb95f1f57f2 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:32:62:e0:6d} reservation:<nil>}
I0701 15:15:12.131029 3915475 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-28e3ebdfe03a IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:97:4d:77:de} reservation:<nil>}
I0701 15:15:12.131599 3915475 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-2eca4f7c13a7 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:3c:53:3b:8f} reservation:<nil>}
I0701 15:15:12.132012 3915475 network.go:211] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName:br-bdbc927c6f35 IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:8d:4b:f6:f4} reservation:<nil>}
I0701 15:15:12.132790 3915475 network.go:206] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x400191add0}
I0701 15:15:12.132824 3915475 network_create.go:124] attempt to create docker network embed-certs-207952 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 1500 ...
I0701 15:15:12.132885 3915475 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-207952 embed-certs-207952
I0701 15:15:12.212230 3915475 network_create.go:108] docker network embed-certs-207952 192.168.85.0/24 created
I0701 15:15:12.212266 3915475 kic.go:121] calculated static IP "192.168.85.2" for the "embed-certs-207952" container
I0701 15:15:12.212357 3915475 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0701 15:15:12.234771 3915475 cli_runner.go:164] Run: docker volume create embed-certs-207952 --label name.minikube.sigs.k8s.io=embed-certs-207952 --label created_by.minikube.sigs.k8s.io=true
I0701 15:15:12.255121 3915475 oci.go:103] Successfully created a docker volume embed-certs-207952
I0701 15:15:12.255220 3915475 cli_runner.go:164] Run: docker run --rm --name embed-certs-207952-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-207952 --entrypoint /usr/bin/test -v embed-certs-207952:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d -d /var/lib
I0701 15:15:12.935274 3915475 oci.go:107] Successfully prepared a docker volume embed-certs-207952
I0701 15:15:12.935328 3915475 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime crio
I0701 15:15:12.935349 3915475 kic.go:194] Starting extracting preloaded images to volume ...
I0701 15:15:12.935432 3915475 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19166-3708336/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-cri-o-overlay-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-207952:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d -I lz4 -xf /preloaded.tar -C /extractDir
I0701 15:15:17.292251 3906202 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0701 15:15:17.303658 3906202 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0701 15:15:17.328014 3906202 out.go:177]
W0701 15:15:17.337150 3906202 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0701 15:15:17.337199 3906202 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0701 15:15:17.337218 3906202 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0701 15:15:17.337223 3906202 out.go:239] *
W0701 15:15:17.343698 3906202 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0701 15:15:17.365344 3906202 out.go:177]
==> CRI-O <==
Jul 01 15:13:00 old-k8s-version-474598 crio[618]: time="2024-07-01 15:13:00.620952060Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=2023c74c-3920-467e-a8da-a319abbed76b name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:13:12 old-k8s-version-474598 crio[618]: time="2024-07-01 15:13:12.620928211Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=f655d734-b729-424c-8d86-e5eb9bcd9df6 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:13:12 old-k8s-version-474598 crio[618]: time="2024-07-01 15:13:12.621294130Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=f655d734-b729-424c-8d86-e5eb9bcd9df6 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:13:24 old-k8s-version-474598 crio[618]: time="2024-07-01 15:13:24.620698350Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=169a1a9d-77ea-4a5e-bd14-d0695d403013 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:13:24 old-k8s-version-474598 crio[618]: time="2024-07-01 15:13:24.620933052Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=169a1a9d-77ea-4a5e-bd14-d0695d403013 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:13:37 old-k8s-version-474598 crio[618]: time="2024-07-01 15:13:37.620766644Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=b6e1233f-5871-453e-90de-737bd4b84110 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:13:37 old-k8s-version-474598 crio[618]: time="2024-07-01 15:13:37.621000804Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=b6e1233f-5871-453e-90de-737bd4b84110 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:13:50 old-k8s-version-474598 crio[618]: time="2024-07-01 15:13:50.620835090Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=4156ea16-87f2-45cb-b51c-4301873c0889 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:13:50 old-k8s-version-474598 crio[618]: time="2024-07-01 15:13:50.621184501Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=4156ea16-87f2-45cb-b51c-4301873c0889 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:14:01 old-k8s-version-474598 crio[618]: time="2024-07-01 15:14:01.621079067Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=f9a092b0-2408-48c8-a195-76bb8e01592e name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:14:01 old-k8s-version-474598 crio[618]: time="2024-07-01 15:14:01.621333199Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=f9a092b0-2408-48c8-a195-76bb8e01592e name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:14:16 old-k8s-version-474598 crio[618]: time="2024-07-01 15:14:16.620912420Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=c845a48b-0c31-47c8-8e13-41c8e3b25d8e name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:14:16 old-k8s-version-474598 crio[618]: time="2024-07-01 15:14:16.621247126Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=c845a48b-0c31-47c8-8e13-41c8e3b25d8e name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:14:19 old-k8s-version-474598 crio[618]: time="2024-07-01 15:14:19.518149299Z" level=info msg="Checking image status: k8s.gcr.io/pause:3.2" id=8764fb57-4f6e-425c-b269-9178b4d34c07 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:14:19 old-k8s-version-474598 crio[618]: time="2024-07-01 15:14:19.518390089Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:2a060e2e7101d419352bf82c613158587400be743482d9a537ec4a9d1b4eb93c,RepoTags:[k8s.gcr.io/pause:3.2 registry.k8s.io/pause:3.2],RepoDigests:[k8s.gcr.io/pause@sha256:31d3efd12022ffeffb3146bc10ae8beb890c80ed2f07363515580add7ed47636 k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f registry.k8s.io/pause@sha256:31d3efd12022ffeffb3146bc10ae8beb890c80ed2f07363515580add7ed47636 registry.k8s.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f],Size_:489397,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=8764fb57-4f6e-425c-b269-9178b4d34c07 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:14:31 old-k8s-version-474598 crio[618]: time="2024-07-01 15:14:31.620786592Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=9d02c36e-9b2d-4063-9026-0a13e0e30206 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:14:31 old-k8s-version-474598 crio[618]: time="2024-07-01 15:14:31.621049347Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=9d02c36e-9b2d-4063-9026-0a13e0e30206 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:14:44 old-k8s-version-474598 crio[618]: time="2024-07-01 15:14:44.620792607Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=1dd8e769-984d-40d8-8764-824e74e75dab name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:14:44 old-k8s-version-474598 crio[618]: time="2024-07-01 15:14:44.621150091Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=1dd8e769-984d-40d8-8764-824e74e75dab name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:14:58 old-k8s-version-474598 crio[618]: time="2024-07-01 15:14:58.620834647Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=e346ed8e-8338-4f0d-8b00-87bb7b43ecd0 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:14:58 old-k8s-version-474598 crio[618]: time="2024-07-01 15:14:58.621188504Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=e346ed8e-8338-4f0d-8b00-87bb7b43ecd0 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:15:09 old-k8s-version-474598 crio[618]: time="2024-07-01 15:15:09.621156632Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=8944d523-d81a-4a47-aeb1-7fafd3ad4ba2 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:15:09 old-k8s-version-474598 crio[618]: time="2024-07-01 15:15:09.621393664Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=8944d523-d81a-4a47-aeb1-7fafd3ad4ba2 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 01 15:15:09 old-k8s-version-474598 crio[618]: time="2024-07-01 15:15:09.622088357Z" level=info msg="Pulling image: fake.domain/registry.k8s.io/echoserver:1.4" id=6e7b9895-750c-49c7-bf6a-0fd0ef7930fb name=/runtime.v1alpha2.ImageService/PullImage
Jul 01 15:15:09 old-k8s-version-474598 crio[618]: time="2024-07-01 15:15:09.627630177Z" level=info msg="Trying to access \"fake.domain/registry.k8s.io/echoserver:1.4\""
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
c5883918438fc a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7 2 minutes ago Exited dashboard-metrics-scraper 5 964f4d9677e1f dashboard-metrics-scraper-8d5bb5db8-ppb9p
870578f023cca docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93 5 minutes ago Running kubernetes-dashboard 0 949bead633303 kubernetes-dashboard-cd95d586-wrff2
25c8776f1771d ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6 5 minutes ago Running storage-provisioner 0 4c23d0c907a2a storage-provisioner
ec86544b4349a 1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c 5 minutes ago Running busybox 0 152ab9f058bf9 busybox
d6c47f5e5c008 89d73d416b992e8f9602b67b4614d9e7f0655aebb3696e18efec695e0b654c40 5 minutes ago Running kindnet-cni 0 93a6791743c47 kindnet-4k4lt
585eb048d28ee db91994f4ee8f894a1e8a6c1a76f615da8fc3c019300a3686291ce6fcbc57895 5 minutes ago Running coredns 0 7c0f56b14f84d coredns-74ff55c5b-6nqwr
4f612ce98e504 25a5233254979d0678a2db1d15b76b73dc380d81bc5eed93916ba5638b3cd894 5 minutes ago Running kube-proxy 0 2767ab30c048a kube-proxy-prspm
6f249a20156ff 1df8a2b116bd16f7070fd383a6769c8d644b365575e8ffa3e492b84e4f05fc74 5 minutes ago Running kube-controller-manager 0 5b1dd556f22be kube-controller-manager-old-k8s-version-474598
8937951752f8c 05b738aa1bc6355db8a2ee8639f3631b908286e43f584a3d2ee0c472de033c28 5 minutes ago Running etcd 0 768c29981e415 etcd-old-k8s-version-474598
99b47a1789a53 e7605f88f17d6a4c3f083ef9c6f5f19b39f87e4d4406a05a8612b54a6ea57051 5 minutes ago Running kube-scheduler 0 cf77d737fcaa7 kube-scheduler-old-k8s-version-474598
29ff1e584547a 2c08bbbc02d3aa5dfbf4e79f15c0a61424049288917aa10364464ca1f7de7157 5 minutes ago Running kube-apiserver 0 b7a013cb4d874 kube-apiserver-old-k8s-version-474598
==> coredns [585eb048d28eef3f91142d493ebacd44932dc6beaeb62efc44eef6e21a027d29] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:51952 - 42951 "HINFO IN 9146435228650152897.2704546719472669548. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.011730957s
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:44443 - 28859 "HINFO IN 2863620352919622520.3109769025305134213. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.033939018s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I0701 15:10:06.387349 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-01 15:09:36.386675205 +0000 UTC m=+0.121971736) (total time: 30.00056638s):
Trace[2019727887]: [30.00056638s] [30.00056638s] END
E0701 15:10:06.387481 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0701 15:10:06.387526 1 trace.go:116] Trace[1427131847]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-01 15:09:36.38725098 +0000 UTC m=+0.122547511) (total time: 30.000256511s):
Trace[1427131847]: [30.000256511s] [30.000256511s] END
E0701 15:10:06.387542 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0701 15:10:06.387823 1 trace.go:116] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-01 15:09:36.387588116 +0000 UTC m=+0.122884663) (total time: 30.000220761s):
Trace[911902081]: [30.000220761s] [30.000220761s] END
E0701 15:10:06.387831 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> describe nodes <==
Name: old-k8s-version-474598
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-474598
kubernetes.io/os=linux
minikube.k8s.io/commit=f87dc4b1adfa3faf30393d14b8f7fb9acc5e991c
minikube.k8s.io/name=old-k8s-version-474598
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_07_01T15_06_41_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 01 Jul 2024 15:06:38 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-474598
AcquireTime: <unset>
RenewTime: Mon, 01 Jul 2024 15:15:14 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 01 Jul 2024 15:10:25 +0000 Mon, 01 Jul 2024 15:06:32 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 01 Jul 2024 15:10:25 +0000 Mon, 01 Jul 2024 15:06:32 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 01 Jul 2024 15:10:25 +0000 Mon, 01 Jul 2024 15:06:32 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 01 Jul 2024 15:10:25 +0000 Mon, 01 Jul 2024 15:07:09 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-474598
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022360Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022360Ki
pods: 110
System Info:
Machine ID: b0337712096d4a84b29e48b38b4b0a40
System UUID: 0c4fd3b9-24c5-4785-ab57-e69a0a8b8da1
Boot ID: 030faa4f-44aa-434e-978f-182f6d212f48
Kernel Version: 5.15.0-1063-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: cri-o://1.24.6
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m42s
kube-system coredns-74ff55c5b-6nqwr 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m22s
kube-system etcd-old-k8s-version-474598 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m30s
kube-system kindnet-4k4lt 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 8m22s
kube-system kube-apiserver-old-k8s-version-474598 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m30s
kube-system kube-controller-manager-old-k8s-version-474598 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m30s
kube-system kube-proxy-prspm 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m22s
kube-system kube-scheduler-old-k8s-version-474598 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m30s
kube-system metrics-server-9975d5f86-99tkb 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m31s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m20s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-ppb9p 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m28s
kubernetes-dashboard kubernetes-dashboard-cd95d586-wrff2 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m28s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m49s (x5 over 8m49s) kubelet Node old-k8s-version-474598 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m49s (x5 over 8m49s) kubelet Node old-k8s-version-474598 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m49s (x4 over 8m49s) kubelet Node old-k8s-version-474598 status is now: NodeHasSufficientPID
Normal Starting 8m30s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m30s kubelet Node old-k8s-version-474598 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m30s kubelet Node old-k8s-version-474598 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m30s kubelet Node old-k8s-version-474598 status is now: NodeHasSufficientPID
Normal Starting 8m20s kube-proxy Starting kube-proxy.
Normal NodeReady 8m10s kubelet Node old-k8s-version-474598 status is now: NodeReady
Normal Starting 6m kubelet Starting kubelet.
Normal NodeHasSufficientMemory 6m (x8 over 6m) kubelet Node old-k8s-version-474598 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m (x8 over 6m) kubelet Node old-k8s-version-474598 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m (x8 over 6m) kubelet Node old-k8s-version-474598 status is now: NodeHasSufficientPID
Normal Starting 5m43s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.000739] FS-Cache: N-cookie c=000001f2 [p=000001e9 fl=2 nc=0 na=1]
[ +0.000919] FS-Cache: N-cookie d=00000000ac0c5ba0{9p.inode} n=000000002bcd9820
[ +0.001021] FS-Cache: N-key=[8] '7f903b0000000000'
[ +0.003039] FS-Cache: Duplicate cookie detected
[ +0.000679] FS-Cache: O-cookie c=000001ec [p=000001e9 fl=226 nc=0 na=1]
[ +0.000953] FS-Cache: O-cookie d=00000000ac0c5ba0{9p.inode} n=000000004cf8c411
[ +0.001075] FS-Cache: O-key=[8] '7f903b0000000000'
[ +0.000699] FS-Cache: N-cookie c=000001f3 [p=000001e9 fl=2 nc=0 na=1]
[ +0.000920] FS-Cache: N-cookie d=00000000ac0c5ba0{9p.inode} n=000000007108af87
[ +0.001036] FS-Cache: N-key=[8] '7f903b0000000000'
[ +2.349943] FS-Cache: Duplicate cookie detected
[ +0.000692] FS-Cache: O-cookie c=000001ea [p=000001e9 fl=226 nc=0 na=1]
[ +0.000979] FS-Cache: O-cookie d=00000000ac0c5ba0{9p.inode} n=000000003e41755a
[ +0.001031] FS-Cache: O-key=[8] '7e903b0000000000'
[ +0.000727] FS-Cache: N-cookie c=000001f5 [p=000001e9 fl=2 nc=0 na=1]
[ +0.000922] FS-Cache: N-cookie d=00000000ac0c5ba0{9p.inode} n=0000000049bce9d6
[ +0.001027] FS-Cache: N-key=[8] '7e903b0000000000'
[ +0.286123] FS-Cache: Duplicate cookie detected
[ +0.000698] FS-Cache: O-cookie c=000001ef [p=000001e9 fl=226 nc=0 na=1]
[ +0.000952] FS-Cache: O-cookie d=00000000ac0c5ba0{9p.inode} n=000000001ef70645
[ +0.001038] FS-Cache: O-key=[8] '84903b0000000000'
[ +0.000692] FS-Cache: N-cookie c=000001f6 [p=000001e9 fl=2 nc=0 na=1]
[ +0.000940] FS-Cache: N-cookie d=00000000ac0c5ba0{9p.inode} n=000000002bcd9820
[ +0.001037] FS-Cache: N-key=[8] '84903b0000000000'
[Jul 1 15:03] overlayfs: '/var/lib/containers/storage/overlay/l/Q2QJNMTVZL6GMULS36RA5ZJGSA' not a directory
==> etcd [8937951752f8cf91f00237b6ccb23193fd6ae6e0c75a210a7eb01e45df33434f] <==
2024-07-01 15:11:18.305846 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:11:28.306002 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:11:38.305796 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:11:48.307040 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:11:58.305897 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:12:08.305803 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:12:18.305814 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:12:28.305973 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:12:38.305865 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:12:48.305764 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:12:58.305771 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:13:08.305874 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:13:18.305769 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:13:28.305893 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:13:38.305706 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:13:48.305859 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:13:58.305781 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:14:08.305930 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:14:18.305925 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:14:28.305881 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:14:38.305936 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:14:48.305889 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:14:58.305763 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:15:08.305926 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 15:15:18.307112 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
15:15:19 up 1 day, 22:57, 0 users, load average: 1.58, 1.87, 2.31
Linux old-k8s-version-474598 5.15.0-1063-aws #69~20.04.1-Ubuntu SMP Fri May 10 19:21:30 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [d6c47f5e5c008f8c4904f4fab278a0c43bd06a808a8fc9f67cc24c2e47316d28] <==
I0701 15:13:18.576737 1 main.go:227] handling current node
I0701 15:13:28.584299 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0701 15:13:28.584328 1 main.go:227] handling current node
I0701 15:13:38.596440 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0701 15:13:38.596466 1 main.go:227] handling current node
I0701 15:13:48.612265 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0701 15:13:48.612292 1 main.go:227] handling current node
I0701 15:13:58.627310 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0701 15:13:58.627340 1 main.go:227] handling current node
I0701 15:14:08.643673 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0701 15:14:08.643699 1 main.go:227] handling current node
I0701 15:14:18.667857 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0701 15:14:18.667882 1 main.go:227] handling current node
I0701 15:14:28.673186 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0701 15:14:28.673218 1 main.go:227] handling current node
I0701 15:14:38.701187 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0701 15:14:38.701294 1 main.go:227] handling current node
I0701 15:14:48.715497 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0701 15:14:48.715526 1 main.go:227] handling current node
I0701 15:14:58.727454 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0701 15:14:58.727482 1 main.go:227] handling current node
I0701 15:15:08.744501 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0701 15:15:08.744530 1 main.go:227] handling current node
I0701 15:15:18.781097 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0701 15:15:18.781129 1 main.go:227] handling current node
==> kube-apiserver [29ff1e584547a3f1954c3b3bc8d86133f9f8821165607c401129fbb1ad25343b] <==
I0701 15:11:51.827295 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0701 15:11:51.827304 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0701 15:12:36.351119 1 handler_proxy.go:102] no RequestInfo found in the context
E0701 15:12:36.351195 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0701 15:12:36.351202 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0701 15:12:36.710335 1 client.go:360] parsed scheme: "passthrough"
I0701 15:12:36.710391 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0701 15:12:36.710401 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0701 15:13:16.035790 1 client.go:360] parsed scheme: "passthrough"
I0701 15:13:16.035835 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0701 15:13:16.035844 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0701 15:13:54.951035 1 client.go:360] parsed scheme: "passthrough"
I0701 15:13:54.951077 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0701 15:13:54.951086 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0701 15:14:27.676333 1 client.go:360] parsed scheme: "passthrough"
I0701 15:14:27.676380 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0701 15:14:27.676389 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0701 15:14:33.180051 1 handler_proxy.go:102] no RequestInfo found in the context
E0701 15:14:33.180144 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0701 15:14:33.180152 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0701 15:15:02.926054 1 client.go:360] parsed scheme: "passthrough"
I0701 15:15:02.926101 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0701 15:15:02.926110 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [6f249a20156ffcc8d1b05a5a0133a0476123eab1338f65400a301afe0851c461] <==
W0701 15:10:57.492079 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0701 15:11:25.184324 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0701 15:11:29.142605 1 request.go:655] Throttling request took 1.036824677s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0701 15:11:29.994051 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0701 15:11:55.686077 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0701 15:12:01.644523 1 request.go:655] Throttling request took 1.048502614s, request: GET:https://192.168.76.2:8443/apis/networking.k8s.io/v1beta1?timeout=32s
W0701 15:12:02.497484 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0701 15:12:26.188186 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0701 15:12:34.147823 1 request.go:655] Throttling request took 1.048341901s, request: GET:https://192.168.76.2:8443/apis/certificates.k8s.io/v1beta1?timeout=32s
W0701 15:12:34.999272 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0701 15:12:56.690076 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0701 15:13:06.649658 1 request.go:655] Throttling request took 1.048413098s, request: GET:https://192.168.76.2:8443/apis/scheduling.k8s.io/v1beta1?timeout=32s
W0701 15:13:07.502379 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0701 15:13:27.192561 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0701 15:13:39.153528 1 request.go:655] Throttling request took 1.04835187s, request: GET:https://192.168.76.2:8443/apis/coordination.k8s.io/v1?timeout=32s
W0701 15:13:40.013288 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0701 15:13:57.694451 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0701 15:14:11.664705 1 request.go:655] Throttling request took 1.048493432s, request: GET:https://192.168.76.2:8443/apis/networking.k8s.io/v1beta1?timeout=32s
W0701 15:14:12.516177 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0701 15:14:28.196216 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0701 15:14:44.166690 1 request.go:655] Throttling request took 1.048299094s, request: GET:https://192.168.76.2:8443/apis/certificates.k8s.io/v1beta1?timeout=32s
W0701 15:14:45.019046 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0701 15:14:58.698101 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0701 15:15:16.669549 1 request.go:655] Throttling request took 1.047585735s, request: GET:https://192.168.76.2:8443/apis/rbac.authorization.k8s.io/v1?timeout=32s
W0701 15:15:17.521162 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-proxy [4f612ce98e504e45b0b7d45ab196646d112950fff7af0818ed6b6ae20f451730] <==
I0701 15:06:59.908164 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0701 15:06:59.908439 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0701 15:06:59.919951 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0701 15:06:59.920037 1 server_others.go:185] Using iptables Proxier.
I0701 15:06:59.920289 1 server.go:650] Version: v1.20.0
I0701 15:06:59.921588 1 config.go:224] Starting endpoint slice config controller
I0701 15:06:59.921702 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0701 15:06:59.922482 1 config.go:315] Starting service config controller
I0701 15:06:59.922558 1 shared_informer.go:240] Waiting for caches to sync for service config
I0701 15:07:00.034958 1 shared_informer.go:247] Caches are synced for service config
I0701 15:07:00.035018 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0701 15:09:36.629035 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0701 15:09:36.629119 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0701 15:09:36.641586 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0701 15:09:36.641762 1 server_others.go:185] Using iptables Proxier.
I0701 15:09:36.643101 1 server.go:650] Version: v1.20.0
I0701 15:09:36.645886 1 config.go:315] Starting service config controller
I0701 15:09:36.658875 1 shared_informer.go:240] Waiting for caches to sync for service config
I0701 15:09:36.658962 1 shared_informer.go:247] Caches are synced for service config
I0701 15:09:36.652513 1 config.go:224] Starting endpoint slice config controller
I0701 15:09:36.659095 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0701 15:09:36.659122 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-scheduler [99b47a1789a53fcc22fad9c608f7e9a89470909c3bed1f74b857b5da84b94f8c] <==
E0701 15:06:38.093200 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0701 15:06:38.099427 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0701 15:06:38.099687 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0701 15:06:38.099782 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0701 15:06:38.099860 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0701 15:06:38.099933 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0701 15:06:38.100004 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0701 15:06:38.100071 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0701 15:06:38.100150 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0701 15:06:38.100274 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0701 15:06:38.100352 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0701 15:06:38.100417 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0701 15:06:39.024361 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0701 15:06:39.097518 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
I0701 15:06:39.779607 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0701 15:09:26.569738 1 serving.go:331] Generated self-signed cert in-memory
W0701 15:09:32.101571 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0701 15:09:32.101717 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0701 15:09:32.101732 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0701 15:09:32.101738 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0701 15:09:32.243752 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0701 15:09:32.249148 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0701 15:09:32.253158 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0701 15:09:32.253343 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0701 15:09:32.390803 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Jul 01 15:13:50 old-k8s-version-474598 kubelet[731]: E0701 15:13:50.621437 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 15:13:54 old-k8s-version-474598 kubelet[731]: I0701 15:13:54.620418 731 scope.go:95] [topologymanager] RemoveContainer - Container ID: c5883918438fc46716a63a35a6278fc60f6b19c1de9f1d272d946ab4b8c49aca
Jul 01 15:13:54 old-k8s-version-474598 kubelet[731]: E0701 15:13:54.620755 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
Jul 01 15:14:01 old-k8s-version-474598 kubelet[731]: E0701 15:14:01.621745 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 15:14:07 old-k8s-version-474598 kubelet[731]: I0701 15:14:07.620415 731 scope.go:95] [topologymanager] RemoveContainer - Container ID: c5883918438fc46716a63a35a6278fc60f6b19c1de9f1d272d946ab4b8c49aca
Jul 01 15:14:07 old-k8s-version-474598 kubelet[731]: E0701 15:14:07.620754 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
Jul 01 15:14:16 old-k8s-version-474598 kubelet[731]: E0701 15:14:16.622062 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 15:14:19 old-k8s-version-474598 kubelet[731]: E0701 15:14:19.598995 731 container_manager_linux.go:533] failed to find cgroups of kubelet - cpu and memory cgroup hierarchy not unified. cpu: /docker/488c1c329e41a6bb8e3ea135435a6e0d150e1847d966df238e8563a0593d59d7, memory: /docker/488c1c329e41a6bb8e3ea135435a6e0d150e1847d966df238e8563a0593d59d7/system.slice/kubelet.service
Jul 01 15:14:22 old-k8s-version-474598 kubelet[731]: I0701 15:14:22.620459 731 scope.go:95] [topologymanager] RemoveContainer - Container ID: c5883918438fc46716a63a35a6278fc60f6b19c1de9f1d272d946ab4b8c49aca
Jul 01 15:14:22 old-k8s-version-474598 kubelet[731]: E0701 15:14:22.620813 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
Jul 01 15:14:31 old-k8s-version-474598 kubelet[731]: E0701 15:14:31.621391 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 15:14:33 old-k8s-version-474598 kubelet[731]: I0701 15:14:33.620477 731 scope.go:95] [topologymanager] RemoveContainer - Container ID: c5883918438fc46716a63a35a6278fc60f6b19c1de9f1d272d946ab4b8c49aca
Jul 01 15:14:33 old-k8s-version-474598 kubelet[731]: E0701 15:14:33.620802 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
Jul 01 15:14:44 old-k8s-version-474598 kubelet[731]: E0701 15:14:44.621361 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 15:14:48 old-k8s-version-474598 kubelet[731]: I0701 15:14:48.620387 731 scope.go:95] [topologymanager] RemoveContainer - Container ID: c5883918438fc46716a63a35a6278fc60f6b19c1de9f1d272d946ab4b8c49aca
Jul 01 15:14:48 old-k8s-version-474598 kubelet[731]: E0701 15:14:48.620740 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
Jul 01 15:14:58 old-k8s-version-474598 kubelet[731]: E0701 15:14:58.621427 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 15:15:01 old-k8s-version-474598 kubelet[731]: I0701 15:15:01.620520 731 scope.go:95] [topologymanager] RemoveContainer - Container ID: c5883918438fc46716a63a35a6278fc60f6b19c1de9f1d272d946ab4b8c49aca
Jul 01 15:15:01 old-k8s-version-474598 kubelet[731]: E0701 15:15:01.620856 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
Jul 01 15:15:09 old-k8s-version-474598 kubelet[731]: E0701 15:15:09.632533 731 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Jul 01 15:15:09 old-k8s-version-474598 kubelet[731]: E0701 15:15:09.632589 731 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Jul 01 15:15:09 old-k8s-version-474598 kubelet[731]: E0701 15:15:09.632785 731 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-tnwnp,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-99tkb_kube-system(7e29841
1-ec18-491b-b64f-48a78925d9cf): ErrImagePull: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Jul 01 15:15:09 old-k8s-version-474598 kubelet[731]: E0701 15:15:09.632816 731 pod_workers.go:191] Error syncing pod 7e298411-ec18-491b-b64f-48a78925d9cf ("metrics-server-9975d5f86-99tkb_kube-system(7e298411-ec18-491b-b64f-48a78925d9cf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
Jul 01 15:15:12 old-k8s-version-474598 kubelet[731]: I0701 15:15:12.621005 731 scope.go:95] [topologymanager] RemoveContainer - Container ID: c5883918438fc46716a63a35a6278fc60f6b19c1de9f1d272d946ab4b8c49aca
Jul 01 15:15:12 old-k8s-version-474598 kubelet[731]: E0701 15:15:12.621391 731 pod_workers.go:191] Error syncing pod c0d271ca-8841-4811-a61c-55f3d52669c4 ("dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-ppb9p_kubernetes-dashboard(c0d271ca-8841-4811-a61c-55f3d52669c4)"
==> kubernetes-dashboard [870578f023cca426ce7d3f51bb2af8cb79612ae25002a652dcbcb30bc1690ed1] <==
2024/07/01 15:10:04 Starting overwatch
2024/07/01 15:10:04 Using namespace: kubernetes-dashboard
2024/07/01 15:10:04 Using in-cluster config to connect to apiserver
2024/07/01 15:10:04 Using secret token for csrf signing
2024/07/01 15:10:04 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/07/01 15:10:04 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/07/01 15:10:04 Successful initial request to the apiserver, version: v1.20.0
2024/07/01 15:10:04 Generating JWE encryption key
2024/07/01 15:10:04 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/07/01 15:10:04 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/07/01 15:10:04 Initializing JWE encryption key from synchronized object
2024/07/01 15:10:04 Creating in-cluster Sidecar client
2024/07/01 15:10:04 Serving insecurely on HTTP port: 9090
2024/07/01 15:10:04 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/01 15:10:34 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/01 15:11:04 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/01 15:11:34 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/01 15:12:04 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/01 15:12:34 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/01 15:13:04 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/01 15:13:34 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/01 15:14:04 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/01 15:14:34 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/01 15:15:04 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
==> storage-provisioner [25c8776f1771df2532ca9cb51b3c40a3778154fec4f38ce0727c6e4b29adc787] <==
I0701 15:07:14.755208 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0701 15:07:14.776230 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0701 15:07:14.778421 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0701 15:07:14.821724 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0701 15:07:14.821979 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-474598_d23fcb95-97a6-47e8-a648-21f64f216e8e!
I0701 15:07:14.822676 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"1eb87cdf-19d1-44a8-b26a-bf206c9de2f7", APIVersion:"v1", ResourceVersion:"489", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-474598_d23fcb95-97a6-47e8-a648-21f64f216e8e became leader
I0701 15:07:14.922942 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-474598_d23fcb95-97a6-47e8-a648-21f64f216e8e!
I0701 15:09:49.795184 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0701 15:09:49.816447 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0701 15:09:49.816645 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0701 15:10:07.321364 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0701 15:10:07.321525 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-474598_5559e759-e0c4-46f4-a073-f252aad476fe!
I0701 15:10:07.322535 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"1eb87cdf-19d1-44a8-b26a-bf206c9de2f7", APIVersion:"v1", ResourceVersion:"827", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-474598_5559e759-e0c4-46f4-a073-f252aad476fe became leader
I0701 15:10:07.422638 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-474598_5559e759-e0c4-46f4-a073-f252aad476fe!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-474598 -n old-k8s-version-474598
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-474598 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-99tkb
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-474598 describe pod metrics-server-9975d5f86-99tkb
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-474598 describe pod metrics-server-9975d5f86-99tkb: exit status 1 (97.034752ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-99tkb" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-474598 describe pod metrics-server-9975d5f86-99tkb: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (379.23s)