=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-475170 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
E0920 18:31:00.179430 299684 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19672-294290/.minikube/profiles/functional-129075/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-475170 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m10.795924283s)
-- stdout --
* [old-k8s-version-475170] minikube v1.34.0 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=19672
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19672-294290/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19672-294290/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.31.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.1
* Using the docker driver based on existing profile
* Starting "old-k8s-version-475170" primary control-plane node in "old-k8s-version-475170" cluster
* Pulling base image v0.0.45-1726784731-19672 ...
* Restarting existing docker container for "old-k8s-version-475170" ...
* Preparing Kubernetes v1.20.0 on containerd 1.7.22 ...
* Verifying Kubernetes components...
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-475170 addons enable metrics-server
* Enabled addons: metrics-server, storage-provisioner, default-storageclass, dashboard
-- /stdout --
** stderr **
I0920 18:30:52.190850 506753 out.go:345] Setting OutFile to fd 1 ...
I0920 18:30:52.195180 506753 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0920 18:30:52.195194 506753 out.go:358] Setting ErrFile to fd 2...
I0920 18:30:52.195199 506753 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0920 18:30:52.195470 506753 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19672-294290/.minikube/bin
I0920 18:30:52.195866 506753 out.go:352] Setting JSON to false
I0920 18:30:52.196789 506753 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":8003,"bootTime":1726849050,"procs":209,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0920 18:30:52.196850 506753 start.go:139] virtualization:
I0920 18:30:52.199352 506753 out.go:177] * [old-k8s-version-475170] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I0920 18:30:52.201887 506753 out.go:177] - MINIKUBE_LOCATION=19672
I0920 18:30:52.202094 506753 notify.go:220] Checking for updates...
I0920 18:30:52.206433 506753 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0920 18:30:52.208871 506753 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19672-294290/kubeconfig
I0920 18:30:52.211063 506753 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19672-294290/.minikube
I0920 18:30:52.213117 506753 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0920 18:30:52.215396 506753 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0920 18:30:52.218093 506753 config.go:182] Loaded profile config "old-k8s-version-475170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0920 18:30:52.221094 506753 out.go:177] * Kubernetes 1.31.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.1
I0920 18:30:52.223456 506753 driver.go:394] Setting default libvirt URI to qemu:///system
I0920 18:30:52.278912 506753 docker.go:123] docker version: linux-27.3.0:Docker Engine - Community
I0920 18:30:52.279115 506753 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0920 18:30:52.443924 506753 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:59 OomKillDisable:true NGoroutines:68 SystemTime:2024-09-20 18:30:52.383250926 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214839296 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.3.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.6]] Warnings:<nil>}}
I0920 18:30:52.444037 506753 docker.go:318] overlay module found
I0920 18:30:52.446447 506753 out.go:177] * Using the docker driver based on existing profile
I0920 18:30:52.448457 506753 start.go:297] selected driver: docker
I0920 18:30:52.448473 506753 start.go:901] validating driver "docker" against &{Name:old-k8s-version-475170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-475170 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0920 18:30:52.448593 506753 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0920 18:30:52.449191 506753 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0920 18:30:52.526441 506753 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:49 OomKillDisable:true NGoroutines:68 SystemTime:2024-09-20 18:30:52.514070221 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214839296 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.3.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.6]] Warnings:<nil>}}
I0920 18:30:52.526779 506753 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0920 18:30:52.526806 506753 cni.go:84] Creating CNI manager for ""
I0920 18:30:52.526867 506753 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0920 18:30:52.526910 506753 start.go:340] cluster config:
{Name:old-k8s-version-475170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-475170 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0920 18:30:52.529381 506753 out.go:177] * Starting "old-k8s-version-475170" primary control-plane node in "old-k8s-version-475170" cluster
I0920 18:30:52.531643 506753 cache.go:121] Beginning downloading kic base image for docker with containerd
I0920 18:30:52.534046 506753 out.go:177] * Pulling base image v0.0.45-1726784731-19672 ...
I0920 18:30:52.536064 506753 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0920 18:30:52.536131 506753 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19672-294290/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0920 18:30:52.536140 506753 cache.go:56] Caching tarball of preloaded images
I0920 18:30:52.536222 506753 preload.go:172] Found /home/jenkins/minikube-integration/19672-294290/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0920 18:30:52.536232 506753 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0920 18:30:52.536349 506753 profile.go:143] Saving config to /home/jenkins/minikube-integration/19672-294290/.minikube/profiles/old-k8s-version-475170/config.json ...
I0920 18:30:52.536563 506753 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local docker daemon
W0920 18:30:52.570095 506753 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed is of wrong architecture
I0920 18:30:52.570114 506753 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed to local cache
I0920 18:30:52.570187 506753 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local cache directory
I0920 18:30:52.570213 506753 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local cache directory, skipping pull
I0920 18:30:52.570218 506753 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed exists in cache, skipping pull
I0920 18:30:52.570226 506753 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed as a tarball
I0920 18:30:52.570231 506753 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed from local cache
I0920 18:30:52.708067 506753 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed from cached tarball
I0920 18:30:52.708099 506753 cache.go:194] Successfully downloaded all kic artifacts
I0920 18:30:52.708143 506753 start.go:360] acquireMachinesLock for old-k8s-version-475170: {Name:mk4d8656377382173c8e718b41822611d0eb711c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0920 18:30:52.708211 506753 start.go:364] duration metric: took 44.431µs to acquireMachinesLock for "old-k8s-version-475170"
I0920 18:30:52.708236 506753 start.go:96] Skipping create...Using existing machine configuration
I0920 18:30:52.708251 506753 fix.go:54] fixHost starting:
I0920 18:30:52.708525 506753 cli_runner.go:164] Run: docker container inspect old-k8s-version-475170 --format={{.State.Status}}
I0920 18:30:52.747106 506753 fix.go:112] recreateIfNeeded on old-k8s-version-475170: state=Stopped err=<nil>
W0920 18:30:52.747135 506753 fix.go:138] unexpected machine state, will restart: <nil>
I0920 18:30:52.749933 506753 out.go:177] * Restarting existing docker container for "old-k8s-version-475170" ...
I0920 18:30:52.751910 506753 cli_runner.go:164] Run: docker start old-k8s-version-475170
I0920 18:30:53.221024 506753 cli_runner.go:164] Run: docker container inspect old-k8s-version-475170 --format={{.State.Status}}
I0920 18:30:53.248034 506753 kic.go:430] container "old-k8s-version-475170" state is running.
I0920 18:30:53.248502 506753 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-475170
I0920 18:30:53.291768 506753 profile.go:143] Saving config to /home/jenkins/minikube-integration/19672-294290/.minikube/profiles/old-k8s-version-475170/config.json ...
I0920 18:30:53.292006 506753 machine.go:93] provisionDockerMachine start ...
I0920 18:30:53.292071 506753 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-475170
I0920 18:30:53.320414 506753 main.go:141] libmachine: Using SSH client type: native
I0920 18:30:53.320681 506753 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33434 <nil> <nil>}
I0920 18:30:53.320691 506753 main.go:141] libmachine: About to run SSH command:
hostname
I0920 18:30:53.321334 506753 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:41976->127.0.0.1:33434: read: connection reset by peer
I0920 18:30:56.471281 506753 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-475170
I0920 18:30:56.471312 506753 ubuntu.go:169] provisioning hostname "old-k8s-version-475170"
I0920 18:30:56.471383 506753 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-475170
I0920 18:30:56.491697 506753 main.go:141] libmachine: Using SSH client type: native
I0920 18:30:56.491955 506753 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33434 <nil> <nil>}
I0920 18:30:56.491979 506753 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-475170 && echo "old-k8s-version-475170" | sudo tee /etc/hostname
I0920 18:30:56.644069 506753 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-475170
I0920 18:30:56.644246 506753 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-475170
I0920 18:30:56.669435 506753 main.go:141] libmachine: Using SSH client type: native
I0920 18:30:56.669685 506753 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33434 <nil> <nil>}
I0920 18:30:56.669702 506753 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-475170' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-475170/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-475170' | sudo tee -a /etc/hosts;
fi
fi
I0920 18:30:56.807413 506753 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0920 18:30:56.807440 506753 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19672-294290/.minikube CaCertPath:/home/jenkins/minikube-integration/19672-294290/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19672-294290/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19672-294290/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19672-294290/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19672-294290/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19672-294290/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19672-294290/.minikube}
I0920 18:30:56.807472 506753 ubuntu.go:177] setting up certificates
I0920 18:30:56.807482 506753 provision.go:84] configureAuth start
I0920 18:30:56.807557 506753 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-475170
I0920 18:30:56.829942 506753 provision.go:143] copyHostCerts
I0920 18:30:56.830012 506753 exec_runner.go:144] found /home/jenkins/minikube-integration/19672-294290/.minikube/ca.pem, removing ...
I0920 18:30:56.830025 506753 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19672-294290/.minikube/ca.pem
I0920 18:30:56.830102 506753 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19672-294290/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19672-294290/.minikube/ca.pem (1082 bytes)
I0920 18:30:56.830212 506753 exec_runner.go:144] found /home/jenkins/minikube-integration/19672-294290/.minikube/cert.pem, removing ...
I0920 18:30:56.830224 506753 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19672-294290/.minikube/cert.pem
I0920 18:30:56.830252 506753 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19672-294290/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19672-294290/.minikube/cert.pem (1123 bytes)
I0920 18:30:56.830308 506753 exec_runner.go:144] found /home/jenkins/minikube-integration/19672-294290/.minikube/key.pem, removing ...
I0920 18:30:56.830317 506753 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19672-294290/.minikube/key.pem
I0920 18:30:56.830344 506753 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19672-294290/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19672-294290/.minikube/key.pem (1679 bytes)
I0920 18:30:56.830395 506753 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19672-294290/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19672-294290/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19672-294290/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-475170 san=[127.0.0.1 192.168.85.2 localhost minikube old-k8s-version-475170]
I0920 18:30:57.277542 506753 provision.go:177] copyRemoteCerts
I0920 18:30:57.277611 506753 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0920 18:30:57.277665 506753 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-475170
I0920 18:30:57.300914 506753 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33434 SSHKeyPath:/home/jenkins/minikube-integration/19672-294290/.minikube/machines/old-k8s-version-475170/id_rsa Username:docker}
I0920 18:30:57.397307 506753 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-294290/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0920 18:30:57.431099 506753 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-294290/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0920 18:30:57.461533 506753 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-294290/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0920 18:30:57.492149 506753 provision.go:87] duration metric: took 684.647041ms to configureAuth
I0920 18:30:57.492225 506753 ubuntu.go:193] setting minikube options for container-runtime
I0920 18:30:57.492491 506753 config.go:182] Loaded profile config "old-k8s-version-475170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0920 18:30:57.492538 506753 machine.go:96] duration metric: took 4.200515986s to provisionDockerMachine
I0920 18:30:57.492559 506753 start.go:293] postStartSetup for "old-k8s-version-475170" (driver="docker")
I0920 18:30:57.492585 506753 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0920 18:30:57.492683 506753 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0920 18:30:57.492745 506753 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-475170
I0920 18:30:57.514671 506753 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33434 SSHKeyPath:/home/jenkins/minikube-integration/19672-294290/.minikube/machines/old-k8s-version-475170/id_rsa Username:docker}
I0920 18:30:57.617273 506753 ssh_runner.go:195] Run: cat /etc/os-release
I0920 18:30:57.620622 506753 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0920 18:30:57.620659 506753 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0920 18:30:57.620671 506753 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0920 18:30:57.620679 506753 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I0920 18:30:57.620689 506753 filesync.go:126] Scanning /home/jenkins/minikube-integration/19672-294290/.minikube/addons for local assets ...
I0920 18:30:57.620747 506753 filesync.go:126] Scanning /home/jenkins/minikube-integration/19672-294290/.minikube/files for local assets ...
I0920 18:30:57.620826 506753 filesync.go:149] local asset: /home/jenkins/minikube-integration/19672-294290/.minikube/files/etc/ssl/certs/2996842.pem -> 2996842.pem in /etc/ssl/certs
I0920 18:30:57.620937 506753 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0920 18:30:57.633496 506753 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-294290/.minikube/files/etc/ssl/certs/2996842.pem --> /etc/ssl/certs/2996842.pem (1708 bytes)
I0920 18:30:57.674548 506753 start.go:296] duration metric: took 181.958617ms for postStartSetup
I0920 18:30:57.674646 506753 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0920 18:30:57.674696 506753 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-475170
I0920 18:30:57.697135 506753 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33434 SSHKeyPath:/home/jenkins/minikube-integration/19672-294290/.minikube/machines/old-k8s-version-475170/id_rsa Username:docker}
I0920 18:30:57.792522 506753 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0920 18:30:57.799409 506753 fix.go:56] duration metric: took 5.091151507s for fixHost
I0920 18:30:57.799439 506753 start.go:83] releasing machines lock for "old-k8s-version-475170", held for 5.09121878s
I0920 18:30:57.799515 506753 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-475170
I0920 18:30:57.821518 506753 ssh_runner.go:195] Run: cat /version.json
I0920 18:30:57.821912 506753 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-475170
I0920 18:30:57.822403 506753 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0920 18:30:57.822477 506753 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-475170
I0920 18:30:57.869004 506753 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33434 SSHKeyPath:/home/jenkins/minikube-integration/19672-294290/.minikube/machines/old-k8s-version-475170/id_rsa Username:docker}
I0920 18:30:57.872070 506753 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33434 SSHKeyPath:/home/jenkins/minikube-integration/19672-294290/.minikube/machines/old-k8s-version-475170/id_rsa Username:docker}
I0920 18:30:57.962584 506753 ssh_runner.go:195] Run: systemctl --version
I0920 18:30:58.094893 506753 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0920 18:30:58.101044 506753 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0920 18:30:58.126998 506753 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0920 18:30:58.127159 506753 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0920 18:30:58.138935 506753 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0920 18:30:58.138980 506753 start.go:495] detecting cgroup driver to use...
I0920 18:30:58.139055 506753 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0920 18:30:58.139130 506753 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0920 18:30:58.157805 506753 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0920 18:30:58.175391 506753 docker.go:217] disabling cri-docker service (if available) ...
I0920 18:30:58.175460 506753 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0920 18:30:58.195874 506753 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0920 18:30:58.212852 506753 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0920 18:30:58.328293 506753 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0920 18:30:58.433176 506753 docker.go:233] disabling docker service ...
I0920 18:30:58.433244 506753 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0920 18:30:58.447674 506753 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0920 18:30:58.460052 506753 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0920 18:30:58.579674 506753 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0920 18:30:58.701900 506753 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0920 18:30:58.715888 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0920 18:30:58.742478 506753 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0920 18:30:58.761191 506753 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0920 18:30:58.776812 506753 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0920 18:30:58.776923 506753 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0920 18:30:58.788422 506753 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0920 18:30:58.801925 506753 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0920 18:30:58.817212 506753 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0920 18:30:58.828889 506753 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0920 18:30:58.840839 506753 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0920 18:30:58.852291 506753 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0920 18:30:58.861835 506753 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0920 18:30:58.871435 506753 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0920 18:30:58.985002 506753 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0920 18:30:59.237967 506753 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0920 18:30:59.238072 506753 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0920 18:30:59.242857 506753 start.go:563] Will wait 60s for crictl version
I0920 18:30:59.242936 506753 ssh_runner.go:195] Run: which crictl
I0920 18:30:59.246557 506753 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0920 18:30:59.310754 506753 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.22
RuntimeApiVersion: v1
I0920 18:30:59.310873 506753 ssh_runner.go:195] Run: containerd --version
I0920 18:30:59.342178 506753 ssh_runner.go:195] Run: containerd --version
I0920 18:30:59.374527 506753 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.7.22 ...
I0920 18:30:59.377165 506753 cli_runner.go:164] Run: docker network inspect old-k8s-version-475170 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0920 18:30:59.402085 506753 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0920 18:30:59.406468 506753 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0920 18:30:59.421290 506753 kubeadm.go:883] updating cluster {Name:old-k8s-version-475170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-475170 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0920 18:30:59.421406 506753 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0920 18:30:59.421465 506753 ssh_runner.go:195] Run: sudo crictl images --output json
I0920 18:30:59.465328 506753 containerd.go:627] all images are preloaded for containerd runtime.
I0920 18:30:59.465396 506753 containerd.go:534] Images already preloaded, skipping extraction
I0920 18:30:59.465493 506753 ssh_runner.go:195] Run: sudo crictl images --output json
I0920 18:30:59.517030 506753 containerd.go:627] all images are preloaded for containerd runtime.
I0920 18:30:59.517052 506753 cache_images.go:84] Images are preloaded, skipping loading
I0920 18:30:59.517063 506753 kubeadm.go:934] updating node { 192.168.85.2 8443 v1.20.0 containerd true true} ...
I0920 18:30:59.517175 506753 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-475170 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-475170 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0920 18:30:59.517245 506753 ssh_runner.go:195] Run: sudo crictl info
I0920 18:30:59.574302 506753 cni.go:84] Creating CNI manager for ""
I0920 18:30:59.574331 506753 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0920 18:30:59.574341 506753 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0920 18:30:59.574363 506753 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-475170 NodeName:old-k8s-version-475170 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0920 18:30:59.574490 506753 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-475170"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0920 18:30:59.574612 506753 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0920 18:30:59.588557 506753 binaries.go:44] Found k8s binaries, skipping transfer
I0920 18:30:59.588699 506753 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0920 18:30:59.602604 506753 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0920 18:30:59.621491 506753 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0920 18:30:59.652381 506753 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0920 18:30:59.674066 506753 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0920 18:30:59.678107 506753 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0920 18:30:59.689236 506753 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0920 18:30:59.801830 506753 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0920 18:30:59.818812 506753 certs.go:68] Setting up /home/jenkins/minikube-integration/19672-294290/.minikube/profiles/old-k8s-version-475170 for IP: 192.168.85.2
I0920 18:30:59.818888 506753 certs.go:194] generating shared ca certs ...
I0920 18:30:59.818921 506753 certs.go:226] acquiring lock for ca certs: {Name:mke4cc07e532357ce4393d299e5243fb270e9472 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:30:59.819142 506753 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19672-294290/.minikube/ca.key
I0920 18:30:59.819230 506753 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19672-294290/.minikube/proxy-client-ca.key
I0920 18:30:59.819265 506753 certs.go:256] generating profile certs ...
I0920 18:30:59.819405 506753 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19672-294290/.minikube/profiles/old-k8s-version-475170/client.key
I0920 18:30:59.819512 506753 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19672-294290/.minikube/profiles/old-k8s-version-475170/apiserver.key.0afed5f1
I0920 18:30:59.819588 506753 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19672-294290/.minikube/profiles/old-k8s-version-475170/proxy-client.key
I0920 18:30:59.819734 506753 certs.go:484] found cert: /home/jenkins/minikube-integration/19672-294290/.minikube/certs/299684.pem (1338 bytes)
W0920 18:30:59.819792 506753 certs.go:480] ignoring /home/jenkins/minikube-integration/19672-294290/.minikube/certs/299684_empty.pem, impossibly tiny 0 bytes
I0920 18:30:59.819819 506753 certs.go:484] found cert: /home/jenkins/minikube-integration/19672-294290/.minikube/certs/ca-key.pem (1675 bytes)
I0920 18:30:59.819879 506753 certs.go:484] found cert: /home/jenkins/minikube-integration/19672-294290/.minikube/certs/ca.pem (1082 bytes)
I0920 18:30:59.819928 506753 certs.go:484] found cert: /home/jenkins/minikube-integration/19672-294290/.minikube/certs/cert.pem (1123 bytes)
I0920 18:30:59.819985 506753 certs.go:484] found cert: /home/jenkins/minikube-integration/19672-294290/.minikube/certs/key.pem (1679 bytes)
I0920 18:30:59.820055 506753 certs.go:484] found cert: /home/jenkins/minikube-integration/19672-294290/.minikube/files/etc/ssl/certs/2996842.pem (1708 bytes)
I0920 18:30:59.820718 506753 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-294290/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0920 18:30:59.856306 506753 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-294290/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0920 18:30:59.890380 506753 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-294290/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0920 18:30:59.933467 506753 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-294290/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0920 18:30:59.968346 506753 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-294290/.minikube/profiles/old-k8s-version-475170/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0920 18:31:00.038471 506753 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-294290/.minikube/profiles/old-k8s-version-475170/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0920 18:31:00.133448 506753 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-294290/.minikube/profiles/old-k8s-version-475170/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0920 18:31:00.177149 506753 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-294290/.minikube/profiles/old-k8s-version-475170/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0920 18:31:00.259875 506753 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-294290/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0920 18:31:00.299996 506753 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-294290/.minikube/certs/299684.pem --> /usr/share/ca-certificates/299684.pem (1338 bytes)
I0920 18:31:00.332560 506753 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-294290/.minikube/files/etc/ssl/certs/2996842.pem --> /usr/share/ca-certificates/2996842.pem (1708 bytes)
I0920 18:31:00.382964 506753 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0920 18:31:00.427799 506753 ssh_runner.go:195] Run: openssl version
I0920 18:31:00.438089 506753 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0920 18:31:00.455315 506753 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0920 18:31:00.468089 506753 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 20 17:40 /usr/share/ca-certificates/minikubeCA.pem
I0920 18:31:00.468256 506753 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0920 18:31:00.485538 506753 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0920 18:31:00.498378 506753 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/299684.pem && ln -fs /usr/share/ca-certificates/299684.pem /etc/ssl/certs/299684.pem"
I0920 18:31:00.512009 506753 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/299684.pem
I0920 18:31:00.518008 506753 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 20 17:50 /usr/share/ca-certificates/299684.pem
I0920 18:31:00.518179 506753 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/299684.pem
I0920 18:31:00.530038 506753 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/299684.pem /etc/ssl/certs/51391683.0"
I0920 18:31:00.542659 506753 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2996842.pem && ln -fs /usr/share/ca-certificates/2996842.pem /etc/ssl/certs/2996842.pem"
I0920 18:31:00.555566 506753 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2996842.pem
I0920 18:31:00.561482 506753 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 20 17:50 /usr/share/ca-certificates/2996842.pem
I0920 18:31:00.561779 506753 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2996842.pem
I0920 18:31:00.571637 506753 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/2996842.pem /etc/ssl/certs/3ec20f2e.0"
I0920 18:31:00.584448 506753 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0920 18:31:00.592744 506753 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0920 18:31:00.600978 506753 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0920 18:31:00.609193 506753 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0920 18:31:00.617819 506753 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0920 18:31:00.626992 506753 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0920 18:31:00.635765 506753 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0920 18:31:00.647360 506753 kubeadm.go:392] StartCluster: {Name:old-k8s-version-475170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-475170 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0920 18:31:00.647519 506753 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0920 18:31:00.647631 506753 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0920 18:31:00.709092 506753 cri.go:89] found id: "3e5b0a7d9d673d78cc6bc4fb42b865a56a854a554083c93d5469d52ce1613872"
I0920 18:31:00.709167 506753 cri.go:89] found id: "8a4ee0253af3725554a381aa7b6a8f89dbafb548f3de5993565a3866b25f01fc"
I0920 18:31:00.709186 506753 cri.go:89] found id: "e126978f873c21258f64888c111ebc9d582eb0398c12b5d85458a1909b5cbe76"
I0920 18:31:00.709206 506753 cri.go:89] found id: "93d93c2e410820672b1234f1012c02eadac7b65e873d66423584e1bf387e045e"
I0920 18:31:00.709238 506753 cri.go:89] found id: "233df6b6eb986baede4db039e732ee1858dd85728e913ffd728598b107989bfd"
I0920 18:31:00.709264 506753 cri.go:89] found id: "e9fb3ff5b999ec2b982365086ff02d308b31e23e032a6a83b361204f78b0edf6"
I0920 18:31:00.709284 506753 cri.go:89] found id: "3537612de5ba307587c7b835c7e961d7204cd3b56b96f9297584d7d664afdcc6"
I0920 18:31:00.709307 506753 cri.go:89] found id: "199b68be37f6dec0c3e145251b4cf0f7dc80451e8df9799cc519d5f26245c333"
I0920 18:31:00.709340 506753 cri.go:89] found id: ""
I0920 18:31:00.709412 506753 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0920 18:31:00.722839 506753 cri.go:116] JSON = null
W0920 18:31:00.722942 506753 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0920 18:31:00.723064 506753 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0920 18:31:00.732964 506753 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0920 18:31:00.733027 506753 kubeadm.go:593] restartPrimaryControlPlane start ...
I0920 18:31:00.733112 506753 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0920 18:31:00.745658 506753 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0920 18:31:00.746093 506753 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-475170" does not appear in /home/jenkins/minikube-integration/19672-294290/kubeconfig
I0920 18:31:00.746230 506753 kubeconfig.go:62] /home/jenkins/minikube-integration/19672-294290/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-475170" cluster setting kubeconfig missing "old-k8s-version-475170" context setting]
I0920 18:31:00.746516 506753 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-294290/kubeconfig: {Name:mk99ef3647d0cf66fbb7a624c924e5cee2350dae Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:31:00.747909 506753 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0920 18:31:00.757254 506753 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.85.2
I0920 18:31:00.757290 506753 kubeadm.go:597] duration metric: took 24.243412ms to restartPrimaryControlPlane
I0920 18:31:00.757299 506753 kubeadm.go:394] duration metric: took 109.953708ms to StartCluster
I0920 18:31:00.757316 506753 settings.go:142] acquiring lock: {Name:mk4f88389204d2653ab82e878e61c50b8437ae37 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:31:00.757392 506753 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19672-294290/kubeconfig
I0920 18:31:00.758042 506753 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-294290/kubeconfig: {Name:mk99ef3647d0cf66fbb7a624c924e5cee2350dae Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:31:00.758258 506753 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0920 18:31:00.758578 506753 config.go:182] Loaded profile config "old-k8s-version-475170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0920 18:31:00.758630 506753 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0920 18:31:00.758701 506753 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-475170"
I0920 18:31:00.758720 506753 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-475170"
W0920 18:31:00.758731 506753 addons.go:243] addon storage-provisioner should already be in state true
I0920 18:31:00.758755 506753 host.go:66] Checking if "old-k8s-version-475170" exists ...
I0920 18:31:00.758765 506753 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-475170"
I0920 18:31:00.758784 506753 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-475170"
I0920 18:31:00.759131 506753 cli_runner.go:164] Run: docker container inspect old-k8s-version-475170 --format={{.State.Status}}
I0920 18:31:00.759272 506753 cli_runner.go:164] Run: docker container inspect old-k8s-version-475170 --format={{.State.Status}}
I0920 18:31:00.761417 506753 addons.go:69] Setting dashboard=true in profile "old-k8s-version-475170"
I0920 18:31:00.761455 506753 addons.go:234] Setting addon dashboard=true in "old-k8s-version-475170"
W0920 18:31:00.761464 506753 addons.go:243] addon dashboard should already be in state true
I0920 18:31:00.761495 506753 host.go:66] Checking if "old-k8s-version-475170" exists ...
I0920 18:31:00.762003 506753 cli_runner.go:164] Run: docker container inspect old-k8s-version-475170 --format={{.State.Status}}
I0920 18:31:00.762206 506753 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-475170"
I0920 18:31:00.762223 506753 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-475170"
W0920 18:31:00.762230 506753 addons.go:243] addon metrics-server should already be in state true
I0920 18:31:00.762255 506753 host.go:66] Checking if "old-k8s-version-475170" exists ...
I0920 18:31:00.762671 506753 cli_runner.go:164] Run: docker container inspect old-k8s-version-475170 --format={{.State.Status}}
I0920 18:31:00.764259 506753 out.go:177] * Verifying Kubernetes components...
I0920 18:31:00.770743 506753 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0920 18:31:00.804649 506753 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-475170"
W0920 18:31:00.804671 506753 addons.go:243] addon default-storageclass should already be in state true
I0920 18:31:00.804696 506753 host.go:66] Checking if "old-k8s-version-475170" exists ...
I0920 18:31:00.805128 506753 cli_runner.go:164] Run: docker container inspect old-k8s-version-475170 --format={{.State.Status}}
I0920 18:31:00.809631 506753 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0920 18:31:00.809742 506753 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0920 18:31:00.812478 506753 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0920 18:31:00.812505 506753 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0920 18:31:00.812569 506753 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-475170
I0920 18:31:00.812707 506753 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0920 18:31:00.812714 506753 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0920 18:31:00.812747 506753 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-475170
I0920 18:31:00.838581 506753 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0920 18:31:00.847820 506753 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0920 18:31:00.852485 506753 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0920 18:31:00.852511 506753 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0920 18:31:00.852602 506753 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-475170
I0920 18:31:00.858030 506753 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0920 18:31:00.858054 506753 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0920 18:31:00.858114 506753 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-475170
I0920 18:31:00.878455 506753 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33434 SSHKeyPath:/home/jenkins/minikube-integration/19672-294290/.minikube/machines/old-k8s-version-475170/id_rsa Username:docker}
I0920 18:31:00.887246 506753 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33434 SSHKeyPath:/home/jenkins/minikube-integration/19672-294290/.minikube/machines/old-k8s-version-475170/id_rsa Username:docker}
I0920 18:31:00.911808 506753 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33434 SSHKeyPath:/home/jenkins/minikube-integration/19672-294290/.minikube/machines/old-k8s-version-475170/id_rsa Username:docker}
I0920 18:31:00.928844 506753 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33434 SSHKeyPath:/home/jenkins/minikube-integration/19672-294290/.minikube/machines/old-k8s-version-475170/id_rsa Username:docker}
I0920 18:31:00.947875 506753 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0920 18:31:00.978586 506753 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-475170" to be "Ready" ...
I0920 18:31:01.029334 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0920 18:31:01.101102 506753 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0920 18:31:01.101179 506753 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0920 18:31:01.101373 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0920 18:31:01.125773 506753 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0920 18:31:01.125809 506753 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0920 18:31:01.186688 506753 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0920 18:31:01.186715 506753 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0920 18:31:01.220643 506753 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0920 18:31:01.220677 506753 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0920 18:31:01.236823 506753 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0920 18:31:01.236849 506753 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
W0920 18:31:01.275356 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:01.275397 506753 retry.go:31] will retry after 258.416202ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:01.293504 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0920 18:31:01.295523 506753 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0920 18:31:01.295550 506753 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
W0920 18:31:01.327931 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:01.327966 506753 retry.go:31] will retry after 344.165227ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:01.346241 506753 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0920 18:31:01.346266 506753 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0920 18:31:01.371577 506753 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0920 18:31:01.371659 506753 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0920 18:31:01.396448 506753 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0920 18:31:01.396528 506753 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
W0920 18:31:01.397467 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:01.397536 506753 retry.go:31] will retry after 282.36717ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:01.416494 506753 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0920 18:31:01.416517 506753 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0920 18:31:01.434996 506753 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0920 18:31:01.435047 506753 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0920 18:31:01.459926 506753 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0920 18:31:01.460009 506753 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0920 18:31:01.480734 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0920 18:31:01.535045 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0920 18:31:01.564517 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:01.564547 506753 retry.go:31] will retry after 258.348078ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0920 18:31:01.650631 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:01.650665 506753 retry.go:31] will retry after 526.60715ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:01.672945 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0920 18:31:01.680586 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0920 18:31:01.783272 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:01.783308 506753 retry.go:31] will retry after 473.069614ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0920 18:31:01.786445 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:01.786475 506753 retry.go:31] will retry after 290.94863ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:01.823594 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0920 18:31:01.901434 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:01.901466 506753 retry.go:31] will retry after 230.244128ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:02.078212 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0920 18:31:02.132703 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0920 18:31:02.178314 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0920 18:31:02.190482 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:02.190527 506753 retry.go:31] will retry after 630.767138ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:02.256927 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0920 18:31:02.308375 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:02.308423 506753 retry.go:31] will retry after 768.298604ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0920 18:31:02.308581 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:02.308602 506753 retry.go:31] will retry after 835.709788ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0920 18:31:02.373959 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:02.373992 506753 retry.go:31] will retry after 673.077489ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:02.822229 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0920 18:31:02.911038 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:02.911075 506753 retry.go:31] will retry after 595.46633ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:02.979722 506753 node_ready.go:53] error getting node "old-k8s-version-475170": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-475170": dial tcp 192.168.85.2:8443: connect: connection refused
I0920 18:31:03.048014 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0920 18:31:03.077553 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0920 18:31:03.144605 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0920 18:31:03.213432 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:03.213521 506753 retry.go:31] will retry after 519.455195ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0920 18:31:03.289947 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:03.290027 506753 retry.go:31] will retry after 846.810387ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0920 18:31:03.320179 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:03.320272 506753 retry.go:31] will retry after 1.18576754s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:03.507250 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0920 18:31:03.597081 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:03.597160 506753 retry.go:31] will retry after 1.359347738s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:03.733346 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0920 18:31:03.887280 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:03.887312 506753 retry.go:31] will retry after 1.496068106s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:04.137050 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0920 18:31:04.294552 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:04.294579 506753 retry.go:31] will retry after 1.662593802s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:04.506383 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0920 18:31:04.648609 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:04.648637 506753 retry.go:31] will retry after 1.173685573s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:04.957118 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0920 18:31:04.979796 506753 node_ready.go:53] error getting node "old-k8s-version-475170": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-475170": dial tcp 192.168.85.2:8443: connect: connection refused
W0920 18:31:05.069161 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:05.069191 506753 retry.go:31] will retry after 2.35408638s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:05.387641 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0920 18:31:05.530812 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:05.530842 506753 retry.go:31] will retry after 2.183743278s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:05.822495 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0920 18:31:05.934935 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:05.934966 506753 retry.go:31] will retry after 1.826104256s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:05.958308 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0920 18:31:06.071290 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:06.071321 506753 retry.go:31] will retry after 2.174890133s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:06.980025 506753 node_ready.go:53] error getting node "old-k8s-version-475170": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-475170": dial tcp 192.168.85.2:8443: connect: connection refused
I0920 18:31:07.423498 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0920 18:31:07.503236 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:07.503272 506753 retry.go:31] will retry after 2.029562665s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:07.715646 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0920 18:31:07.762048 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0920 18:31:07.799717 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:07.799755 506753 retry.go:31] will retry after 3.17503337s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0920 18:31:07.844714 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:07.844754 506753 retry.go:31] will retry after 4.268590937s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:08.246921 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0920 18:31:08.320208 506753 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:08.320282 506753 retry.go:31] will retry after 1.657338397s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0920 18:31:09.479126 506753 node_ready.go:53] error getting node "old-k8s-version-475170": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-475170": dial tcp 192.168.85.2:8443: connect: connection refused
I0920 18:31:09.533506 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0920 18:31:09.978348 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0920 18:31:10.975498 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0920 18:31:12.114258 506753 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0920 18:31:17.461202 506753 node_ready.go:49] node "old-k8s-version-475170" has status "Ready":"True"
I0920 18:31:17.461232 506753 node_ready.go:38] duration metric: took 16.482553949s for node "old-k8s-version-475170" to be "Ready" ...
I0920 18:31:17.461243 506753 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0920 18:31:17.684394 506753 pod_ready.go:79] waiting up to 6m0s for pod "coredns-74ff55c5b-hc5pl" in "kube-system" namespace to be "Ready" ...
I0920 18:31:17.704908 506753 pod_ready.go:93] pod "coredns-74ff55c5b-hc5pl" in "kube-system" namespace has status "Ready":"True"
I0920 18:31:17.704936 506753 pod_ready.go:82] duration metric: took 20.502314ms for pod "coredns-74ff55c5b-hc5pl" in "kube-system" namespace to be "Ready" ...
I0920 18:31:17.704947 506753 pod_ready.go:79] waiting up to 6m0s for pod "etcd-old-k8s-version-475170" in "kube-system" namespace to be "Ready" ...
I0920 18:31:17.744501 506753 pod_ready.go:93] pod "etcd-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"True"
I0920 18:31:17.744528 506753 pod_ready.go:82] duration metric: took 39.573042ms for pod "etcd-old-k8s-version-475170" in "kube-system" namespace to be "Ready" ...
I0920 18:31:17.744556 506753 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-475170" in "kube-system" namespace to be "Ready" ...
I0920 18:31:17.795228 506753 pod_ready.go:93] pod "kube-apiserver-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"True"
I0920 18:31:17.795256 506753 pod_ready.go:82] duration metric: took 50.690191ms for pod "kube-apiserver-old-k8s-version-475170" in "kube-system" namespace to be "Ready" ...
I0920 18:31:17.795267 506753 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace to be "Ready" ...
I0920 18:31:18.997950 506753 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (9.464402201s)
I0920 18:31:18.998028 506753 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-475170"
I0920 18:31:18.998132 506753 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (9.019761988s)
I0920 18:31:18.998189 506753 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (8.022668559s)
I0920 18:31:19.049655 506753 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (6.935350649s)
I0920 18:31:19.051877 506753 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-475170 addons enable metrics-server
I0920 18:31:19.053916 506753 out.go:177] * Enabled addons: metrics-server, storage-provisioner, default-storageclass, dashboard
I0920 18:31:19.055892 506753 addons.go:510] duration metric: took 18.297256409s for enable addons: enabled=[metrics-server storage-provisioner default-storageclass dashboard]
I0920 18:31:19.802294 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:31:22.302239 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:31:24.302952 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:31:26.303444 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:31:28.802371 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:31:30.802727 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:31:32.804542 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:31:34.810951 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:31:37.310553 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:31:39.803051 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:31:42.304377 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:31:44.806526 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:31:47.356214 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:31:49.806536 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:31:52.315686 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:31:54.802651 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:31:56.802860 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:31:58.802903 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:00.803110 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:03.302604 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:05.302831 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:07.305214 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:09.802298 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:12.303231 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:14.802148 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:17.301946 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:19.802021 506753 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:20.802214 506753 pod_ready.go:93] pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"True"
I0920 18:32:20.802242 506753 pod_ready.go:82] duration metric: took 1m3.006966245s for pod "kube-controller-manager-old-k8s-version-475170" in "kube-system" namespace to be "Ready" ...
I0920 18:32:20.802255 506753 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-r9xl5" in "kube-system" namespace to be "Ready" ...
I0920 18:32:20.807464 506753 pod_ready.go:93] pod "kube-proxy-r9xl5" in "kube-system" namespace has status "Ready":"True"
I0920 18:32:20.807489 506753 pod_ready.go:82] duration metric: took 5.225878ms for pod "kube-proxy-r9xl5" in "kube-system" namespace to be "Ready" ...
I0920 18:32:20.807500 506753 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-475170" in "kube-system" namespace to be "Ready" ...
I0920 18:32:22.814032 506753 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:25.315114 506753 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:27.813306 506753 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:29.813473 506753 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:31.813543 506753 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:33.814050 506753 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:36.313538 506753 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:38.313743 506753 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:38.813525 506753 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-475170" in "kube-system" namespace has status "Ready":"True"
I0920 18:32:38.813553 506753 pod_ready.go:82] duration metric: took 18.006044047s for pod "kube-scheduler-old-k8s-version-475170" in "kube-system" namespace to be "Ready" ...
I0920 18:32:38.813565 506753 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace to be "Ready" ...
I0920 18:32:40.819506 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:43.319864 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:45.321750 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:47.867234 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:50.319745 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:52.319872 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:54.320288 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:56.320680 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:32:58.820130 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:01.319748 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:03.320750 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:05.321063 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:07.820361 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:10.321874 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:12.819437 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:14.820133 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:16.820784 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:19.320188 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:21.820227 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:24.319958 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:26.820004 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:29.319982 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:31.320342 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:33.326905 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:35.819613 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:37.819666 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:39.819844 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:41.819915 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:44.320464 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:46.819873 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:49.318903 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:51.320059 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:53.820409 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:56.320245 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:33:58.320520 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:00.343519 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:02.821066 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:05.320902 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:07.819491 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:09.820393 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:11.820929 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:14.320900 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:16.819223 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:19.320556 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:21.819969 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:23.820120 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:26.320467 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:28.818836 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:30.820033 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:32.825103 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:35.321052 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:37.819298 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:39.819953 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:41.820175 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:44.320020 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:46.820245 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:49.319476 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:51.818900 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:53.819357 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:55.819439 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:57.819976 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:34:59.820926 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:02.320643 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:04.820371 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:06.820538 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:09.320051 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:11.820519 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:13.829147 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:16.320987 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:18.819404 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:20.820238 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:23.319368 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:25.319483 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:27.320931 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:29.320970 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:31.820049 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:33.820719 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:36.320283 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:38.819888 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:40.820197 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:43.320477 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:45.322459 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:47.819567 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:49.819641 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:52.320514 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:54.320566 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:56.819702 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:35:58.820404 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:36:00.820667 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:36:03.319887 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:36:05.320011 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:36:07.820749 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:36:09.821112 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:36:11.827868 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:36:14.320776 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:36:16.820357 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:36:19.320321 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:36:21.819589 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:36:23.828014 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:36:26.320605 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:36:28.819974 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:36:30.820572 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:36:33.321325 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:36:35.820011 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:36:37.820711 506753 pod_ready.go:103] pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace has status "Ready":"False"
I0920 18:36:38.819846 506753 pod_ready.go:82] duration metric: took 4m0.006265343s for pod "metrics-server-9975d5f86-2scnf" in "kube-system" namespace to be "Ready" ...
E0920 18:36:38.819874 506753 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I0920 18:36:38.819885 506753 pod_ready.go:39] duration metric: took 5m21.358631983s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0920 18:36:38.819901 506753 api_server.go:52] waiting for apiserver process to appear ...
I0920 18:36:38.819931 506753 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0920 18:36:38.819997 506753 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0920 18:36:38.866542 506753 cri.go:89] found id: "819a0e2152e9284aada7d30f67dd8a064d3cd2804d41229ca0e7af02aa77f0c0"
I0920 18:36:38.866582 506753 cri.go:89] found id: "e9fb3ff5b999ec2b982365086ff02d308b31e23e032a6a83b361204f78b0edf6"
I0920 18:36:38.866587 506753 cri.go:89] found id: ""
I0920 18:36:38.866595 506753 logs.go:276] 2 containers: [819a0e2152e9284aada7d30f67dd8a064d3cd2804d41229ca0e7af02aa77f0c0 e9fb3ff5b999ec2b982365086ff02d308b31e23e032a6a83b361204f78b0edf6]
I0920 18:36:38.866675 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:38.870264 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:38.873657 506753 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0920 18:36:38.873743 506753 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0920 18:36:38.916187 506753 cri.go:89] found id: "b41a67962b9045e22b2075573e3f11825adf11fb40f066ced5d6a9c9b4586c99"
I0920 18:36:38.916213 506753 cri.go:89] found id: "233df6b6eb986baede4db039e732ee1858dd85728e913ffd728598b107989bfd"
I0920 18:36:38.916218 506753 cri.go:89] found id: ""
I0920 18:36:38.916225 506753 logs.go:276] 2 containers: [b41a67962b9045e22b2075573e3f11825adf11fb40f066ced5d6a9c9b4586c99 233df6b6eb986baede4db039e732ee1858dd85728e913ffd728598b107989bfd]
I0920 18:36:38.916288 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:38.919988 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:38.923309 506753 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0920 18:36:38.923387 506753 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0920 18:36:38.966874 506753 cri.go:89] found id: "bba0d98fd29865d157261c8482ac52d89e6ffc1f1e5b727ff5d3d5262a37fd32"
I0920 18:36:38.966896 506753 cri.go:89] found id: "3e5b0a7d9d673d78cc6bc4fb42b865a56a854a554083c93d5469d52ce1613872"
I0920 18:36:38.966903 506753 cri.go:89] found id: ""
I0920 18:36:38.966910 506753 logs.go:276] 2 containers: [bba0d98fd29865d157261c8482ac52d89e6ffc1f1e5b727ff5d3d5262a37fd32 3e5b0a7d9d673d78cc6bc4fb42b865a56a854a554083c93d5469d52ce1613872]
I0920 18:36:38.966965 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:38.970540 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:38.974077 506753 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0920 18:36:38.974157 506753 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0920 18:36:39.018766 506753 cri.go:89] found id: "186afb87158e29ba5b33e79e9d46317f8bf2277b41c9c1948bb4fe7bd52cb5ca"
I0920 18:36:39.018791 506753 cri.go:89] found id: "199b68be37f6dec0c3e145251b4cf0f7dc80451e8df9799cc519d5f26245c333"
I0920 18:36:39.018797 506753 cri.go:89] found id: ""
I0920 18:36:39.018806 506753 logs.go:276] 2 containers: [186afb87158e29ba5b33e79e9d46317f8bf2277b41c9c1948bb4fe7bd52cb5ca 199b68be37f6dec0c3e145251b4cf0f7dc80451e8df9799cc519d5f26245c333]
I0920 18:36:39.018868 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:39.023622 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:39.027638 506753 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0920 18:36:39.027713 506753 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0920 18:36:39.071854 506753 cri.go:89] found id: "101769e8441e423925facf5f93161549531fb8ea432669373cb403b040be6102"
I0920 18:36:39.071874 506753 cri.go:89] found id: "93d93c2e410820672b1234f1012c02eadac7b65e873d66423584e1bf387e045e"
I0920 18:36:39.071879 506753 cri.go:89] found id: ""
I0920 18:36:39.071887 506753 logs.go:276] 2 containers: [101769e8441e423925facf5f93161549531fb8ea432669373cb403b040be6102 93d93c2e410820672b1234f1012c02eadac7b65e873d66423584e1bf387e045e]
I0920 18:36:39.071948 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:39.076615 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:39.085832 506753 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0920 18:36:39.085908 506753 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0920 18:36:39.127144 506753 cri.go:89] found id: "233d68ae9f8fdfbccfa0227891e909d8315f56c07f1a81d70b9939806795f464"
I0920 18:36:39.127175 506753 cri.go:89] found id: "3537612de5ba307587c7b835c7e961d7204cd3b56b96f9297584d7d664afdcc6"
I0920 18:36:39.127180 506753 cri.go:89] found id: ""
I0920 18:36:39.127187 506753 logs.go:276] 2 containers: [233d68ae9f8fdfbccfa0227891e909d8315f56c07f1a81d70b9939806795f464 3537612de5ba307587c7b835c7e961d7204cd3b56b96f9297584d7d664afdcc6]
I0920 18:36:39.127260 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:39.131753 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:39.136051 506753 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0920 18:36:39.136155 506753 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0920 18:36:39.174474 506753 cri.go:89] found id: "fdda1626f0e17b465e141e79489b20add7508ca46cf9cd2f835cf37bb6674225"
I0920 18:36:39.174535 506753 cri.go:89] found id: "8a4ee0253af3725554a381aa7b6a8f89dbafb548f3de5993565a3866b25f01fc"
I0920 18:36:39.174553 506753 cri.go:89] found id: ""
I0920 18:36:39.174577 506753 logs.go:276] 2 containers: [fdda1626f0e17b465e141e79489b20add7508ca46cf9cd2f835cf37bb6674225 8a4ee0253af3725554a381aa7b6a8f89dbafb548f3de5993565a3866b25f01fc]
I0920 18:36:39.174650 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:39.178577 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:39.182429 506753 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0920 18:36:39.182598 506753 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0920 18:36:39.221837 506753 cri.go:89] found id: "b12b0d4c8fc78ca871279a8f41127290f53d614f970d7916b20ce43b14066509"
I0920 18:36:39.221861 506753 cri.go:89] found id: ""
I0920 18:36:39.221870 506753 logs.go:276] 1 containers: [b12b0d4c8fc78ca871279a8f41127290f53d614f970d7916b20ce43b14066509]
I0920 18:36:39.221934 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:39.226108 506753 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0920 18:36:39.226200 506753 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0920 18:36:39.268628 506753 cri.go:89] found id: "9bc5c63f723351b1d6ef80d461357d2aa2f2e9617925dad553809fae62b51f84"
I0920 18:36:39.268693 506753 cri.go:89] found id: "e126978f873c21258f64888c111ebc9d582eb0398c12b5d85458a1909b5cbe76"
I0920 18:36:39.268712 506753 cri.go:89] found id: ""
I0920 18:36:39.268736 506753 logs.go:276] 2 containers: [9bc5c63f723351b1d6ef80d461357d2aa2f2e9617925dad553809fae62b51f84 e126978f873c21258f64888c111ebc9d582eb0398c12b5d85458a1909b5cbe76]
I0920 18:36:39.268829 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:39.272499 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:39.277382 506753 logs.go:123] Gathering logs for kube-proxy [101769e8441e423925facf5f93161549531fb8ea432669373cb403b040be6102] ...
I0920 18:36:39.277420 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 101769e8441e423925facf5f93161549531fb8ea432669373cb403b040be6102"
I0920 18:36:39.327652 506753 logs.go:123] Gathering logs for storage-provisioner [e126978f873c21258f64888c111ebc9d582eb0398c12b5d85458a1909b5cbe76] ...
I0920 18:36:39.327681 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e126978f873c21258f64888c111ebc9d582eb0398c12b5d85458a1909b5cbe76"
I0920 18:36:39.370138 506753 logs.go:123] Gathering logs for containerd ...
I0920 18:36:39.370174 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0920 18:36:39.438364 506753 logs.go:123] Gathering logs for dmesg ...
I0920 18:36:39.438410 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0920 18:36:39.459684 506753 logs.go:123] Gathering logs for kube-apiserver [819a0e2152e9284aada7d30f67dd8a064d3cd2804d41229ca0e7af02aa77f0c0] ...
I0920 18:36:39.459716 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 819a0e2152e9284aada7d30f67dd8a064d3cd2804d41229ca0e7af02aa77f0c0"
I0920 18:36:39.544267 506753 logs.go:123] Gathering logs for coredns [3e5b0a7d9d673d78cc6bc4fb42b865a56a854a554083c93d5469d52ce1613872] ...
I0920 18:36:39.544306 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3e5b0a7d9d673d78cc6bc4fb42b865a56a854a554083c93d5469d52ce1613872"
I0920 18:36:39.586502 506753 logs.go:123] Gathering logs for kube-scheduler [199b68be37f6dec0c3e145251b4cf0f7dc80451e8df9799cc519d5f26245c333] ...
I0920 18:36:39.586532 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 199b68be37f6dec0c3e145251b4cf0f7dc80451e8df9799cc519d5f26245c333"
I0920 18:36:39.658603 506753 logs.go:123] Gathering logs for kube-controller-manager [3537612de5ba307587c7b835c7e961d7204cd3b56b96f9297584d7d664afdcc6] ...
I0920 18:36:39.658639 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3537612de5ba307587c7b835c7e961d7204cd3b56b96f9297584d7d664afdcc6"
I0920 18:36:39.730370 506753 logs.go:123] Gathering logs for kindnet [fdda1626f0e17b465e141e79489b20add7508ca46cf9cd2f835cf37bb6674225] ...
I0920 18:36:39.730410 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fdda1626f0e17b465e141e79489b20add7508ca46cf9cd2f835cf37bb6674225"
I0920 18:36:39.788229 506753 logs.go:123] Gathering logs for kindnet [8a4ee0253af3725554a381aa7b6a8f89dbafb548f3de5993565a3866b25f01fc] ...
I0920 18:36:39.788261 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8a4ee0253af3725554a381aa7b6a8f89dbafb548f3de5993565a3866b25f01fc"
I0920 18:36:39.833400 506753 logs.go:123] Gathering logs for container status ...
I0920 18:36:39.833433 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0920 18:36:39.914353 506753 logs.go:123] Gathering logs for describe nodes ...
I0920 18:36:39.914386 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0920 18:36:40.099453 506753 logs.go:123] Gathering logs for etcd [b41a67962b9045e22b2075573e3f11825adf11fb40f066ced5d6a9c9b4586c99] ...
I0920 18:36:40.099494 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b41a67962b9045e22b2075573e3f11825adf11fb40f066ced5d6a9c9b4586c99"
I0920 18:36:40.147147 506753 logs.go:123] Gathering logs for etcd [233df6b6eb986baede4db039e732ee1858dd85728e913ffd728598b107989bfd] ...
I0920 18:36:40.147178 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 233df6b6eb986baede4db039e732ee1858dd85728e913ffd728598b107989bfd"
I0920 18:36:40.199920 506753 logs.go:123] Gathering logs for kube-apiserver [e9fb3ff5b999ec2b982365086ff02d308b31e23e032a6a83b361204f78b0edf6] ...
I0920 18:36:40.199954 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e9fb3ff5b999ec2b982365086ff02d308b31e23e032a6a83b361204f78b0edf6"
I0920 18:36:40.256178 506753 logs.go:123] Gathering logs for kubernetes-dashboard [b12b0d4c8fc78ca871279a8f41127290f53d614f970d7916b20ce43b14066509] ...
I0920 18:36:40.256216 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b12b0d4c8fc78ca871279a8f41127290f53d614f970d7916b20ce43b14066509"
I0920 18:36:40.300277 506753 logs.go:123] Gathering logs for storage-provisioner [9bc5c63f723351b1d6ef80d461357d2aa2f2e9617925dad553809fae62b51f84] ...
I0920 18:36:40.300310 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9bc5c63f723351b1d6ef80d461357d2aa2f2e9617925dad553809fae62b51f84"
I0920 18:36:40.348014 506753 logs.go:123] Gathering logs for kube-proxy [93d93c2e410820672b1234f1012c02eadac7b65e873d66423584e1bf387e045e] ...
I0920 18:36:40.348046 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 93d93c2e410820672b1234f1012c02eadac7b65e873d66423584e1bf387e045e"
I0920 18:36:40.390793 506753 logs.go:123] Gathering logs for kube-controller-manager [233d68ae9f8fdfbccfa0227891e909d8315f56c07f1a81d70b9939806795f464] ...
I0920 18:36:40.390821 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 233d68ae9f8fdfbccfa0227891e909d8315f56c07f1a81d70b9939806795f464"
I0920 18:36:40.461822 506753 logs.go:123] Gathering logs for kubelet ...
I0920 18:36:40.461861 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0920 18:36:40.512597 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:17 old-k8s-version-475170 kubelet[662]: E0920 18:31:17.390835 662 reflector.go:138] object-"kube-system"/"kindnet-token-t5zmp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-t5zmp" is forbidden: User "system:node:old-k8s-version-475170" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-475170' and this object
W0920 18:36:40.512833 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:17 old-k8s-version-475170 kubelet[662]: E0920 18:31:17.391083 662 reflector.go:138] object-"kube-system"/"coredns-token-4tb5x": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-4tb5x" is forbidden: User "system:node:old-k8s-version-475170" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-475170' and this object
W0920 18:36:40.513043 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:17 old-k8s-version-475170 kubelet[662]: E0920 18:31:17.391195 662 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-475170" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-475170' and this object
W0920 18:36:40.513273 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:17 old-k8s-version-475170 kubelet[662]: E0920 18:31:17.391282 662 reflector.go:138] object-"kube-system"/"storage-provisioner-token-7wm24": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-7wm24" is forbidden: User "system:node:old-k8s-version-475170" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-475170' and this object
W0920 18:36:40.513497 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:17 old-k8s-version-475170 kubelet[662]: E0920 18:31:17.391349 662 reflector.go:138] object-"kube-system"/"metrics-server-token-ftv7g": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-ftv7g" is forbidden: User "system:node:old-k8s-version-475170" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-475170' and this object
W0920 18:36:40.513699 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:17 old-k8s-version-475170 kubelet[662]: E0920 18:31:17.391412 662 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-475170" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-475170' and this object
W0920 18:36:40.513909 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:17 old-k8s-version-475170 kubelet[662]: E0920 18:31:17.391421 662 reflector.go:138] object-"default"/"default-token-pflvr": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-pflvr" is forbidden: User "system:node:old-k8s-version-475170" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-475170' and this object
W0920 18:36:40.514126 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:17 old-k8s-version-475170 kubelet[662]: E0920 18:31:17.391476 662 reflector.go:138] object-"kube-system"/"kube-proxy-token-s4d9s": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-s4d9s" is forbidden: User "system:node:old-k8s-version-475170" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-475170' and this object
W0920 18:36:40.522762 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:21 old-k8s-version-475170 kubelet[662]: E0920 18:31:21.571773 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0920 18:36:40.522953 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:21 old-k8s-version-475170 kubelet[662]: E0920 18:31:21.781672 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:40.527348 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:43 old-k8s-version-475170 kubelet[662]: E0920 18:31:43.014693 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0920 18:36:40.527977 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:44 old-k8s-version-475170 kubelet[662]: E0920 18:31:44.859444 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.528308 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:45 old-k8s-version-475170 kubelet[662]: E0920 18:31:45.862927 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.528643 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:47 old-k8s-version-475170 kubelet[662]: E0920 18:31:47.458620 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.529169 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:56 old-k8s-version-475170 kubelet[662]: E0920 18:31:56.563261 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:40.530117 506753 logs.go:138] Found kubelet problem: Sep 20 18:32:02 old-k8s-version-475170 kubelet[662]: E0920 18:32:02.910262 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.530449 506753 logs.go:138] Found kubelet problem: Sep 20 18:32:07 old-k8s-version-475170 kubelet[662]: E0920 18:32:07.458841 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.532889 506753 logs.go:138] Found kubelet problem: Sep 20 18:32:07 old-k8s-version-475170 kubelet[662]: E0920 18:32:07.571677 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0920 18:36:40.533216 506753 logs.go:138] Found kubelet problem: Sep 20 18:32:20 old-k8s-version-475170 kubelet[662]: E0920 18:32:20.564228 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.533414 506753 logs.go:138] Found kubelet problem: Sep 20 18:32:21 old-k8s-version-475170 kubelet[662]: E0920 18:32:21.560781 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:40.534011 506753 logs.go:138] Found kubelet problem: Sep 20 18:32:35 old-k8s-version-475170 kubelet[662]: E0920 18:32:35.002687 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.534195 506753 logs.go:138] Found kubelet problem: Sep 20 18:32:36 old-k8s-version-475170 kubelet[662]: E0920 18:32:36.562114 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:40.534524 506753 logs.go:138] Found kubelet problem: Sep 20 18:32:37 old-k8s-version-475170 kubelet[662]: E0920 18:32:37.458573 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.534854 506753 logs.go:138] Found kubelet problem: Sep 20 18:32:47 old-k8s-version-475170 kubelet[662]: E0920 18:32:47.560274 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.537289 506753 logs.go:138] Found kubelet problem: Sep 20 18:32:50 old-k8s-version-475170 kubelet[662]: E0920 18:32:50.573726 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0920 18:36:40.537618 506753 logs.go:138] Found kubelet problem: Sep 20 18:32:59 old-k8s-version-475170 kubelet[662]: E0920 18:32:59.560273 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.537805 506753 logs.go:138] Found kubelet problem: Sep 20 18:33:01 old-k8s-version-475170 kubelet[662]: E0920 18:33:01.561247 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:40.538132 506753 logs.go:138] Found kubelet problem: Sep 20 18:33:13 old-k8s-version-475170 kubelet[662]: E0920 18:33:13.560334 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.538315 506753 logs.go:138] Found kubelet problem: Sep 20 18:33:16 old-k8s-version-475170 kubelet[662]: E0920 18:33:16.560810 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:40.538914 506753 logs.go:138] Found kubelet problem: Sep 20 18:33:29 old-k8s-version-475170 kubelet[662]: E0920 18:33:29.189104 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.539144 506753 logs.go:138] Found kubelet problem: Sep 20 18:33:29 old-k8s-version-475170 kubelet[662]: E0920 18:33:29.560759 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:40.539474 506753 logs.go:138] Found kubelet problem: Sep 20 18:33:37 old-k8s-version-475170 kubelet[662]: E0920 18:33:37.458800 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.539664 506753 logs.go:138] Found kubelet problem: Sep 20 18:33:41 old-k8s-version-475170 kubelet[662]: E0920 18:33:41.560924 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:40.539993 506753 logs.go:138] Found kubelet problem: Sep 20 18:33:49 old-k8s-version-475170 kubelet[662]: E0920 18:33:49.560399 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.540183 506753 logs.go:138] Found kubelet problem: Sep 20 18:33:56 old-k8s-version-475170 kubelet[662]: E0920 18:33:56.560918 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:40.540509 506753 logs.go:138] Found kubelet problem: Sep 20 18:34:01 old-k8s-version-475170 kubelet[662]: E0920 18:34:01.560297 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.540693 506753 logs.go:138] Found kubelet problem: Sep 20 18:34:08 old-k8s-version-475170 kubelet[662]: E0920 18:34:08.565922 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:40.541020 506753 logs.go:138] Found kubelet problem: Sep 20 18:34:13 old-k8s-version-475170 kubelet[662]: E0920 18:34:13.560350 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.543460 506753 logs.go:138] Found kubelet problem: Sep 20 18:34:19 old-k8s-version-475170 kubelet[662]: E0920 18:34:19.569001 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0920 18:36:40.543796 506753 logs.go:138] Found kubelet problem: Sep 20 18:34:24 old-k8s-version-475170 kubelet[662]: E0920 18:34:24.564378 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.543985 506753 logs.go:138] Found kubelet problem: Sep 20 18:34:30 old-k8s-version-475170 kubelet[662]: E0920 18:34:30.570033 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:40.544316 506753 logs.go:138] Found kubelet problem: Sep 20 18:34:38 old-k8s-version-475170 kubelet[662]: E0920 18:34:38.560886 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.544502 506753 logs.go:138] Found kubelet problem: Sep 20 18:34:41 old-k8s-version-475170 kubelet[662]: E0920 18:34:41.568748 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:40.545093 506753 logs.go:138] Found kubelet problem: Sep 20 18:34:53 old-k8s-version-475170 kubelet[662]: E0920 18:34:53.437729 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.545277 506753 logs.go:138] Found kubelet problem: Sep 20 18:34:56 old-k8s-version-475170 kubelet[662]: E0920 18:34:56.560875 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:40.545602 506753 logs.go:138] Found kubelet problem: Sep 20 18:34:57 old-k8s-version-475170 kubelet[662]: E0920 18:34:57.458858 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.545927 506753 logs.go:138] Found kubelet problem: Sep 20 18:35:09 old-k8s-version-475170 kubelet[662]: E0920 18:35:09.560326 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.546111 506753 logs.go:138] Found kubelet problem: Sep 20 18:35:09 old-k8s-version-475170 kubelet[662]: E0920 18:35:09.561513 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:40.546295 506753 logs.go:138] Found kubelet problem: Sep 20 18:35:21 old-k8s-version-475170 kubelet[662]: E0920 18:35:21.560735 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:40.546621 506753 logs.go:138] Found kubelet problem: Sep 20 18:35:22 old-k8s-version-475170 kubelet[662]: E0920 18:35:22.560289 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.546804 506753 logs.go:138] Found kubelet problem: Sep 20 18:35:34 old-k8s-version-475170 kubelet[662]: E0920 18:35:34.560606 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:40.547142 506753 logs.go:138] Found kubelet problem: Sep 20 18:35:37 old-k8s-version-475170 kubelet[662]: E0920 18:35:37.560351 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.547327 506753 logs.go:138] Found kubelet problem: Sep 20 18:35:47 old-k8s-version-475170 kubelet[662]: E0920 18:35:47.560695 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:40.547657 506753 logs.go:138] Found kubelet problem: Sep 20 18:35:51 old-k8s-version-475170 kubelet[662]: E0920 18:35:51.560316 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.547844 506753 logs.go:138] Found kubelet problem: Sep 20 18:36:00 old-k8s-version-475170 kubelet[662]: E0920 18:36:00.571086 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:40.548172 506753 logs.go:138] Found kubelet problem: Sep 20 18:36:06 old-k8s-version-475170 kubelet[662]: E0920 18:36:06.560426 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.548358 506753 logs.go:138] Found kubelet problem: Sep 20 18:36:15 old-k8s-version-475170 kubelet[662]: E0920 18:36:15.560776 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:40.548683 506753 logs.go:138] Found kubelet problem: Sep 20 18:36:20 old-k8s-version-475170 kubelet[662]: E0920 18:36:20.565096 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.548868 506753 logs.go:138] Found kubelet problem: Sep 20 18:36:28 old-k8s-version-475170 kubelet[662]: E0920 18:36:28.561796 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:40.549202 506753 logs.go:138] Found kubelet problem: Sep 20 18:36:31 old-k8s-version-475170 kubelet[662]: E0920 18:36:31.560613 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.549392 506753 logs.go:138] Found kubelet problem: Sep 20 18:36:39 old-k8s-version-475170 kubelet[662]: E0920 18:36:39.560758 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0920 18:36:40.549403 506753 logs.go:123] Gathering logs for coredns [bba0d98fd29865d157261c8482ac52d89e6ffc1f1e5b727ff5d3d5262a37fd32] ...
I0920 18:36:40.549418 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bba0d98fd29865d157261c8482ac52d89e6ffc1f1e5b727ff5d3d5262a37fd32"
I0920 18:36:40.596117 506753 logs.go:123] Gathering logs for kube-scheduler [186afb87158e29ba5b33e79e9d46317f8bf2277b41c9c1948bb4fe7bd52cb5ca] ...
I0920 18:36:40.596147 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 186afb87158e29ba5b33e79e9d46317f8bf2277b41c9c1948bb4fe7bd52cb5ca"
I0920 18:36:40.642804 506753 out.go:358] Setting ErrFile to fd 2...
I0920 18:36:40.642832 506753 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0920 18:36:40.642899 506753 out.go:270] X Problems detected in kubelet:
X Problems detected in kubelet:
W0920 18:36:40.642912 506753 out.go:270] Sep 20 18:36:15 old-k8s-version-475170 kubelet[662]: E0920 18:36:15.560776 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 20 18:36:15 old-k8s-version-475170 kubelet[662]: E0920 18:36:15.560776 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:40.642923 506753 out.go:270] Sep 20 18:36:20 old-k8s-version-475170 kubelet[662]: E0920 18:36:20.565096 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
Sep 20 18:36:20 old-k8s-version-475170 kubelet[662]: E0920 18:36:20.565096 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.642956 506753 out.go:270] Sep 20 18:36:28 old-k8s-version-475170 kubelet[662]: E0920 18:36:28.561796 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 20 18:36:28 old-k8s-version-475170 kubelet[662]: E0920 18:36:28.561796 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:40.642969 506753 out.go:270] Sep 20 18:36:31 old-k8s-version-475170 kubelet[662]: E0920 18:36:31.560613 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
Sep 20 18:36:31 old-k8s-version-475170 kubelet[662]: E0920 18:36:31.560613 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:40.642983 506753 out.go:270] Sep 20 18:36:39 old-k8s-version-475170 kubelet[662]: E0920 18:36:39.560758 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 20 18:36:39 old-k8s-version-475170 kubelet[662]: E0920 18:36:39.560758 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0920 18:36:40.642990 506753 out.go:358] Setting ErrFile to fd 2...
I0920 18:36:40.643009 506753 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0920 18:36:50.643999 506753 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0920 18:36:50.663478 506753 api_server.go:72] duration metric: took 5m49.905179208s to wait for apiserver process to appear ...
I0920 18:36:50.663505 506753 api_server.go:88] waiting for apiserver healthz status ...
I0920 18:36:50.663542 506753 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0920 18:36:50.663604 506753 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0920 18:36:50.724871 506753 cri.go:89] found id: "819a0e2152e9284aada7d30f67dd8a064d3cd2804d41229ca0e7af02aa77f0c0"
I0920 18:36:50.724890 506753 cri.go:89] found id: "e9fb3ff5b999ec2b982365086ff02d308b31e23e032a6a83b361204f78b0edf6"
I0920 18:36:50.724894 506753 cri.go:89] found id: ""
I0920 18:36:50.724902 506753 logs.go:276] 2 containers: [819a0e2152e9284aada7d30f67dd8a064d3cd2804d41229ca0e7af02aa77f0c0 e9fb3ff5b999ec2b982365086ff02d308b31e23e032a6a83b361204f78b0edf6]
I0920 18:36:50.724956 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:50.730579 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:50.735327 506753 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0920 18:36:50.735404 506753 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0920 18:36:50.800388 506753 cri.go:89] found id: "b41a67962b9045e22b2075573e3f11825adf11fb40f066ced5d6a9c9b4586c99"
I0920 18:36:50.800410 506753 cri.go:89] found id: "233df6b6eb986baede4db039e732ee1858dd85728e913ffd728598b107989bfd"
I0920 18:36:50.800415 506753 cri.go:89] found id: ""
I0920 18:36:50.800423 506753 logs.go:276] 2 containers: [b41a67962b9045e22b2075573e3f11825adf11fb40f066ced5d6a9c9b4586c99 233df6b6eb986baede4db039e732ee1858dd85728e913ffd728598b107989bfd]
I0920 18:36:50.800479 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:50.804276 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:50.807916 506753 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0920 18:36:50.807989 506753 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0920 18:36:50.886003 506753 cri.go:89] found id: "bba0d98fd29865d157261c8482ac52d89e6ffc1f1e5b727ff5d3d5262a37fd32"
I0920 18:36:50.886027 506753 cri.go:89] found id: "3e5b0a7d9d673d78cc6bc4fb42b865a56a854a554083c93d5469d52ce1613872"
I0920 18:36:50.886033 506753 cri.go:89] found id: ""
I0920 18:36:50.886041 506753 logs.go:276] 2 containers: [bba0d98fd29865d157261c8482ac52d89e6ffc1f1e5b727ff5d3d5262a37fd32 3e5b0a7d9d673d78cc6bc4fb42b865a56a854a554083c93d5469d52ce1613872]
I0920 18:36:50.886124 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:50.894588 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:50.898446 506753 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0920 18:36:50.898543 506753 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0920 18:36:50.947683 506753 cri.go:89] found id: "186afb87158e29ba5b33e79e9d46317f8bf2277b41c9c1948bb4fe7bd52cb5ca"
I0920 18:36:50.947706 506753 cri.go:89] found id: "199b68be37f6dec0c3e145251b4cf0f7dc80451e8df9799cc519d5f26245c333"
I0920 18:36:50.947711 506753 cri.go:89] found id: ""
I0920 18:36:50.947719 506753 logs.go:276] 2 containers: [186afb87158e29ba5b33e79e9d46317f8bf2277b41c9c1948bb4fe7bd52cb5ca 199b68be37f6dec0c3e145251b4cf0f7dc80451e8df9799cc519d5f26245c333]
I0920 18:36:50.947802 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:50.951394 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:50.954774 506753 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0920 18:36:50.954847 506753 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0920 18:36:50.993047 506753 cri.go:89] found id: "101769e8441e423925facf5f93161549531fb8ea432669373cb403b040be6102"
I0920 18:36:50.993069 506753 cri.go:89] found id: "93d93c2e410820672b1234f1012c02eadac7b65e873d66423584e1bf387e045e"
I0920 18:36:50.993074 506753 cri.go:89] found id: ""
I0920 18:36:50.993081 506753 logs.go:276] 2 containers: [101769e8441e423925facf5f93161549531fb8ea432669373cb403b040be6102 93d93c2e410820672b1234f1012c02eadac7b65e873d66423584e1bf387e045e]
I0920 18:36:50.993139 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:50.996778 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:51.000391 506753 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0920 18:36:51.000463 506753 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0920 18:36:51.049636 506753 cri.go:89] found id: "233d68ae9f8fdfbccfa0227891e909d8315f56c07f1a81d70b9939806795f464"
I0920 18:36:51.049658 506753 cri.go:89] found id: "3537612de5ba307587c7b835c7e961d7204cd3b56b96f9297584d7d664afdcc6"
I0920 18:36:51.049663 506753 cri.go:89] found id: ""
I0920 18:36:51.049670 506753 logs.go:276] 2 containers: [233d68ae9f8fdfbccfa0227891e909d8315f56c07f1a81d70b9939806795f464 3537612de5ba307587c7b835c7e961d7204cd3b56b96f9297584d7d664afdcc6]
I0920 18:36:51.049726 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:51.053689 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:51.057386 506753 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0920 18:36:51.057493 506753 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0920 18:36:51.104092 506753 cri.go:89] found id: "fdda1626f0e17b465e141e79489b20add7508ca46cf9cd2f835cf37bb6674225"
I0920 18:36:51.104128 506753 cri.go:89] found id: "8a4ee0253af3725554a381aa7b6a8f89dbafb548f3de5993565a3866b25f01fc"
I0920 18:36:51.104134 506753 cri.go:89] found id: ""
I0920 18:36:51.104159 506753 logs.go:276] 2 containers: [fdda1626f0e17b465e141e79489b20add7508ca46cf9cd2f835cf37bb6674225 8a4ee0253af3725554a381aa7b6a8f89dbafb548f3de5993565a3866b25f01fc]
I0920 18:36:51.104251 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:51.108435 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:51.112388 506753 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0920 18:36:51.112464 506753 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0920 18:36:51.167472 506753 cri.go:89] found id: "9bc5c63f723351b1d6ef80d461357d2aa2f2e9617925dad553809fae62b51f84"
I0920 18:36:51.167496 506753 cri.go:89] found id: "e126978f873c21258f64888c111ebc9d582eb0398c12b5d85458a1909b5cbe76"
I0920 18:36:51.167501 506753 cri.go:89] found id: ""
I0920 18:36:51.167510 506753 logs.go:276] 2 containers: [9bc5c63f723351b1d6ef80d461357d2aa2f2e9617925dad553809fae62b51f84 e126978f873c21258f64888c111ebc9d582eb0398c12b5d85458a1909b5cbe76]
I0920 18:36:51.167568 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:51.171433 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:51.174978 506753 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0920 18:36:51.175097 506753 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0920 18:36:51.213083 506753 cri.go:89] found id: "b12b0d4c8fc78ca871279a8f41127290f53d614f970d7916b20ce43b14066509"
I0920 18:36:51.213104 506753 cri.go:89] found id: ""
I0920 18:36:51.213112 506753 logs.go:276] 1 containers: [b12b0d4c8fc78ca871279a8f41127290f53d614f970d7916b20ce43b14066509]
I0920 18:36:51.213173 506753 ssh_runner.go:195] Run: which crictl
I0920 18:36:51.216824 506753 logs.go:123] Gathering logs for kubernetes-dashboard [b12b0d4c8fc78ca871279a8f41127290f53d614f970d7916b20ce43b14066509] ...
I0920 18:36:51.216849 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b12b0d4c8fc78ca871279a8f41127290f53d614f970d7916b20ce43b14066509"
I0920 18:36:51.279731 506753 logs.go:123] Gathering logs for kube-apiserver [e9fb3ff5b999ec2b982365086ff02d308b31e23e032a6a83b361204f78b0edf6] ...
I0920 18:36:51.279762 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e9fb3ff5b999ec2b982365086ff02d308b31e23e032a6a83b361204f78b0edf6"
I0920 18:36:51.349953 506753 logs.go:123] Gathering logs for etcd [233df6b6eb986baede4db039e732ee1858dd85728e913ffd728598b107989bfd] ...
I0920 18:36:51.349996 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 233df6b6eb986baede4db039e732ee1858dd85728e913ffd728598b107989bfd"
I0920 18:36:51.410094 506753 logs.go:123] Gathering logs for coredns [bba0d98fd29865d157261c8482ac52d89e6ffc1f1e5b727ff5d3d5262a37fd32] ...
I0920 18:36:51.410124 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bba0d98fd29865d157261c8482ac52d89e6ffc1f1e5b727ff5d3d5262a37fd32"
I0920 18:36:51.471385 506753 logs.go:123] Gathering logs for coredns [3e5b0a7d9d673d78cc6bc4fb42b865a56a854a554083c93d5469d52ce1613872] ...
I0920 18:36:51.471415 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3e5b0a7d9d673d78cc6bc4fb42b865a56a854a554083c93d5469d52ce1613872"
I0920 18:36:51.548492 506753 logs.go:123] Gathering logs for kindnet [8a4ee0253af3725554a381aa7b6a8f89dbafb548f3de5993565a3866b25f01fc] ...
I0920 18:36:51.548522 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8a4ee0253af3725554a381aa7b6a8f89dbafb548f3de5993565a3866b25f01fc"
I0920 18:36:51.647765 506753 logs.go:123] Gathering logs for storage-provisioner [e126978f873c21258f64888c111ebc9d582eb0398c12b5d85458a1909b5cbe76] ...
I0920 18:36:51.647796 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e126978f873c21258f64888c111ebc9d582eb0398c12b5d85458a1909b5cbe76"
I0920 18:36:51.701179 506753 logs.go:123] Gathering logs for dmesg ...
I0920 18:36:51.701210 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0920 18:36:51.746660 506753 logs.go:123] Gathering logs for kube-apiserver [819a0e2152e9284aada7d30f67dd8a064d3cd2804d41229ca0e7af02aa77f0c0] ...
I0920 18:36:51.746690 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 819a0e2152e9284aada7d30f67dd8a064d3cd2804d41229ca0e7af02aa77f0c0"
I0920 18:36:51.844920 506753 logs.go:123] Gathering logs for etcd [b41a67962b9045e22b2075573e3f11825adf11fb40f066ced5d6a9c9b4586c99] ...
I0920 18:36:51.844958 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b41a67962b9045e22b2075573e3f11825adf11fb40f066ced5d6a9c9b4586c99"
I0920 18:36:51.899426 506753 logs.go:123] Gathering logs for kube-scheduler [199b68be37f6dec0c3e145251b4cf0f7dc80451e8df9799cc519d5f26245c333] ...
I0920 18:36:51.899459 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 199b68be37f6dec0c3e145251b4cf0f7dc80451e8df9799cc519d5f26245c333"
I0920 18:36:51.951489 506753 logs.go:123] Gathering logs for storage-provisioner [9bc5c63f723351b1d6ef80d461357d2aa2f2e9617925dad553809fae62b51f84] ...
I0920 18:36:51.951521 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9bc5c63f723351b1d6ef80d461357d2aa2f2e9617925dad553809fae62b51f84"
I0920 18:36:52.004471 506753 logs.go:123] Gathering logs for kubelet ...
I0920 18:36:52.004500 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0920 18:36:52.064540 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:17 old-k8s-version-475170 kubelet[662]: E0920 18:31:17.390835 662 reflector.go:138] object-"kube-system"/"kindnet-token-t5zmp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-t5zmp" is forbidden: User "system:node:old-k8s-version-475170" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-475170' and this object
W0920 18:36:52.064778 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:17 old-k8s-version-475170 kubelet[662]: E0920 18:31:17.391083 662 reflector.go:138] object-"kube-system"/"coredns-token-4tb5x": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-4tb5x" is forbidden: User "system:node:old-k8s-version-475170" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-475170' and this object
W0920 18:36:52.064987 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:17 old-k8s-version-475170 kubelet[662]: E0920 18:31:17.391195 662 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-475170" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-475170' and this object
W0920 18:36:52.065300 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:17 old-k8s-version-475170 kubelet[662]: E0920 18:31:17.391282 662 reflector.go:138] object-"kube-system"/"storage-provisioner-token-7wm24": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-7wm24" is forbidden: User "system:node:old-k8s-version-475170" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-475170' and this object
W0920 18:36:52.065536 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:17 old-k8s-version-475170 kubelet[662]: E0920 18:31:17.391349 662 reflector.go:138] object-"kube-system"/"metrics-server-token-ftv7g": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-ftv7g" is forbidden: User "system:node:old-k8s-version-475170" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-475170' and this object
W0920 18:36:52.065741 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:17 old-k8s-version-475170 kubelet[662]: E0920 18:31:17.391412 662 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-475170" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-475170' and this object
W0920 18:36:52.065953 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:17 old-k8s-version-475170 kubelet[662]: E0920 18:31:17.391421 662 reflector.go:138] object-"default"/"default-token-pflvr": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-pflvr" is forbidden: User "system:node:old-k8s-version-475170" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-475170' and this object
W0920 18:36:52.066168 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:17 old-k8s-version-475170 kubelet[662]: E0920 18:31:17.391476 662 reflector.go:138] object-"kube-system"/"kube-proxy-token-s4d9s": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-s4d9s" is forbidden: User "system:node:old-k8s-version-475170" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-475170' and this object
W0920 18:36:52.074825 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:21 old-k8s-version-475170 kubelet[662]: E0920 18:31:21.571773 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0920 18:36:52.075060 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:21 old-k8s-version-475170 kubelet[662]: E0920 18:31:21.781672 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.079411 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:43 old-k8s-version-475170 kubelet[662]: E0920 18:31:43.014693 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0920 18:36:52.080004 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:44 old-k8s-version-475170 kubelet[662]: E0920 18:31:44.859444 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.080332 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:45 old-k8s-version-475170 kubelet[662]: E0920 18:31:45.862927 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.080663 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:47 old-k8s-version-475170 kubelet[662]: E0920 18:31:47.458620 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.081179 506753 logs.go:138] Found kubelet problem: Sep 20 18:31:56 old-k8s-version-475170 kubelet[662]: E0920 18:31:56.563261 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.082120 506753 logs.go:138] Found kubelet problem: Sep 20 18:32:02 old-k8s-version-475170 kubelet[662]: E0920 18:32:02.910262 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.082512 506753 logs.go:138] Found kubelet problem: Sep 20 18:32:07 old-k8s-version-475170 kubelet[662]: E0920 18:32:07.458841 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.085080 506753 logs.go:138] Found kubelet problem: Sep 20 18:32:07 old-k8s-version-475170 kubelet[662]: E0920 18:32:07.571677 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0920 18:36:52.085421 506753 logs.go:138] Found kubelet problem: Sep 20 18:32:20 old-k8s-version-475170 kubelet[662]: E0920 18:32:20.564228 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.085607 506753 logs.go:138] Found kubelet problem: Sep 20 18:32:21 old-k8s-version-475170 kubelet[662]: E0920 18:32:21.560781 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.086193 506753 logs.go:138] Found kubelet problem: Sep 20 18:32:35 old-k8s-version-475170 kubelet[662]: E0920 18:32:35.002687 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.086376 506753 logs.go:138] Found kubelet problem: Sep 20 18:32:36 old-k8s-version-475170 kubelet[662]: E0920 18:32:36.562114 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.086704 506753 logs.go:138] Found kubelet problem: Sep 20 18:32:37 old-k8s-version-475170 kubelet[662]: E0920 18:32:37.458573 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.087040 506753 logs.go:138] Found kubelet problem: Sep 20 18:32:47 old-k8s-version-475170 kubelet[662]: E0920 18:32:47.560274 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.089545 506753 logs.go:138] Found kubelet problem: Sep 20 18:32:50 old-k8s-version-475170 kubelet[662]: E0920 18:32:50.573726 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0920 18:36:52.089879 506753 logs.go:138] Found kubelet problem: Sep 20 18:32:59 old-k8s-version-475170 kubelet[662]: E0920 18:32:59.560273 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.090076 506753 logs.go:138] Found kubelet problem: Sep 20 18:33:01 old-k8s-version-475170 kubelet[662]: E0920 18:33:01.561247 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.090412 506753 logs.go:138] Found kubelet problem: Sep 20 18:33:13 old-k8s-version-475170 kubelet[662]: E0920 18:33:13.560334 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.090597 506753 logs.go:138] Found kubelet problem: Sep 20 18:33:16 old-k8s-version-475170 kubelet[662]: E0920 18:33:16.560810 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.091348 506753 logs.go:138] Found kubelet problem: Sep 20 18:33:29 old-k8s-version-475170 kubelet[662]: E0920 18:33:29.189104 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.091538 506753 logs.go:138] Found kubelet problem: Sep 20 18:33:29 old-k8s-version-475170 kubelet[662]: E0920 18:33:29.560759 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.091868 506753 logs.go:138] Found kubelet problem: Sep 20 18:33:37 old-k8s-version-475170 kubelet[662]: E0920 18:33:37.458800 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.092051 506753 logs.go:138] Found kubelet problem: Sep 20 18:33:41 old-k8s-version-475170 kubelet[662]: E0920 18:33:41.560924 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.092377 506753 logs.go:138] Found kubelet problem: Sep 20 18:33:49 old-k8s-version-475170 kubelet[662]: E0920 18:33:49.560399 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.092560 506753 logs.go:138] Found kubelet problem: Sep 20 18:33:56 old-k8s-version-475170 kubelet[662]: E0920 18:33:56.560918 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.092888 506753 logs.go:138] Found kubelet problem: Sep 20 18:34:01 old-k8s-version-475170 kubelet[662]: E0920 18:34:01.560297 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.093071 506753 logs.go:138] Found kubelet problem: Sep 20 18:34:08 old-k8s-version-475170 kubelet[662]: E0920 18:34:08.565922 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.093394 506753 logs.go:138] Found kubelet problem: Sep 20 18:34:13 old-k8s-version-475170 kubelet[662]: E0920 18:34:13.560350 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.095843 506753 logs.go:138] Found kubelet problem: Sep 20 18:34:19 old-k8s-version-475170 kubelet[662]: E0920 18:34:19.569001 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0920 18:36:52.096169 506753 logs.go:138] Found kubelet problem: Sep 20 18:34:24 old-k8s-version-475170 kubelet[662]: E0920 18:34:24.564378 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.096353 506753 logs.go:138] Found kubelet problem: Sep 20 18:34:30 old-k8s-version-475170 kubelet[662]: E0920 18:34:30.570033 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.096678 506753 logs.go:138] Found kubelet problem: Sep 20 18:34:38 old-k8s-version-475170 kubelet[662]: E0920 18:34:38.560886 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.096868 506753 logs.go:138] Found kubelet problem: Sep 20 18:34:41 old-k8s-version-475170 kubelet[662]: E0920 18:34:41.568748 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.097452 506753 logs.go:138] Found kubelet problem: Sep 20 18:34:53 old-k8s-version-475170 kubelet[662]: E0920 18:34:53.437729 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.097637 506753 logs.go:138] Found kubelet problem: Sep 20 18:34:56 old-k8s-version-475170 kubelet[662]: E0920 18:34:56.560875 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.097960 506753 logs.go:138] Found kubelet problem: Sep 20 18:34:57 old-k8s-version-475170 kubelet[662]: E0920 18:34:57.458858 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.098285 506753 logs.go:138] Found kubelet problem: Sep 20 18:35:09 old-k8s-version-475170 kubelet[662]: E0920 18:35:09.560326 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.098471 506753 logs.go:138] Found kubelet problem: Sep 20 18:35:09 old-k8s-version-475170 kubelet[662]: E0920 18:35:09.561513 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.098656 506753 logs.go:138] Found kubelet problem: Sep 20 18:35:21 old-k8s-version-475170 kubelet[662]: E0920 18:35:21.560735 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.098982 506753 logs.go:138] Found kubelet problem: Sep 20 18:35:22 old-k8s-version-475170 kubelet[662]: E0920 18:35:22.560289 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.099198 506753 logs.go:138] Found kubelet problem: Sep 20 18:35:34 old-k8s-version-475170 kubelet[662]: E0920 18:35:34.560606 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.099528 506753 logs.go:138] Found kubelet problem: Sep 20 18:35:37 old-k8s-version-475170 kubelet[662]: E0920 18:35:37.560351 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.099711 506753 logs.go:138] Found kubelet problem: Sep 20 18:35:47 old-k8s-version-475170 kubelet[662]: E0920 18:35:47.560695 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.100096 506753 logs.go:138] Found kubelet problem: Sep 20 18:35:51 old-k8s-version-475170 kubelet[662]: E0920 18:35:51.560316 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.100299 506753 logs.go:138] Found kubelet problem: Sep 20 18:36:00 old-k8s-version-475170 kubelet[662]: E0920 18:36:00.571086 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.100627 506753 logs.go:138] Found kubelet problem: Sep 20 18:36:06 old-k8s-version-475170 kubelet[662]: E0920 18:36:06.560426 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.100811 506753 logs.go:138] Found kubelet problem: Sep 20 18:36:15 old-k8s-version-475170 kubelet[662]: E0920 18:36:15.560776 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.101138 506753 logs.go:138] Found kubelet problem: Sep 20 18:36:20 old-k8s-version-475170 kubelet[662]: E0920 18:36:20.565096 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.101322 506753 logs.go:138] Found kubelet problem: Sep 20 18:36:28 old-k8s-version-475170 kubelet[662]: E0920 18:36:28.561796 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.101649 506753 logs.go:138] Found kubelet problem: Sep 20 18:36:31 old-k8s-version-475170 kubelet[662]: E0920 18:36:31.560613 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.101834 506753 logs.go:138] Found kubelet problem: Sep 20 18:36:39 old-k8s-version-475170 kubelet[662]: E0920 18:36:39.560758 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.102158 506753 logs.go:138] Found kubelet problem: Sep 20 18:36:45 old-k8s-version-475170 kubelet[662]: E0920 18:36:45.560462 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.102342 506753 logs.go:138] Found kubelet problem: Sep 20 18:36:50 old-k8s-version-475170 kubelet[662]: E0920 18:36:50.560674 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0920 18:36:52.102352 506753 logs.go:123] Gathering logs for kube-scheduler [186afb87158e29ba5b33e79e9d46317f8bf2277b41c9c1948bb4fe7bd52cb5ca] ...
I0920 18:36:52.102369 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 186afb87158e29ba5b33e79e9d46317f8bf2277b41c9c1948bb4fe7bd52cb5ca"
I0920 18:36:52.182143 506753 logs.go:123] Gathering logs for kube-proxy [101769e8441e423925facf5f93161549531fb8ea432669373cb403b040be6102] ...
I0920 18:36:52.182175 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 101769e8441e423925facf5f93161549531fb8ea432669373cb403b040be6102"
I0920 18:36:52.230742 506753 logs.go:123] Gathering logs for containerd ...
I0920 18:36:52.230772 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0920 18:36:52.304450 506753 logs.go:123] Gathering logs for container status ...
I0920 18:36:52.304534 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0920 18:36:52.385355 506753 logs.go:123] Gathering logs for describe nodes ...
I0920 18:36:52.385437 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0920 18:36:52.596145 506753 logs.go:123] Gathering logs for kube-proxy [93d93c2e410820672b1234f1012c02eadac7b65e873d66423584e1bf387e045e] ...
I0920 18:36:52.596231 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 93d93c2e410820672b1234f1012c02eadac7b65e873d66423584e1bf387e045e"
I0920 18:36:52.646915 506753 logs.go:123] Gathering logs for kube-controller-manager [233d68ae9f8fdfbccfa0227891e909d8315f56c07f1a81d70b9939806795f464] ...
I0920 18:36:52.646941 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 233d68ae9f8fdfbccfa0227891e909d8315f56c07f1a81d70b9939806795f464"
I0920 18:36:52.734279 506753 logs.go:123] Gathering logs for kube-controller-manager [3537612de5ba307587c7b835c7e961d7204cd3b56b96f9297584d7d664afdcc6] ...
I0920 18:36:52.734360 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3537612de5ba307587c7b835c7e961d7204cd3b56b96f9297584d7d664afdcc6"
I0920 18:36:52.834536 506753 logs.go:123] Gathering logs for kindnet [fdda1626f0e17b465e141e79489b20add7508ca46cf9cd2f835cf37bb6674225] ...
I0920 18:36:52.834576 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fdda1626f0e17b465e141e79489b20add7508ca46cf9cd2f835cf37bb6674225"
I0920 18:36:52.892448 506753 out.go:358] Setting ErrFile to fd 2...
I0920 18:36:52.892473 506753 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0920 18:36:52.892558 506753 out.go:270] X Problems detected in kubelet:
X Problems detected in kubelet:
W0920 18:36:52.892569 506753 out.go:270] Sep 20 18:36:28 old-k8s-version-475170 kubelet[662]: E0920 18:36:28.561796 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 20 18:36:28 old-k8s-version-475170 kubelet[662]: E0920 18:36:28.561796 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.892693 506753 out.go:270] Sep 20 18:36:31 old-k8s-version-475170 kubelet[662]: E0920 18:36:31.560613 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
Sep 20 18:36:31 old-k8s-version-475170 kubelet[662]: E0920 18:36:31.560613 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.892708 506753 out.go:270] Sep 20 18:36:39 old-k8s-version-475170 kubelet[662]: E0920 18:36:39.560758 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 20 18:36:39 old-k8s-version-475170 kubelet[662]: E0920 18:36:39.560758 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.892730 506753 out.go:270] Sep 20 18:36:45 old-k8s-version-475170 kubelet[662]: E0920 18:36:45.560462 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
Sep 20 18:36:45 old-k8s-version-475170 kubelet[662]: E0920 18:36:45.560462 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.892740 506753 out.go:270] Sep 20 18:36:50 old-k8s-version-475170 kubelet[662]: E0920 18:36:50.560674 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 20 18:36:50 old-k8s-version-475170 kubelet[662]: E0920 18:36:50.560674 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0920 18:36:52.892746 506753 out.go:358] Setting ErrFile to fd 2...
I0920 18:36:52.892756 506753 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0920 18:37:02.892915 506753 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0920 18:37:02.908774 506753 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0920 18:37:02.911340 506753 out.go:201]
W0920 18:37:02.913428 506753 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0920 18:37:02.913473 506753 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0920 18:37:02.913496 506753 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0920 18:37:02.913506 506753 out.go:270] *
*
W0920 18:37:02.914882 506753 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0920 18:37:02.916769 506753 out.go:201]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-475170 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-475170
helpers_test.go:235: (dbg) docker inspect old-k8s-version-475170:
-- stdout --
[
{
"Id": "e1fab191f1e133beac62a793b6bd563fa1cd7bd886b88fcb483ab092f260ce1c",
"Created": "2024-09-20T18:27:43.433943504Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 506951,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-09-20T18:30:52.95807732Z",
"FinishedAt": "2024-09-20T18:30:51.531926164Z"
},
"Image": "sha256:c94982da1293baee77c00993711af197ed62d6b1a4ee12c0caa4f57c70de4fdc",
"ResolvConfPath": "/var/lib/docker/containers/e1fab191f1e133beac62a793b6bd563fa1cd7bd886b88fcb483ab092f260ce1c/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/e1fab191f1e133beac62a793b6bd563fa1cd7bd886b88fcb483ab092f260ce1c/hostname",
"HostsPath": "/var/lib/docker/containers/e1fab191f1e133beac62a793b6bd563fa1cd7bd886b88fcb483ab092f260ce1c/hosts",
"LogPath": "/var/lib/docker/containers/e1fab191f1e133beac62a793b6bd563fa1cd7bd886b88fcb483ab092f260ce1c/e1fab191f1e133beac62a793b6bd563fa1cd7bd886b88fcb483ab092f260ce1c-json.log",
"Name": "/old-k8s-version-475170",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-475170:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-475170",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/09d0b1443c08b785d7c1e9fbbf7ab7aeb2f8949dc0836e3d5f8bfd5191de3700-init/diff:/var/lib/docker/overlay2/3c4c9ed4137da049c491f1302314a8de7bd30a1897b7cd29bbcd1724ef9b7a93/diff",
"MergedDir": "/var/lib/docker/overlay2/09d0b1443c08b785d7c1e9fbbf7ab7aeb2f8949dc0836e3d5f8bfd5191de3700/merged",
"UpperDir": "/var/lib/docker/overlay2/09d0b1443c08b785d7c1e9fbbf7ab7aeb2f8949dc0836e3d5f8bfd5191de3700/diff",
"WorkDir": "/var/lib/docker/overlay2/09d0b1443c08b785d7c1e9fbbf7ab7aeb2f8949dc0836e3d5f8bfd5191de3700/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-475170",
"Source": "/var/lib/docker/volumes/old-k8s-version-475170/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-475170",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-475170",
"name.minikube.sigs.k8s.io": "old-k8s-version-475170",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "5fecbb382151d6db234f0c8f1f79e1770907b1911c18b70aa7f8762cbce5b898",
"SandboxKey": "/var/run/docker/netns/5fecbb382151",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33434"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33435"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33438"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33436"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33437"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-475170": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:55:02",
"DriverOpts": null,
"NetworkID": "0affc8d07ed54260b9b6de02cf5b6039415049b628299127baea7a03238007da",
"EndpointID": "c2ed92551019d6cc795c994f3f5003dbd020dbb95b21e05b9fb998cd03c8dc76",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-475170",
"e1fab191f1e1"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-475170 -n old-k8s-version-475170
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-475170 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-475170 logs -n 25: (2.488396562s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| start | -p cert-expiration-652317 | cert-expiration-652317 | jenkins | v1.34.0 | 20 Sep 24 18:26 UTC | 20 Sep 24 18:27 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-env-804673 | force-systemd-env-804673 | jenkins | v1.34.0 | 20 Sep 24 18:26 UTC | 20 Sep 24 18:26 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-env-804673 | force-systemd-env-804673 | jenkins | v1.34.0 | 20 Sep 24 18:26 UTC | 20 Sep 24 18:26 UTC |
| start | -p cert-options-222283 | cert-options-222283 | jenkins | v1.34.0 | 20 Sep 24 18:26 UTC | 20 Sep 24 18:27 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-222283 ssh | cert-options-222283 | jenkins | v1.34.0 | 20 Sep 24 18:27 UTC | 20 Sep 24 18:27 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-222283 -- sudo | cert-options-222283 | jenkins | v1.34.0 | 20 Sep 24 18:27 UTC | 20 Sep 24 18:27 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-222283 | cert-options-222283 | jenkins | v1.34.0 | 20 Sep 24 18:27 UTC | 20 Sep 24 18:27 UTC |
| start | -p old-k8s-version-475170 | old-k8s-version-475170 | jenkins | v1.34.0 | 20 Sep 24 18:27 UTC | 20 Sep 24 18:30 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-652317 | cert-expiration-652317 | jenkins | v1.34.0 | 20 Sep 24 18:30 UTC | 20 Sep 24 18:30 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-652317 | cert-expiration-652317 | jenkins | v1.34.0 | 20 Sep 24 18:30 UTC | 20 Sep 24 18:30 UTC |
| start | -p no-preload-949863 | no-preload-949863 | jenkins | v1.34.0 | 20 Sep 24 18:30 UTC | 20 Sep 24 18:31 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
| addons | enable metrics-server -p old-k8s-version-475170 | old-k8s-version-475170 | jenkins | v1.34.0 | 20 Sep 24 18:30 UTC | 20 Sep 24 18:30 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-475170 | old-k8s-version-475170 | jenkins | v1.34.0 | 20 Sep 24 18:30 UTC | 20 Sep 24 18:30 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-475170 | old-k8s-version-475170 | jenkins | v1.34.0 | 20 Sep 24 18:30 UTC | 20 Sep 24 18:30 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-475170 | old-k8s-version-475170 | jenkins | v1.34.0 | 20 Sep 24 18:30 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-949863 | no-preload-949863 | jenkins | v1.34.0 | 20 Sep 24 18:31 UTC | 20 Sep 24 18:31 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-949863 | no-preload-949863 | jenkins | v1.34.0 | 20 Sep 24 18:31 UTC | 20 Sep 24 18:31 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-949863 | no-preload-949863 | jenkins | v1.34.0 | 20 Sep 24 18:31 UTC | 20 Sep 24 18:31 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-949863 | no-preload-949863 | jenkins | v1.34.0 | 20 Sep 24 18:31 UTC | 20 Sep 24 18:36 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
| image | no-preload-949863 image list | no-preload-949863 | jenkins | v1.34.0 | 20 Sep 24 18:36 UTC | 20 Sep 24 18:36 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-949863 | no-preload-949863 | jenkins | v1.34.0 | 20 Sep 24 18:36 UTC | 20 Sep 24 18:36 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-949863 | no-preload-949863 | jenkins | v1.34.0 | 20 Sep 24 18:36 UTC | 20 Sep 24 18:36 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-949863 | no-preload-949863 | jenkins | v1.34.0 | 20 Sep 24 18:36 UTC | 20 Sep 24 18:36 UTC |
| delete | -p no-preload-949863 | no-preload-949863 | jenkins | v1.34.0 | 20 Sep 24 18:36 UTC | 20 Sep 24 18:36 UTC |
| start | -p embed-certs-320115 | embed-certs-320115 | jenkins | v1.34.0 | 20 Sep 24 18:36 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/09/20 18:36:53
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.23.0 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0920 18:36:53.099651 517404 out.go:345] Setting OutFile to fd 1 ...
I0920 18:36:53.099822 517404 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0920 18:36:53.099832 517404 out.go:358] Setting ErrFile to fd 2...
I0920 18:36:53.099837 517404 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0920 18:36:53.100172 517404 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19672-294290/.minikube/bin
I0920 18:36:53.100655 517404 out.go:352] Setting JSON to false
I0920 18:36:53.101675 517404 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":8363,"bootTime":1726849050,"procs":218,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0920 18:36:53.101771 517404 start.go:139] virtualization:
I0920 18:36:53.104634 517404 out.go:177] * [embed-certs-320115] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I0920 18:36:53.107096 517404 out.go:177] - MINIKUBE_LOCATION=19672
I0920 18:36:53.107172 517404 notify.go:220] Checking for updates...
I0920 18:36:53.111889 517404 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0920 18:36:53.113737 517404 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19672-294290/kubeconfig
I0920 18:36:53.115736 517404 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19672-294290/.minikube
I0920 18:36:53.117507 517404 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0920 18:36:53.119132 517404 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0920 18:36:53.121713 517404 config.go:182] Loaded profile config "old-k8s-version-475170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0920 18:36:53.121867 517404 driver.go:394] Setting default libvirt URI to qemu:///system
I0920 18:36:53.149405 517404 docker.go:123] docker version: linux-27.3.0:Docker Engine - Community
I0920 18:36:53.149787 517404 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0920 18:36:53.218372 517404 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:34 OomKillDisable:true NGoroutines:53 SystemTime:2024-09-20 18:36:53.20835883 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aa
rch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214839296 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.3.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridg
e-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.6]] Warnings:<nil>}}
I0920 18:36:53.218477 517404 docker.go:318] overlay module found
I0920 18:36:53.220764 517404 out.go:177] * Using the docker driver based on user configuration
I0920 18:36:53.222737 517404 start.go:297] selected driver: docker
I0920 18:36:53.222756 517404 start.go:901] validating driver "docker" against <nil>
I0920 18:36:53.222770 517404 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0920 18:36:53.223524 517404 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0920 18:36:53.272809 517404 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:34 OomKillDisable:true NGoroutines:53 SystemTime:2024-09-20 18:36:53.2630508 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214839296 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.3.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge
-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.6]] Warnings:<nil>}}
I0920 18:36:53.273011 517404 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0920 18:36:53.273239 517404 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0920 18:36:53.275220 517404 out.go:177] * Using Docker driver with root privileges
I0920 18:36:53.276939 517404 cni.go:84] Creating CNI manager for ""
I0920 18:36:53.277008 517404 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0920 18:36:53.277025 517404 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0920 18:36:53.277114 517404 start.go:340] cluster config:
{Name:embed-certs-320115 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:embed-certs-320115 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Stati
cIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0920 18:36:53.279067 517404 out.go:177] * Starting "embed-certs-320115" primary control-plane node in "embed-certs-320115" cluster
I0920 18:36:53.280633 517404 cache.go:121] Beginning downloading kic base image for docker with containerd
I0920 18:36:53.282839 517404 out.go:177] * Pulling base image v0.0.45-1726784731-19672 ...
I0920 18:36:53.285082 517404 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0920 18:36:53.285145 517404 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19672-294290/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4
I0920 18:36:53.285159 517404 cache.go:56] Caching tarball of preloaded images
I0920 18:36:53.285194 517404 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local docker daemon
I0920 18:36:53.285245 517404 preload.go:172] Found /home/jenkins/minikube-integration/19672-294290/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0920 18:36:53.285256 517404 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on containerd
I0920 18:36:53.285372 517404 profile.go:143] Saving config to /home/jenkins/minikube-integration/19672-294290/.minikube/profiles/embed-certs-320115/config.json ...
I0920 18:36:53.285390 517404 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-294290/.minikube/profiles/embed-certs-320115/config.json: {Name:mkd8a3072a2af9152fa9dc2788f04ffe4bdcf7cd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
W0920 18:36:53.304802 517404 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed is of wrong architecture
I0920 18:36:53.304826 517404 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed to local cache
I0920 18:36:53.304924 517404 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local cache directory
I0920 18:36:53.304947 517404 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local cache directory, skipping pull
I0920 18:36:53.304953 517404 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed exists in cache, skipping pull
I0920 18:36:53.304964 517404 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed as a tarball
I0920 18:36:53.304972 517404 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed from local cache
I0920 18:36:53.438489 517404 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed from cached tarball
I0920 18:36:53.438542 517404 cache.go:194] Successfully downloaded all kic artifacts
I0920 18:36:53.438573 517404 start.go:360] acquireMachinesLock for embed-certs-320115: {Name:mk4635f2feccf9ba90a03b81efcf4b8bd48aa25f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0920 18:36:53.439143 517404 start.go:364] duration metric: took 538.432µs to acquireMachinesLock for "embed-certs-320115"
I0920 18:36:53.439182 517404 start.go:93] Provisioning new machine with config: &{Name:embed-certs-320115 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:embed-certs-320115 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableM
etrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0920 18:36:53.439273 517404 start.go:125] createHost starting for "" (driver="docker")
I0920 18:36:52.230742 506753 logs.go:123] Gathering logs for containerd ...
I0920 18:36:52.230772 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0920 18:36:52.304450 506753 logs.go:123] Gathering logs for container status ...
I0920 18:36:52.304534 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0920 18:36:52.385355 506753 logs.go:123] Gathering logs for describe nodes ...
I0920 18:36:52.385437 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0920 18:36:52.596145 506753 logs.go:123] Gathering logs for kube-proxy [93d93c2e410820672b1234f1012c02eadac7b65e873d66423584e1bf387e045e] ...
I0920 18:36:52.596231 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 93d93c2e410820672b1234f1012c02eadac7b65e873d66423584e1bf387e045e"
I0920 18:36:52.646915 506753 logs.go:123] Gathering logs for kube-controller-manager [233d68ae9f8fdfbccfa0227891e909d8315f56c07f1a81d70b9939806795f464] ...
I0920 18:36:52.646941 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 233d68ae9f8fdfbccfa0227891e909d8315f56c07f1a81d70b9939806795f464"
I0920 18:36:52.734279 506753 logs.go:123] Gathering logs for kube-controller-manager [3537612de5ba307587c7b835c7e961d7204cd3b56b96f9297584d7d664afdcc6] ...
I0920 18:36:52.734360 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3537612de5ba307587c7b835c7e961d7204cd3b56b96f9297584d7d664afdcc6"
I0920 18:36:52.834536 506753 logs.go:123] Gathering logs for kindnet [fdda1626f0e17b465e141e79489b20add7508ca46cf9cd2f835cf37bb6674225] ...
I0920 18:36:52.834576 506753 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fdda1626f0e17b465e141e79489b20add7508ca46cf9cd2f835cf37bb6674225"
I0920 18:36:52.892448 506753 out.go:358] Setting ErrFile to fd 2...
I0920 18:36:52.892473 506753 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0920 18:36:52.892558 506753 out.go:270] X Problems detected in kubelet:
W0920 18:36:52.892569 506753 out.go:270] Sep 20 18:36:28 old-k8s-version-475170 kubelet[662]: E0920 18:36:28.561796 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.892693 506753 out.go:270] Sep 20 18:36:31 old-k8s-version-475170 kubelet[662]: E0920 18:36:31.560613 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.892708 506753 out.go:270] Sep 20 18:36:39 old-k8s-version-475170 kubelet[662]: E0920 18:36:39.560758 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0920 18:36:52.892730 506753 out.go:270] Sep 20 18:36:45 old-k8s-version-475170 kubelet[662]: E0920 18:36:45.560462 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
W0920 18:36:52.892740 506753 out.go:270] Sep 20 18:36:50 old-k8s-version-475170 kubelet[662]: E0920 18:36:50.560674 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0920 18:36:52.892746 506753 out.go:358] Setting ErrFile to fd 2...
I0920 18:36:52.892756 506753 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0920 18:36:53.443210 517404 out.go:235] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0920 18:36:53.443533 517404 start.go:159] libmachine.API.Create for "embed-certs-320115" (driver="docker")
I0920 18:36:53.443573 517404 client.go:168] LocalClient.Create starting
I0920 18:36:53.443673 517404 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19672-294290/.minikube/certs/ca.pem
I0920 18:36:53.443710 517404 main.go:141] libmachine: Decoding PEM data...
I0920 18:36:53.443728 517404 main.go:141] libmachine: Parsing certificate...
I0920 18:36:53.443796 517404 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19672-294290/.minikube/certs/cert.pem
I0920 18:36:53.443823 517404 main.go:141] libmachine: Decoding PEM data...
I0920 18:36:53.443837 517404 main.go:141] libmachine: Parsing certificate...
I0920 18:36:53.444263 517404 cli_runner.go:164] Run: docker network inspect embed-certs-320115 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0920 18:36:53.460270 517404 cli_runner.go:211] docker network inspect embed-certs-320115 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0920 18:36:53.460434 517404 network_create.go:284] running [docker network inspect embed-certs-320115] to gather additional debugging logs...
I0920 18:36:53.460460 517404 cli_runner.go:164] Run: docker network inspect embed-certs-320115
W0920 18:36:53.475747 517404 cli_runner.go:211] docker network inspect embed-certs-320115 returned with exit code 1
I0920 18:36:53.475780 517404 network_create.go:287] error running [docker network inspect embed-certs-320115]: docker network inspect embed-certs-320115: exit status 1
stdout:
[]
stderr:
Error response from daemon: network embed-certs-320115 not found
I0920 18:36:53.475793 517404 network_create.go:289] output of [docker network inspect embed-certs-320115]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network embed-certs-320115 not found
** /stderr **
I0920 18:36:53.475891 517404 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0920 18:36:53.502708 517404 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-758fc8c66451 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:12:0e:b8:19} reservation:<nil>}
I0920 18:36:53.503308 517404 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-bc7d965af1d7 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:cf:0d:c8:d3} reservation:<nil>}
I0920 18:36:53.503672 517404 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-6633e4dc314a IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:c2:55:69:54} reservation:<nil>}
I0920 18:36:53.504258 517404 network.go:206] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001861130}
I0920 18:36:53.504280 517404 network_create.go:124] attempt to create docker network embed-certs-320115 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I0920 18:36:53.504364 517404 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-320115 embed-certs-320115
I0920 18:36:53.582330 517404 network_create.go:108] docker network embed-certs-320115 192.168.76.0/24 created
I0920 18:36:53.582366 517404 kic.go:121] calculated static IP "192.168.76.2" for the "embed-certs-320115" container
I0920 18:36:53.582444 517404 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0920 18:36:53.601804 517404 cli_runner.go:164] Run: docker volume create embed-certs-320115 --label name.minikube.sigs.k8s.io=embed-certs-320115 --label created_by.minikube.sigs.k8s.io=true
I0920 18:36:53.623694 517404 oci.go:103] Successfully created a docker volume embed-certs-320115
I0920 18:36:53.623799 517404 cli_runner.go:164] Run: docker run --rm --name embed-certs-320115-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-320115 --entrypoint /usr/bin/test -v embed-certs-320115:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed -d /var/lib
I0920 18:36:54.283109 517404 oci.go:107] Successfully prepared a docker volume embed-certs-320115
I0920 18:36:54.283164 517404 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0920 18:36:54.283186 517404 kic.go:194] Starting extracting preloaded images to volume ...
I0920 18:36:54.283263 517404 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19672-294290/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-320115:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed -I lz4 -xf /preloaded.tar -C /extractDir
I0920 18:37:02.892915 506753 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0920 18:37:02.908774 506753 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0920 18:37:02.911340 506753 out.go:201]
W0920 18:37:02.913428 506753 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0920 18:37:02.913473 506753 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0920 18:37:02.913496 506753 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0920 18:37:02.913506 506753 out.go:270] *
W0920 18:37:02.914882 506753 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0920 18:37:02.916769 506753 out.go:201]
I0920 18:36:58.581121 517404 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19672-294290/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-320115:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed -I lz4 -xf /preloaded.tar -C /extractDir: (4.297818487s)
I0920 18:36:58.581167 517404 kic.go:203] duration metric: took 4.297972907s to extract preloaded images to volume ...
W0920 18:36:58.581330 517404 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0920 18:36:58.581466 517404 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0920 18:36:58.639799 517404 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-320115 --name embed-certs-320115 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-320115 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-320115 --network embed-certs-320115 --ip 192.168.76.2 --volume embed-certs-320115:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed
I0920 18:36:58.962977 517404 cli_runner.go:164] Run: docker container inspect embed-certs-320115 --format={{.State.Running}}
I0920 18:36:58.983445 517404 cli_runner.go:164] Run: docker container inspect embed-certs-320115 --format={{.State.Status}}
I0920 18:36:59.004014 517404 cli_runner.go:164] Run: docker exec embed-certs-320115 stat /var/lib/dpkg/alternatives/iptables
I0920 18:36:59.092109 517404 oci.go:144] the created container "embed-certs-320115" has a running status.
I0920 18:36:59.092151 517404 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19672-294290/.minikube/machines/embed-certs-320115/id_rsa...
I0920 18:36:59.442964 517404 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19672-294290/.minikube/machines/embed-certs-320115/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0920 18:36:59.471799 517404 cli_runner.go:164] Run: docker container inspect embed-certs-320115 --format={{.State.Status}}
I0920 18:36:59.497521 517404 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0920 18:36:59.497541 517404 kic_runner.go:114] Args: [docker exec --privileged embed-certs-320115 chown docker:docker /home/docker/.ssh/authorized_keys]
I0920 18:36:59.596255 517404 cli_runner.go:164] Run: docker container inspect embed-certs-320115 --format={{.State.Status}}
I0920 18:36:59.633750 517404 machine.go:93] provisionDockerMachine start ...
I0920 18:36:59.633860 517404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-320115
I0920 18:36:59.661886 517404 main.go:141] libmachine: Using SSH client type: native
I0920 18:36:59.662211 517404 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33444 <nil> <nil>}
I0920 18:36:59.662223 517404 main.go:141] libmachine: About to run SSH command:
hostname
I0920 18:36:59.663136 517404 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0920 18:37:02.794848 517404 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-320115
I0920 18:37:02.794883 517404 ubuntu.go:169] provisioning hostname "embed-certs-320115"
I0920 18:37:02.794949 517404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-320115
I0920 18:37:02.823168 517404 main.go:141] libmachine: Using SSH client type: native
I0920 18:37:02.823638 517404 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33444 <nil> <nil>}
I0920 18:37:02.823656 517404 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-320115 && echo "embed-certs-320115" | sudo tee /etc/hostname
I0920 18:37:02.993113 517404 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-320115
I0920 18:37:02.993187 517404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-320115
I0920 18:37:03.058944 517404 main.go:141] libmachine: Using SSH client type: native
I0920 18:37:03.060615 517404 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33444 <nil> <nil>}
I0920 18:37:03.060659 517404 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-320115' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-320115/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-320115' | sudo tee -a /etc/hosts;
fi
fi
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
ede576265552f 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 a0efff585a993 dashboard-metrics-scraper-8d5bb5db8-pq4wb
b12b0d4c8fc78 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 e1580a63ce184 kubernetes-dashboard-cd95d586-7hgck
9bc5c63f72335 ba04bb24b9575 5 minutes ago Running storage-provisioner 1 be88f50945a5e storage-provisioner
06e2f5d021682 1611cd07b61d5 5 minutes ago Running busybox 1 438e739a03a63 busybox
fdda1626f0e17 6a23fa8fd2b78 5 minutes ago Running kindnet-cni 1 e15777df47851 kindnet-s7pqm
101769e8441e4 25a5233254979 5 minutes ago Running kube-proxy 1 0dfcadfb47ec6 kube-proxy-r9xl5
bba0d98fd2986 db91994f4ee8f 5 minutes ago Running coredns 1 9c33e4383dd18 coredns-74ff55c5b-hc5pl
819a0e2152e92 2c08bbbc02d3a 5 minutes ago Running kube-apiserver 1 67cdc3675975f kube-apiserver-old-k8s-version-475170
233d68ae9f8fd 1df8a2b116bd1 5 minutes ago Running kube-controller-manager 1 d966aa5991863 kube-controller-manager-old-k8s-version-475170
186afb87158e2 e7605f88f17d6 5 minutes ago Running kube-scheduler 1 ee56d24e1b2b3 kube-scheduler-old-k8s-version-475170
b41a67962b904 05b738aa1bc63 5 minutes ago Running etcd 1 68762caf8ecaa etcd-old-k8s-version-475170
abdc058d5bf03 1611cd07b61d5 6 minutes ago Exited busybox 0 1344202376c79 busybox
3e5b0a7d9d673 db91994f4ee8f 8 minutes ago Exited coredns 0 04df706415e30 coredns-74ff55c5b-hc5pl
8a4ee0253af37 6a23fa8fd2b78 8 minutes ago Exited kindnet-cni 0 1e5184a405cd7 kindnet-s7pqm
e126978f873c2 ba04bb24b9575 8 minutes ago Exited storage-provisioner 0 ce54f659ac3ff storage-provisioner
93d93c2e41082 25a5233254979 8 minutes ago Exited kube-proxy 0 af05d5fb3dc40 kube-proxy-r9xl5
233df6b6eb986 05b738aa1bc63 8 minutes ago Exited etcd 0 97703aa4f7aff etcd-old-k8s-version-475170
e9fb3ff5b999e 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 8c4369c306753 kube-apiserver-old-k8s-version-475170
3537612de5ba3 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 4fa363b408416 kube-controller-manager-old-k8s-version-475170
199b68be37f6d e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 92c2fa2c62c67 kube-scheduler-old-k8s-version-475170
==> containerd <==
Sep 20 18:33:28 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:33:28.588503467Z" level=info msg="CreateContainer within sandbox \"a0efff585a993a5af1af07e4f2aec72ba9af2fdedc9b19fa4141923724aac4cf\" for name:\"dashboard-metrics-scraper\" attempt:4 returns container id \"7ea05fbc489fcc2fd44ac2ed876a2c16e599f11fdbcba289c8443511302eee03\""
Sep 20 18:33:28 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:33:28.589142884Z" level=info msg="StartContainer for \"7ea05fbc489fcc2fd44ac2ed876a2c16e599f11fdbcba289c8443511302eee03\""
Sep 20 18:33:28 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:33:28.661438222Z" level=info msg="StartContainer for \"7ea05fbc489fcc2fd44ac2ed876a2c16e599f11fdbcba289c8443511302eee03\" returns successfully"
Sep 20 18:33:28 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:33:28.685570104Z" level=info msg="shim disconnected" id=7ea05fbc489fcc2fd44ac2ed876a2c16e599f11fdbcba289c8443511302eee03 namespace=k8s.io
Sep 20 18:33:28 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:33:28.685634736Z" level=warning msg="cleaning up after shim disconnected" id=7ea05fbc489fcc2fd44ac2ed876a2c16e599f11fdbcba289c8443511302eee03 namespace=k8s.io
Sep 20 18:33:28 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:33:28.685644590Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Sep 20 18:33:29 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:33:29.203361031Z" level=info msg="RemoveContainer for \"458fe621bc5b0396e9f90fd9ee16fa72a3eae9bbe4f71493d2f7892b485f8654\""
Sep 20 18:33:29 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:33:29.211533686Z" level=info msg="RemoveContainer for \"458fe621bc5b0396e9f90fd9ee16fa72a3eae9bbe4f71493d2f7892b485f8654\" returns successfully"
Sep 20 18:34:19 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:34:19.560836592Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 20 18:34:19 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:34:19.566562504Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" host=fake.domain
Sep 20 18:34:19 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:34:19.568106764Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Sep 20 18:34:19 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:34:19.568195608Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Sep 20 18:34:52 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:34:52.566873722Z" level=info msg="CreateContainer within sandbox \"a0efff585a993a5af1af07e4f2aec72ba9af2fdedc9b19fa4141923724aac4cf\" for container name:\"dashboard-metrics-scraper\" attempt:5"
Sep 20 18:34:52 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:34:52.582783127Z" level=info msg="CreateContainer within sandbox \"a0efff585a993a5af1af07e4f2aec72ba9af2fdedc9b19fa4141923724aac4cf\" for name:\"dashboard-metrics-scraper\" attempt:5 returns container id \"ede576265552fc52c31896d621c5509c0d403980d968d25712de91548bd4cced\""
Sep 20 18:34:52 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:34:52.583436723Z" level=info msg="StartContainer for \"ede576265552fc52c31896d621c5509c0d403980d968d25712de91548bd4cced\""
Sep 20 18:34:52 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:34:52.649797066Z" level=info msg="StartContainer for \"ede576265552fc52c31896d621c5509c0d403980d968d25712de91548bd4cced\" returns successfully"
Sep 20 18:34:52 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:34:52.674217855Z" level=info msg="shim disconnected" id=ede576265552fc52c31896d621c5509c0d403980d968d25712de91548bd4cced namespace=k8s.io
Sep 20 18:34:52 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:34:52.674285596Z" level=warning msg="cleaning up after shim disconnected" id=ede576265552fc52c31896d621c5509c0d403980d968d25712de91548bd4cced namespace=k8s.io
Sep 20 18:34:52 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:34:52.674298494Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Sep 20 18:34:53 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:34:53.444591588Z" level=info msg="RemoveContainer for \"7ea05fbc489fcc2fd44ac2ed876a2c16e599f11fdbcba289c8443511302eee03\""
Sep 20 18:34:53 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:34:53.450019013Z" level=info msg="RemoveContainer for \"7ea05fbc489fcc2fd44ac2ed876a2c16e599f11fdbcba289c8443511302eee03\" returns successfully"
Sep 20 18:37:01 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:37:01.561313679Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 20 18:37:01 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:37:01.567159572Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" host=fake.domain
Sep 20 18:37:01 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:37:01.568904704Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Sep 20 18:37:01 old-k8s-version-475170 containerd[569]: time="2024-09-20T18:37:01.568920056Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
==> coredns [3e5b0a7d9d673d78cc6bc4fb42b865a56a854a554083c93d5469d52ce1613872] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:58556 - 12422 "HINFO IN 5817523817575646683.2101472075602393078. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.025602109s
==> coredns [bba0d98fd29865d157261c8482ac52d89e6ffc1f1e5b727ff5d3d5262a37fd32] <==
[INFO] plugin/ready: Still waiting on: "kubernetes"
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:51031 - 60533 "HINFO IN 6952676865435153296.5597418273855234125. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.005053874s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I0920 18:31:49.633081 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-09-20 18:31:19.631850609 +0000 UTC m=+0.022610062) (total time: 30.001115039s):
Trace[2019727887]: [30.001115039s] [30.001115039s] END
E0920 18:31:49.633896 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0920 18:31:49.634451 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-09-20 18:31:19.63284753 +0000 UTC m=+0.023606983) (total time: 30.001578555s):
Trace[939984059]: [30.001578555s] [30.001578555s] END
E0920 18:31:49.634595 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0920 18:31:49.634757 1 trace.go:116] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-09-20 18:31:19.632615145 +0000 UTC m=+0.023374598) (total time: 30.002080355s):
Trace[911902081]: [30.002080355s] [30.002080355s] END
E0920 18:31:49.634836 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> describe nodes <==
Name: old-k8s-version-475170
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-475170
kubernetes.io/os=linux
minikube.k8s.io/commit=0626f22cf0d915d75e291a5bce701f94395056e1
minikube.k8s.io/name=old-k8s-version-475170
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_09_20T18_28_20_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Fri, 20 Sep 2024 18:28:17 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-475170
AcquireTime: <unset>
RenewTime: Fri, 20 Sep 2024 18:37:00 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Fri, 20 Sep 2024 18:32:17 +0000 Fri, 20 Sep 2024 18:28:10 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Fri, 20 Sep 2024 18:32:17 +0000 Fri, 20 Sep 2024 18:28:10 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Fri, 20 Sep 2024 18:32:17 +0000 Fri, 20 Sep 2024 18:28:10 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Fri, 20 Sep 2024 18:32:17 +0000 Fri, 20 Sep 2024 18:28:36 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.85.2
Hostname: old-k8s-version-475170
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022304Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022304Ki
pods: 110
System Info:
Machine ID: 4d58842631dd42d1ad44339ae2202e0b
System UUID: ad9b70f1-6a67-44f4-901d-bcd96df814a1
Boot ID: b363b069-6c72-47b0-a80b-36cf6b75e261
Kernel Version: 5.15.0-1070-aws
OS Image: Ubuntu 22.04.5 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.22
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m36s
kube-system coredns-74ff55c5b-hc5pl 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 8m28s
kube-system etcd-old-k8s-version-475170 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 8m35s
kube-system kindnet-s7pqm 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 8m28s
kube-system kube-apiserver-old-k8s-version-475170 250m (12%) 0 (0%) 0 (0%) 0 (0%) 8m35s
kube-system kube-controller-manager-old-k8s-version-475170 200m (10%) 0 (0%) 0 (0%) 0 (0%) 8m35s
kube-system kube-proxy-r9xl5 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m28s
kube-system kube-scheduler-old-k8s-version-475170 100m (5%) 0 (0%) 0 (0%) 0 (0%) 8m35s
kube-system metrics-server-9975d5f86-2scnf 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 6m25s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m27s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-pq4wb 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m30s
kubernetes-dashboard kubernetes-dashboard-cd95d586-7hgck 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m30s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%) 100m (5%)
memory 420Mi (5%) 220Mi (2%)
ephemeral-storage 100Mi (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m55s (x5 over 8m55s) kubelet Node old-k8s-version-475170 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m55s (x4 over 8m55s) kubelet Node old-k8s-version-475170 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m55s (x4 over 8m55s) kubelet Node old-k8s-version-475170 status is now: NodeHasSufficientPID
Normal Starting 8m36s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m36s kubelet Node old-k8s-version-475170 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m36s kubelet Node old-k8s-version-475170 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m36s kubelet Node old-k8s-version-475170 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m36s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m28s kubelet Node old-k8s-version-475170 status is now: NodeReady
Normal Starting 8m27s kube-proxy Starting kube-proxy.
Normal Starting 5m56s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 5m56s (x8 over 5m56s) kubelet Node old-k8s-version-475170 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m56s (x7 over 5m56s) kubelet Node old-k8s-version-475170 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m56s (x8 over 5m56s) kubelet Node old-k8s-version-475170 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 5m56s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m44s kube-proxy Starting kube-proxy.
==> dmesg <==
[Sep20 17:08] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
==> etcd [233df6b6eb986baede4db039e732ee1858dd85728e913ffd728598b107989bfd] <==
raft2024/09/20 18:28:10 INFO: 9f0758e1c58a86ed became candidate at term 2
raft2024/09/20 18:28:10 INFO: 9f0758e1c58a86ed received MsgVoteResp from 9f0758e1c58a86ed at term 2
raft2024/09/20 18:28:10 INFO: 9f0758e1c58a86ed became leader at term 2
raft2024/09/20 18:28:10 INFO: raft.node: 9f0758e1c58a86ed elected leader 9f0758e1c58a86ed at term 2
2024-09-20 18:28:10.453493 I | etcdserver: setting up the initial cluster version to 3.4
2024-09-20 18:28:10.456790 N | etcdserver/membership: set the initial cluster version to 3.4
2024-09-20 18:28:10.456980 I | etcdserver/api: enabled capabilities for version 3.4
2024-09-20 18:28:10.457075 I | etcdserver: published {Name:old-k8s-version-475170 ClientURLs:[https://192.168.85.2:2379]} to cluster 68eaea490fab4e05
2024-09-20 18:28:10.457441 I | embed: ready to serve client requests
2024-09-20 18:28:10.457558 I | embed: ready to serve client requests
2024-09-20 18:28:10.458979 I | embed: serving client requests on 127.0.0.1:2379
2024-09-20 18:28:10.472166 I | embed: serving client requests on 192.168.85.2:2379
2024-09-20 18:28:34.418513 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:28:43.355990 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:28:53.355902 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:29:03.355906 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:29:13.355950 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:29:23.355871 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:29:33.355989 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:29:43.356000 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:29:53.355931 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:30:03.356060 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:30:13.356535 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:30:23.356093 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:30:33.355939 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [b41a67962b9045e22b2075573e3f11825adf11fb40f066ced5d6a9c9b4586c99] <==
2024-09-20 18:33:04.355099 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:33:14.355055 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:33:24.355115 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:33:34.355194 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:33:44.355505 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:33:54.355142 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:34:04.355140 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:34:14.355797 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:34:24.355357 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:34:34.355118 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:34:44.355191 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:34:54.355145 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:35:04.355094 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:35:14.355091 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:35:24.355051 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:35:34.355158 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:35:44.355104 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:35:54.355142 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:36:04.355083 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:36:14.355051 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:36:24.355290 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:36:34.355139 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:36:44.355198 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:36:54.355146 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-20 18:37:04.355331 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
18:37:04 up 2:19, 0 users, load average: 0.68, 1.63, 2.39
Linux old-k8s-version-475170 5.15.0-1070-aws #76~20.04.1-Ubuntu SMP Mon Sep 2 12:20:48 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.5 LTS"
==> kindnet [8a4ee0253af3725554a381aa7b6a8f89dbafb548f3de5993565a3866b25f01fc] <==
I0920 18:28:41.212917 1 shared_informer.go:320] Caches are synced for kube-network-policies
I0920 18:28:41.212962 1 metrics.go:61] Registering metrics
I0920 18:28:41.213048 1 controller.go:374] Syncing nftables rules
I0920 18:28:51.012482 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:28:51.012528 1 main.go:299] handling current node
I0920 18:29:01.012590 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:29:01.012637 1 main.go:299] handling current node
I0920 18:29:11.012784 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:29:11.013382 1 main.go:299] handling current node
I0920 18:29:21.021408 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:29:21.021447 1 main.go:299] handling current node
I0920 18:29:31.021343 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:29:31.021384 1 main.go:299] handling current node
I0920 18:29:41.012604 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:29:41.012647 1 main.go:299] handling current node
I0920 18:29:51.012115 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:29:51.012276 1 main.go:299] handling current node
I0920 18:30:01.015635 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:30:01.015678 1 main.go:299] handling current node
I0920 18:30:11.012883 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:30:11.012932 1 main.go:299] handling current node
I0920 18:30:21.019901 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:30:21.019945 1 main.go:299] handling current node
I0920 18:30:31.012457 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:30:31.012506 1 main.go:299] handling current node
==> kindnet [fdda1626f0e17b465e141e79489b20add7508ca46cf9cd2f835cf37bb6674225] <==
I0920 18:35:00.711861 1 main.go:299] handling current node
I0920 18:35:10.720754 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:35:10.720792 1 main.go:299] handling current node
I0920 18:35:20.711829 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:35:20.711866 1 main.go:299] handling current node
I0920 18:35:30.715514 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:35:30.715551 1 main.go:299] handling current node
I0920 18:35:40.720868 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:35:40.720906 1 main.go:299] handling current node
I0920 18:35:50.720403 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:35:50.720443 1 main.go:299] handling current node
I0920 18:36:00.719802 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:36:00.719849 1 main.go:299] handling current node
I0920 18:36:10.715137 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:36:10.715177 1 main.go:299] handling current node
I0920 18:36:20.712192 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:36:20.712227 1 main.go:299] handling current node
I0920 18:36:30.711972 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:36:30.712032 1 main.go:299] handling current node
I0920 18:36:40.719800 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:36:40.719836 1 main.go:299] handling current node
I0920 18:36:50.719109 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:36:50.719142 1 main.go:299] handling current node
I0920 18:37:00.712524 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0920 18:37:00.712559 1 main.go:299] handling current node
==> kube-apiserver [819a0e2152e9284aada7d30f67dd8a064d3cd2804d41229ca0e7af02aa77f0c0] <==
I0920 18:33:48.021452 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0920 18:33:48.021462 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0920 18:34:20.230021 1 handler_proxy.go:102] no RequestInfo found in the context
E0920 18:34:20.230101 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0920 18:34:20.230112 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0920 18:34:24.925789 1 client.go:360] parsed scheme: "passthrough"
I0920 18:34:24.925834 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0920 18:34:24.925844 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0920 18:34:55.888029 1 client.go:360] parsed scheme: "passthrough"
I0920 18:34:55.888073 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0920 18:34:55.888232 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0920 18:35:34.258821 1 client.go:360] parsed scheme: "passthrough"
I0920 18:35:34.258864 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0920 18:35:34.258873 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0920 18:36:07.947794 1 client.go:360] parsed scheme: "passthrough"
I0920 18:36:07.947837 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0920 18:36:07.947846 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0920 18:36:18.455678 1 handler_proxy.go:102] no RequestInfo found in the context
E0920 18:36:18.455878 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0920 18:36:18.455896 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0920 18:36:51.579570 1 client.go:360] parsed scheme: "passthrough"
I0920 18:36:51.579646 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0920 18:36:51.579656 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [e9fb3ff5b999ec2b982365086ff02d308b31e23e032a6a83b361204f78b0edf6] <==
I0920 18:28:18.011289 1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
I0920 18:28:18.011503 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I0920 18:28:18.022737 1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000
I0920 18:28:18.028570 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I0920 18:28:18.028604 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0920 18:28:18.554855 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0920 18:28:18.620140 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0920 18:28:18.744349 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.85.2]
I0920 18:28:18.745473 1 controller.go:606] quota admission added evaluator for: endpoints
I0920 18:28:18.749491 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0920 18:28:19.038923 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0920 18:28:19.759094 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0920 18:28:20.240768 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0920 18:28:20.305427 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0920 18:28:36.065993 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0920 18:28:36.082560 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0920 18:28:52.469520 1 client.go:360] parsed scheme: "passthrough"
I0920 18:28:52.469566 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0920 18:28:52.469575 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0920 18:29:34.360992 1 client.go:360] parsed scheme: "passthrough"
I0920 18:29:34.361037 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0920 18:29:34.361076 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0920 18:30:18.679543 1 client.go:360] parsed scheme: "passthrough"
I0920 18:30:18.679586 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0920 18:30:18.679595 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [233d68ae9f8fdfbccfa0227891e909d8315f56c07f1a81d70b9939806795f464] <==
W0920 18:32:42.951059 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0920 18:33:06.578738 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0920 18:33:14.601547 1 request.go:655] Throttling request took 1.048360332s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0920 18:33:15.453169 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0920 18:33:37.080646 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0920 18:33:47.103772 1 request.go:655] Throttling request took 1.047929481s, request: GET:https://192.168.85.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0920 18:33:47.955221 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0920 18:34:07.582565 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0920 18:34:19.655776 1 request.go:655] Throttling request took 1.012866939s, request: GET:https://192.168.85.2:8443/apis/policy/v1beta1?timeout=32s
W0920 18:34:20.457214 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0920 18:34:38.084524 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0920 18:34:52.106893 1 request.go:655] Throttling request took 1.048463442s, request: GET:https://192.168.85.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0920 18:34:52.958620 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0920 18:35:08.586359 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0920 18:35:24.609057 1 request.go:655] Throttling request took 1.047919266s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0920 18:35:25.460593 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0920 18:35:39.087598 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0920 18:35:57.111131 1 request.go:655] Throttling request took 1.04827259s, request: GET:https://192.168.85.2:8443/apis/authentication.k8s.io/v1beta1?timeout=32s
W0920 18:35:57.962554 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0920 18:36:09.589111 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0920 18:36:29.613099 1 request.go:655] Throttling request took 1.022359613s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0920 18:36:30.464732 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0920 18:36:40.091295 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0920 18:37:02.115245 1 request.go:655] Throttling request took 1.048448228s, request: GET:https://192.168.85.2:8443/apis/scheduling.k8s.io/v1?timeout=32s
W0920 18:37:02.969481 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-controller-manager [3537612de5ba307587c7b835c7e961d7204cd3b56b96f9297584d7d664afdcc6] <==
I0920 18:28:36.105914 1 shared_informer.go:247] Caches are synced for ReplicaSet
I0920 18:28:36.106209 1 taint_manager.go:187] Starting NoExecuteTaintManager
I0920 18:28:36.106535 1 node_lifecycle_controller.go:1429] Initializing eviction metric for zone:
W0920 18:28:36.106952 1 node_lifecycle_controller.go:1044] Missing timestamp for Node old-k8s-version-475170. Assuming now as a timestamp.
I0920 18:28:36.107194 1 node_lifecycle_controller.go:1245] Controller detected that zone is now in state Normal.
I0920 18:28:36.106718 1 event.go:291] "Event occurred" object="old-k8s-version-475170" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node old-k8s-version-475170 event: Registered Node old-k8s-version-475170 in Controller"
I0920 18:28:36.111254 1 shared_informer.go:247] Caches are synced for job
I0920 18:28:36.120650 1 shared_informer.go:247] Caches are synced for GC
I0920 18:28:36.127108 1 shared_informer.go:247] Caches are synced for persistent volume
I0920 18:28:36.138695 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-54pl7"
I0920 18:28:36.171390 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-r9xl5"
I0920 18:28:36.172172 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-s7pqm"
I0920 18:28:36.172203 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-hc5pl"
I0920 18:28:36.313087 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0920 18:28:36.604921 1 shared_informer.go:247] Caches are synced for garbage collector
I0920 18:28:36.604949 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0920 18:28:36.613280 1 shared_informer.go:247] Caches are synced for garbage collector
I0920 18:28:36.751851 1 request.go:655] Throttling request took 1.037897608s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
I0920 18:28:37.553697 1 shared_informer.go:240] Waiting for caches to sync for resource quota
I0920 18:28:37.553766 1 shared_informer.go:247] Caches are synced for resource quota
I0920 18:28:37.662477 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0920 18:28:37.678379 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-54pl7"
I0920 18:30:38.742997 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
E0920 18:30:38.995719 1 clusterroleaggregation_controller.go:181] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
E0920 18:30:39.412499 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server could not find the requested resource
==> kube-proxy [101769e8441e423925facf5f93161549531fb8ea432669373cb403b040be6102] <==
I0920 18:31:20.023407 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0920 18:31:20.023597 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0920 18:31:20.068842 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0920 18:31:20.068940 1 server_others.go:185] Using iptables Proxier.
I0920 18:31:20.069152 1 server.go:650] Version: v1.20.0
I0920 18:31:20.069685 1 config.go:315] Starting service config controller
I0920 18:31:20.069700 1 shared_informer.go:240] Waiting for caches to sync for service config
I0920 18:31:20.071609 1 config.go:224] Starting endpoint slice config controller
I0920 18:31:20.071622 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0920 18:31:20.169861 1 shared_informer.go:247] Caches are synced for service config
I0920 18:31:20.172735 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-proxy [93d93c2e410820672b1234f1012c02eadac7b65e873d66423584e1bf387e045e] <==
I0920 18:28:37.108878 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0920 18:28:37.109008 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0920 18:28:37.140206 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0920 18:28:37.140308 1 server_others.go:185] Using iptables Proxier.
I0920 18:28:37.140524 1 server.go:650] Version: v1.20.0
I0920 18:28:37.141032 1 config.go:315] Starting service config controller
I0920 18:28:37.141051 1 shared_informer.go:240] Waiting for caches to sync for service config
I0920 18:28:37.142947 1 config.go:224] Starting endpoint slice config controller
I0920 18:28:37.142967 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0920 18:28:37.242390 1 shared_informer.go:247] Caches are synced for service config
I0920 18:28:37.246762 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-scheduler [186afb87158e29ba5b33e79e9d46317f8bf2277b41c9c1948bb4fe7bd52cb5ca] <==
I0920 18:31:12.507775 1 serving.go:331] Generated self-signed cert in-memory
W0920 18:31:17.188153 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0920 18:31:17.188192 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0920 18:31:17.188201 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0920 18:31:17.188213 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0920 18:31:17.540934 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0920 18:31:17.544450 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0920 18:31:17.544483 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0920 18:31:17.544502 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0920 18:31:17.744758 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [199b68be37f6dec0c3e145251b4cf0f7dc80451e8df9799cc519d5f26245c333] <==
W0920 18:28:17.241028 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0920 18:28:17.241155 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0920 18:28:17.241242 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0920 18:28:17.311291 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0920 18:28:17.314186 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0920 18:28:17.314446 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0920 18:28:17.314526 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
E0920 18:28:17.318158 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0920 18:28:17.318265 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0920 18:28:17.335629 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0920 18:28:17.335686 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0920 18:28:17.335776 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0920 18:28:17.336041 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0920 18:28:17.339198 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0920 18:28:17.339555 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0920 18:28:17.341646 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0920 18:28:17.341873 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0920 18:28:17.342037 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0920 18:28:17.342728 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0920 18:28:18.298174 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0920 18:28:18.298576 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0920 18:28:18.345455 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0920 18:28:18.373067 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0920 18:28:18.506008 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
I0920 18:28:21.714763 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Sep 20 18:35:34 old-k8s-version-475170 kubelet[662]: E0920 18:35:34.560606 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 20 18:35:37 old-k8s-version-475170 kubelet[662]: I0920 18:35:37.559965 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: ede576265552fc52c31896d621c5509c0d403980d968d25712de91548bd4cced
Sep 20 18:35:37 old-k8s-version-475170 kubelet[662]: E0920 18:35:37.560351 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
Sep 20 18:35:47 old-k8s-version-475170 kubelet[662]: E0920 18:35:47.560695 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 20 18:35:51 old-k8s-version-475170 kubelet[662]: I0920 18:35:51.559938 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: ede576265552fc52c31896d621c5509c0d403980d968d25712de91548bd4cced
Sep 20 18:35:51 old-k8s-version-475170 kubelet[662]: E0920 18:35:51.560316 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
Sep 20 18:36:00 old-k8s-version-475170 kubelet[662]: E0920 18:36:00.571086 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 20 18:36:06 old-k8s-version-475170 kubelet[662]: I0920 18:36:06.560029 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: ede576265552fc52c31896d621c5509c0d403980d968d25712de91548bd4cced
Sep 20 18:36:06 old-k8s-version-475170 kubelet[662]: E0920 18:36:06.560426 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
Sep 20 18:36:15 old-k8s-version-475170 kubelet[662]: E0920 18:36:15.560776 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 20 18:36:20 old-k8s-version-475170 kubelet[662]: I0920 18:36:20.564020 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: ede576265552fc52c31896d621c5509c0d403980d968d25712de91548bd4cced
Sep 20 18:36:20 old-k8s-version-475170 kubelet[662]: E0920 18:36:20.565096 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
Sep 20 18:36:28 old-k8s-version-475170 kubelet[662]: E0920 18:36:28.561796 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 20 18:36:31 old-k8s-version-475170 kubelet[662]: I0920 18:36:31.560135 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: ede576265552fc52c31896d621c5509c0d403980d968d25712de91548bd4cced
Sep 20 18:36:31 old-k8s-version-475170 kubelet[662]: E0920 18:36:31.560613 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
Sep 20 18:36:39 old-k8s-version-475170 kubelet[662]: E0920 18:36:39.560758 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 20 18:36:45 old-k8s-version-475170 kubelet[662]: I0920 18:36:45.560049 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: ede576265552fc52c31896d621c5509c0d403980d968d25712de91548bd4cced
Sep 20 18:36:45 old-k8s-version-475170 kubelet[662]: E0920 18:36:45.560462 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
Sep 20 18:36:50 old-k8s-version-475170 kubelet[662]: E0920 18:36:50.560674 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 20 18:36:58 old-k8s-version-475170 kubelet[662]: I0920 18:36:58.560287 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: ede576265552fc52c31896d621c5509c0d403980d968d25712de91548bd4cced
Sep 20 18:36:58 old-k8s-version-475170 kubelet[662]: E0920 18:36:58.560632 662 pod_workers.go:191] Error syncing pod 9896dc7c-456c-43f9-93c9-fd1c5545c9f5 ("dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pq4wb_kubernetes-dashboard(9896dc7c-456c-43f9-93c9-fd1c5545c9f5)"
Sep 20 18:37:01 old-k8s-version-475170 kubelet[662]: E0920 18:37:01.569163 662 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host
Sep 20 18:37:01 old-k8s-version-475170 kubelet[662]: E0920 18:37:01.569217 662 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host
Sep 20 18:37:01 old-k8s-version-475170 kubelet[662]: E0920 18:37:01.569360 662 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-ftv7g,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-2scnf_kube-system(e58bdba
3-1017-4138-8586-cd842ea4f482): ErrImagePull: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host
Sep 20 18:37:01 old-k8s-version-475170 kubelet[662]: E0920 18:37:01.569397 662 pod_workers.go:191] Error syncing pod e58bdba3-1017-4138-8586-cd842ea4f482 ("metrics-server-9975d5f86-2scnf_kube-system(e58bdba3-1017-4138-8586-cd842ea4f482)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
==> kubernetes-dashboard [b12b0d4c8fc78ca871279a8f41127290f53d614f970d7916b20ce43b14066509] <==
2024/09/20 18:31:39 Using namespace: kubernetes-dashboard
2024/09/20 18:31:39 Using in-cluster config to connect to apiserver
2024/09/20 18:31:39 Using secret token for csrf signing
2024/09/20 18:31:39 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/09/20 18:31:39 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/09/20 18:31:39 Successful initial request to the apiserver, version: v1.20.0
2024/09/20 18:31:39 Generating JWE encryption key
2024/09/20 18:31:39 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/09/20 18:31:39 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/09/20 18:31:40 Initializing JWE encryption key from synchronized object
2024/09/20 18:31:40 Creating in-cluster Sidecar client
2024/09/20 18:31:40 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/20 18:31:40 Serving insecurely on HTTP port: 9090
2024/09/20 18:32:10 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/20 18:32:40 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/20 18:33:10 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/20 18:33:40 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/20 18:34:10 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/20 18:34:40 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/20 18:35:10 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/20 18:35:40 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/20 18:36:10 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/20 18:36:40 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/20 18:31:39 Starting overwatch
==> storage-provisioner [9bc5c63f723351b1d6ef80d461357d2aa2f2e9617925dad553809fae62b51f84] <==
I0920 18:31:21.541580 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0920 18:31:21.556008 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0920 18:31:21.556083 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0920 18:31:39.040265 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0920 18:31:39.040715 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"6991ee8c-7691-472b-a374-c5e79023fe8b", APIVersion:"v1", ResourceVersion:"794", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-475170_ab8ef3ce-47a3-4b31-a7fb-46cdff7406d2 became leader
I0920 18:31:39.043260 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-475170_ab8ef3ce-47a3-4b31-a7fb-46cdff7406d2!
I0920 18:31:39.154254 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-475170_ab8ef3ce-47a3-4b31-a7fb-46cdff7406d2!
==> storage-provisioner [e126978f873c21258f64888c111ebc9d582eb0398c12b5d85458a1909b5cbe76] <==
I0920 18:28:38.230255 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0920 18:28:38.247294 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0920 18:28:38.247353 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0920 18:28:38.265757 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0920 18:28:38.268349 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"6991ee8c-7691-472b-a374-c5e79023fe8b", APIVersion:"v1", ResourceVersion:"467", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-475170_af4bb4dc-bf17-4283-984a-22a078c5e848 became leader
I0920 18:28:38.268567 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-475170_af4bb4dc-bf17-4283-984a-22a078c5e848!
I0920 18:28:38.369624 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-475170_af4bb4dc-bf17-4283-984a-22a078c5e848!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-475170 -n old-k8s-version-475170
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-475170 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-2scnf
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-475170 describe pod metrics-server-9975d5f86-2scnf
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-475170 describe pod metrics-server-9975d5f86-2scnf: exit status 1 (110.481729ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-2scnf" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-475170 describe pod metrics-server-9975d5f86-2scnf: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (374.59s)