=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-914579 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
E0819 13:47:06.531049 4146547 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19479-4141166/.minikube/profiles/functional-893834/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-914579 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m18.228747s)
-- stdout --
* [old-k8s-version-914579] minikube v1.33.1 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=19479
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19479-4141166/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19479-4141166/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.31.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.0
* Using the docker driver based on existing profile
* Starting "old-k8s-version-914579" primary control-plane node in "old-k8s-version-914579" cluster
* Pulling base image v0.0.44-1723740748-19452 ...
* Restarting existing docker container for "old-k8s-version-914579" ...
* Preparing Kubernetes v1.20.0 on containerd 1.7.20 ...
* Verifying Kubernetes components...
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-914579 addons enable metrics-server
* Enabled addons: storage-provisioner, metrics-server, dashboard, default-storageclass
-- /stdout --
** stderr **
I0819 13:46:40.892354 152452 out.go:345] Setting OutFile to fd 1 ...
I0819 13:46:40.892545 152452 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0819 13:46:40.892583 152452 out.go:358] Setting ErrFile to fd 2...
I0819 13:46:40.892603 152452 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0819 13:46:40.892927 152452 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19479-4141166/.minikube/bin
I0819 13:46:40.897483 152452 out.go:352] Setting JSON to false
I0819 13:46:40.898485 152452 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":98945,"bootTime":1723976256,"procs":176,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1067-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
I0819 13:46:40.898596 152452 start.go:139] virtualization:
I0819 13:46:40.901699 152452 out.go:177] * [old-k8s-version-914579] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0819 13:46:40.906515 152452 notify.go:220] Checking for updates...
I0819 13:46:40.911367 152452 out.go:177] - MINIKUBE_LOCATION=19479
I0819 13:46:40.913975 152452 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0819 13:46:40.916850 152452 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19479-4141166/kubeconfig
I0819 13:46:40.919594 152452 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19479-4141166/.minikube
I0819 13:46:40.922283 152452 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0819 13:46:40.925056 152452 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0819 13:46:40.928187 152452 config.go:182] Loaded profile config "old-k8s-version-914579": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0819 13:46:40.931412 152452 out.go:177] * Kubernetes 1.31.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.0
I0819 13:46:40.933919 152452 driver.go:392] Setting default libvirt URI to qemu:///system
I0819 13:46:40.997210 152452 docker.go:123] docker version: linux-27.1.2:Docker Engine - Community
I0819 13:46:40.997343 152452 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0819 13:46:41.093936 152452 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:33 OomKillDisable:true NGoroutines:42 SystemTime:2024-08-19 13:46:41.082506201 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1067-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.1.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0819 13:46:41.094072 152452 docker.go:307] overlay module found
I0819 13:46:41.096965 152452 out.go:177] * Using the docker driver based on existing profile
I0819 13:46:41.099485 152452 start.go:297] selected driver: docker
I0819 13:46:41.099503 152452 start.go:901] validating driver "docker" against &{Name:old-k8s-version-914579 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-914579 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0819 13:46:41.099618 152452 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0819 13:46:41.100290 152452 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0819 13:46:41.188961 152452 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:41 OomKillDisable:true NGoroutines:50 SystemTime:2024-08-19 13:46:41.175022168 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1067-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.1.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0819 13:46:41.189313 152452 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0819 13:46:41.189341 152452 cni.go:84] Creating CNI manager for ""
I0819 13:46:41.189358 152452 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0819 13:46:41.189407 152452 start.go:340] cluster config:
{Name:old-k8s-version-914579 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-914579 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0819 13:46:41.192744 152452 out.go:177] * Starting "old-k8s-version-914579" primary control-plane node in "old-k8s-version-914579" cluster
I0819 13:46:41.195625 152452 cache.go:121] Beginning downloading kic base image for docker with containerd
I0819 13:46:41.198415 152452 out.go:177] * Pulling base image v0.0.44-1723740748-19452 ...
I0819 13:46:41.201303 152452 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d in local docker daemon
I0819 13:46:41.201269 152452 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0819 13:46:41.201392 152452 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19479-4141166/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0819 13:46:41.201405 152452 cache.go:56] Caching tarball of preloaded images
I0819 13:46:41.201500 152452 preload.go:172] Found /home/jenkins/minikube-integration/19479-4141166/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0819 13:46:41.201508 152452 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0819 13:46:41.201658 152452 profile.go:143] Saving config to /home/jenkins/minikube-integration/19479-4141166/.minikube/profiles/old-k8s-version-914579/config.json ...
W0819 13:46:41.221918 152452 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d is of wrong architecture
I0819 13:46:41.221937 152452 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d to local cache
I0819 13:46:41.222008 152452 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d in local cache directory
I0819 13:46:41.222026 152452 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d in local cache directory, skipping pull
I0819 13:46:41.222030 152452 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d exists in cache, skipping pull
I0819 13:46:41.222046 152452 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d as a tarball
I0819 13:46:41.222052 152452 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d from local cache
I0819 13:46:41.355829 152452 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d from cached tarball
I0819 13:46:41.355883 152452 cache.go:194] Successfully downloaded all kic artifacts
I0819 13:46:41.355923 152452 start.go:360] acquireMachinesLock for old-k8s-version-914579: {Name:mk367928ac150aa926e220ad9d9371371d785260 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0819 13:46:41.355992 152452 start.go:364] duration metric: took 40.82µs to acquireMachinesLock for "old-k8s-version-914579"
I0819 13:46:41.356132 152452 start.go:96] Skipping create...Using existing machine configuration
I0819 13:46:41.356147 152452 fix.go:54] fixHost starting:
I0819 13:46:41.357427 152452 cli_runner.go:164] Run: docker container inspect old-k8s-version-914579 --format={{.State.Status}}
I0819 13:46:41.379198 152452 fix.go:112] recreateIfNeeded on old-k8s-version-914579: state=Stopped err=<nil>
W0819 13:46:41.379227 152452 fix.go:138] unexpected machine state, will restart: <nil>
I0819 13:46:41.384660 152452 out.go:177] * Restarting existing docker container for "old-k8s-version-914579" ...
I0819 13:46:41.387312 152452 cli_runner.go:164] Run: docker start old-k8s-version-914579
I0819 13:46:41.875097 152452 cli_runner.go:164] Run: docker container inspect old-k8s-version-914579 --format={{.State.Status}}
I0819 13:46:41.968483 152452 kic.go:430] container "old-k8s-version-914579" state is running.
I0819 13:46:41.968927 152452 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-914579
I0819 13:46:41.999862 152452 profile.go:143] Saving config to /home/jenkins/minikube-integration/19479-4141166/.minikube/profiles/old-k8s-version-914579/config.json ...
I0819 13:46:42.002467 152452 machine.go:93] provisionDockerMachine start ...
I0819 13:46:42.002584 152452 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-914579
I0819 13:46:42.060099 152452 main.go:141] libmachine: Using SSH client type: native
I0819 13:46:42.060376 152452 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 38550 <nil> <nil>}
I0819 13:46:42.060384 152452 main.go:141] libmachine: About to run SSH command:
hostname
I0819 13:46:42.064799 152452 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:44140->127.0.0.1:38550: read: connection reset by peer
I0819 13:46:45.378720 152452 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-914579
I0819 13:46:45.378903 152452 ubuntu.go:169] provisioning hostname "old-k8s-version-914579"
I0819 13:46:45.379278 152452 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-914579
I0819 13:46:45.413595 152452 main.go:141] libmachine: Using SSH client type: native
I0819 13:46:45.413849 152452 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 38550 <nil> <nil>}
I0819 13:46:45.413872 152452 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-914579 && echo "old-k8s-version-914579" | sudo tee /etc/hostname
I0819 13:46:45.576557 152452 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-914579
I0819 13:46:45.576639 152452 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-914579
I0819 13:46:45.599738 152452 main.go:141] libmachine: Using SSH client type: native
I0819 13:46:45.600106 152452 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 38550 <nil> <nil>}
I0819 13:46:45.600128 152452 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-914579' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-914579/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-914579' | sudo tee -a /etc/hosts;
fi
fi
I0819 13:46:45.744241 152452 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0819 13:46:45.744268 152452 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19479-4141166/.minikube CaCertPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19479-4141166/.minikube}
I0819 13:46:45.744294 152452 ubuntu.go:177] setting up certificates
I0819 13:46:45.744305 152452 provision.go:84] configureAuth start
I0819 13:46:45.744377 152452 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-914579
I0819 13:46:45.761678 152452 provision.go:143] copyHostCerts
I0819 13:46:45.761755 152452 exec_runner.go:144] found /home/jenkins/minikube-integration/19479-4141166/.minikube/ca.pem, removing ...
I0819 13:46:45.761771 152452 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19479-4141166/.minikube/ca.pem
I0819 13:46:45.761830 152452 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19479-4141166/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19479-4141166/.minikube/ca.pem (1082 bytes)
I0819 13:46:45.761936 152452 exec_runner.go:144] found /home/jenkins/minikube-integration/19479-4141166/.minikube/cert.pem, removing ...
I0819 13:46:45.761947 152452 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19479-4141166/.minikube/cert.pem
I0819 13:46:45.761971 152452 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19479-4141166/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19479-4141166/.minikube/cert.pem (1123 bytes)
I0819 13:46:45.762065 152452 exec_runner.go:144] found /home/jenkins/minikube-integration/19479-4141166/.minikube/key.pem, removing ...
I0819 13:46:45.762076 152452 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19479-4141166/.minikube/key.pem
I0819 13:46:45.762102 152452 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19479-4141166/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19479-4141166/.minikube/key.pem (1675 bytes)
I0819 13:46:45.762161 152452 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19479-4141166/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19479-4141166/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19479-4141166/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-914579 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-914579]
I0819 13:46:46.230887 152452 provision.go:177] copyRemoteCerts
I0819 13:46:46.235000 152452 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0819 13:46:46.235106 152452 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-914579
I0819 13:46:46.278176 152452 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38550 SSHKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/machines/old-k8s-version-914579/id_rsa Username:docker}
I0819 13:46:46.376807 152452 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0819 13:46:46.404044 152452 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0819 13:46:46.433649 152452 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0819 13:46:46.461816 152452 provision.go:87] duration metric: took 717.483848ms to configureAuth
I0819 13:46:46.461893 152452 ubuntu.go:193] setting minikube options for container-runtime
I0819 13:46:46.462169 152452 config.go:182] Loaded profile config "old-k8s-version-914579": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0819 13:46:46.462205 152452 machine.go:96] duration metric: took 4.459704503s to provisionDockerMachine
I0819 13:46:46.462236 152452 start.go:293] postStartSetup for "old-k8s-version-914579" (driver="docker")
I0819 13:46:46.462264 152452 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0819 13:46:46.462356 152452 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0819 13:46:46.462432 152452 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-914579
I0819 13:46:46.479864 152452 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38550 SSHKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/machines/old-k8s-version-914579/id_rsa Username:docker}
I0819 13:46:46.582609 152452 ssh_runner.go:195] Run: cat /etc/os-release
I0819 13:46:46.586818 152452 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0819 13:46:46.586856 152452 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0819 13:46:46.586871 152452 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0819 13:46:46.586886 152452 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0819 13:46:46.586900 152452 filesync.go:126] Scanning /home/jenkins/minikube-integration/19479-4141166/.minikube/addons for local assets ...
I0819 13:46:46.586952 152452 filesync.go:126] Scanning /home/jenkins/minikube-integration/19479-4141166/.minikube/files for local assets ...
I0819 13:46:46.587101 152452 filesync.go:149] local asset: /home/jenkins/minikube-integration/19479-4141166/.minikube/files/etc/ssl/certs/41465472.pem -> 41465472.pem in /etc/ssl/certs
I0819 13:46:46.587232 152452 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0819 13:46:46.597655 152452 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/files/etc/ssl/certs/41465472.pem --> /etc/ssl/certs/41465472.pem (1708 bytes)
I0819 13:46:46.627824 152452 start.go:296] duration metric: took 165.556155ms for postStartSetup
I0819 13:46:46.627909 152452 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0819 13:46:46.627969 152452 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-914579
I0819 13:46:46.649373 152452 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38550 SSHKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/machines/old-k8s-version-914579/id_rsa Username:docker}
I0819 13:46:46.740951 152452 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0819 13:46:46.747773 152452 fix.go:56] duration metric: took 5.391618114s for fixHost
I0819 13:46:46.747813 152452 start.go:83] releasing machines lock for "old-k8s-version-914579", held for 5.391807051s
I0819 13:46:46.747888 152452 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-914579
I0819 13:46:46.775858 152452 ssh_runner.go:195] Run: cat /version.json
I0819 13:46:46.775921 152452 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-914579
I0819 13:46:46.776151 152452 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0819 13:46:46.776219 152452 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-914579
I0819 13:46:46.810149 152452 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38550 SSHKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/machines/old-k8s-version-914579/id_rsa Username:docker}
I0819 13:46:46.811153 152452 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38550 SSHKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/machines/old-k8s-version-914579/id_rsa Username:docker}
I0819 13:46:47.055240 152452 ssh_runner.go:195] Run: systemctl --version
I0819 13:46:47.060619 152452 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0819 13:46:47.065474 152452 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0819 13:46:47.099399 152452 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0819 13:46:47.099532 152452 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0819 13:46:47.110067 152452 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0819 13:46:47.110133 152452 start.go:495] detecting cgroup driver to use...
I0819 13:46:47.110180 152452 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0819 13:46:47.110255 152452 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0819 13:46:47.126048 152452 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0819 13:46:47.140183 152452 docker.go:217] disabling cri-docker service (if available) ...
I0819 13:46:47.140290 152452 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0819 13:46:47.155158 152452 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0819 13:46:47.170766 152452 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0819 13:46:47.282731 152452 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0819 13:46:47.415767 152452 docker.go:233] disabling docker service ...
I0819 13:46:47.415880 152452 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0819 13:46:47.434898 152452 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0819 13:46:47.447804 152452 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0819 13:46:47.562347 152452 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0819 13:46:47.693462 152452 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0819 13:46:47.706299 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0819 13:46:47.724093 152452 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0819 13:46:47.733962 152452 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0819 13:46:47.745107 152452 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0819 13:46:47.745225 152452 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0819 13:46:47.755613 152452 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0819 13:46:47.766871 152452 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0819 13:46:47.783658 152452 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0819 13:46:47.799205 152452 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0819 13:46:47.811985 152452 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0819 13:46:47.823085 152452 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0819 13:46:47.833806 152452 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0819 13:46:47.843068 152452 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0819 13:46:47.931388 152452 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0819 13:46:48.110290 152452 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0819 13:46:48.110403 152452 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0819 13:46:48.115593 152452 start.go:563] Will wait 60s for crictl version
I0819 13:46:48.115673 152452 ssh_runner.go:195] Run: which crictl
I0819 13:46:48.121294 152452 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0819 13:46:48.163159 152452 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.20
RuntimeApiVersion: v1
I0819 13:46:48.163235 152452 ssh_runner.go:195] Run: containerd --version
I0819 13:46:48.191654 152452 ssh_runner.go:195] Run: containerd --version
I0819 13:46:48.218563 152452 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.7.20 ...
I0819 13:46:48.221287 152452 cli_runner.go:164] Run: docker network inspect old-k8s-version-914579 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0819 13:46:48.236066 152452 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0819 13:46:48.240194 152452 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0819 13:46:48.254378 152452 kubeadm.go:883] updating cluster {Name:old-k8s-version-914579 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-914579 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0819 13:46:48.254503 152452 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0819 13:46:48.254567 152452 ssh_runner.go:195] Run: sudo crictl images --output json
I0819 13:46:48.308539 152452 containerd.go:627] all images are preloaded for containerd runtime.
I0819 13:46:48.308562 152452 containerd.go:534] Images already preloaded, skipping extraction
I0819 13:46:48.308623 152452 ssh_runner.go:195] Run: sudo crictl images --output json
I0819 13:46:48.375472 152452 containerd.go:627] all images are preloaded for containerd runtime.
I0819 13:46:48.375495 152452 cache_images.go:84] Images are preloaded, skipping loading
I0819 13:46:48.375504 152452 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.20.0 containerd true true} ...
I0819 13:46:48.375630 152452 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-914579 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-914579 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0819 13:46:48.375701 152452 ssh_runner.go:195] Run: sudo crictl info
I0819 13:46:48.454002 152452 cni.go:84] Creating CNI manager for ""
I0819 13:46:48.454107 152452 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0819 13:46:48.454141 152452 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0819 13:46:48.454197 152452 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-914579 NodeName:old-k8s-version-914579 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0819 13:46:48.454358 152452 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-914579"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0819 13:46:48.454491 152452 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0819 13:46:48.465163 152452 binaries.go:44] Found k8s binaries, skipping transfer
I0819 13:46:48.465229 152452 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0819 13:46:48.477707 152452 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0819 13:46:48.500922 152452 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0819 13:46:48.524948 152452 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0819 13:46:48.548898 152452 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0819 13:46:48.552779 152452 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0819 13:46:48.568053 152452 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0819 13:46:48.704117 152452 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0819 13:46:48.725172 152452 certs.go:68] Setting up /home/jenkins/minikube-integration/19479-4141166/.minikube/profiles/old-k8s-version-914579 for IP: 192.168.76.2
I0819 13:46:48.725245 152452 certs.go:194] generating shared ca certs ...
I0819 13:46:48.725279 152452 certs.go:226] acquiring lock for ca certs: {Name:mkb3362db9c120e28de14409a94f066387768cf1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 13:46:48.725489 152452 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19479-4141166/.minikube/ca.key
I0819 13:46:48.725562 152452 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19479-4141166/.minikube/proxy-client-ca.key
I0819 13:46:48.725601 152452 certs.go:256] generating profile certs ...
I0819 13:46:48.725735 152452 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19479-4141166/.minikube/profiles/old-k8s-version-914579/client.key
I0819 13:46:48.725850 152452 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19479-4141166/.minikube/profiles/old-k8s-version-914579/apiserver.key.263f292e
I0819 13:46:48.725922 152452 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19479-4141166/.minikube/profiles/old-k8s-version-914579/proxy-client.key
I0819 13:46:48.726090 152452 certs.go:484] found cert: /home/jenkins/minikube-integration/19479-4141166/.minikube/certs/4146547.pem (1338 bytes)
W0819 13:46:48.726148 152452 certs.go:480] ignoring /home/jenkins/minikube-integration/19479-4141166/.minikube/certs/4146547_empty.pem, impossibly tiny 0 bytes
I0819 13:46:48.726174 152452 certs.go:484] found cert: /home/jenkins/minikube-integration/19479-4141166/.minikube/certs/ca-key.pem (1675 bytes)
I0819 13:46:48.726232 152452 certs.go:484] found cert: /home/jenkins/minikube-integration/19479-4141166/.minikube/certs/ca.pem (1082 bytes)
I0819 13:46:48.726292 152452 certs.go:484] found cert: /home/jenkins/minikube-integration/19479-4141166/.minikube/certs/cert.pem (1123 bytes)
I0819 13:46:48.726355 152452 certs.go:484] found cert: /home/jenkins/minikube-integration/19479-4141166/.minikube/certs/key.pem (1675 bytes)
I0819 13:46:48.726430 152452 certs.go:484] found cert: /home/jenkins/minikube-integration/19479-4141166/.minikube/files/etc/ssl/certs/41465472.pem (1708 bytes)
I0819 13:46:48.727180 152452 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0819 13:46:48.783217 152452 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0819 13:46:48.813898 152452 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0819 13:46:48.856331 152452 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0819 13:46:48.886609 152452 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/profiles/old-k8s-version-914579/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0819 13:46:48.914915 152452 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/profiles/old-k8s-version-914579/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0819 13:46:48.964774 152452 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/profiles/old-k8s-version-914579/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0819 13:46:49.035648 152452 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/profiles/old-k8s-version-914579/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0819 13:46:49.082769 152452 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0819 13:46:49.119835 152452 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/certs/4146547.pem --> /usr/share/ca-certificates/4146547.pem (1338 bytes)
I0819 13:46:49.172345 152452 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/files/etc/ssl/certs/41465472.pem --> /usr/share/ca-certificates/41465472.pem (1708 bytes)
I0819 13:46:49.214561 152452 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0819 13:46:49.242644 152452 ssh_runner.go:195] Run: openssl version
I0819 13:46:49.250866 152452 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0819 13:46:49.264124 152452 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0819 13:46:49.268858 152452 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 19 12:56 /usr/share/ca-certificates/minikubeCA.pem
I0819 13:46:49.268938 152452 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0819 13:46:49.281042 152452 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0819 13:46:49.294313 152452 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/4146547.pem && ln -fs /usr/share/ca-certificates/4146547.pem /etc/ssl/certs/4146547.pem"
I0819 13:46:49.307134 152452 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/4146547.pem
I0819 13:46:49.313606 152452 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 19 13:06 /usr/share/ca-certificates/4146547.pem
I0819 13:46:49.313700 152452 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/4146547.pem
I0819 13:46:49.322756 152452 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/4146547.pem /etc/ssl/certs/51391683.0"
I0819 13:46:49.337035 152452 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/41465472.pem && ln -fs /usr/share/ca-certificates/41465472.pem /etc/ssl/certs/41465472.pem"
I0819 13:46:49.347749 152452 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/41465472.pem
I0819 13:46:49.356436 152452 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 19 13:06 /usr/share/ca-certificates/41465472.pem
I0819 13:46:49.356516 152452 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/41465472.pem
I0819 13:46:49.367928 152452 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/41465472.pem /etc/ssl/certs/3ec20f2e.0"
I0819 13:46:49.380946 152452 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0819 13:46:49.385173 152452 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0819 13:46:49.397839 152452 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0819 13:46:49.408730 152452 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0819 13:46:49.418613 152452 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0819 13:46:49.426194 152452 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0819 13:46:49.435203 152452 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0819 13:46:49.445901 152452 kubeadm.go:392] StartCluster: {Name:old-k8s-version-914579 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-914579 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0819 13:46:49.446040 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0819 13:46:49.446125 152452 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0819 13:46:49.513627 152452 cri.go:89] found id: "8344283822b374d886d00d290f18631a7790271c48c1d318d5b00a1cf12609a5"
I0819 13:46:49.513706 152452 cri.go:89] found id: "765975197bf640c76b530d4282ed5d13d03238e0ae93cd4aca67241e2f5152e9"
I0819 13:46:49.513725 152452 cri.go:89] found id: "93226e5eab87c1b6743b4914b71dcda693967856ed7ea4dba4f9cd99c76340ac"
I0819 13:46:49.513748 152452 cri.go:89] found id: "d8e9102405c0bfd7286b17e5f2348226ea534b03ab646ed8bc5c514f697bdd28"
I0819 13:46:49.513781 152452 cri.go:89] found id: "ff300c34901ca29544018036fcfb1d22bafcc0bace0dcf64fe0bd253b66ef58e"
I0819 13:46:49.513806 152452 cri.go:89] found id: "c2b76e34da1effdab4751291934d76bf6fae4d64b9a57c2e308028866ca67cc7"
I0819 13:46:49.513828 152452 cri.go:89] found id: "fcd65a8439964dae437d73a25791d2c38189fd5f9e340dc4e33ca0cc390524ef"
I0819 13:46:49.513853 152452 cri.go:89] found id: "6c7959865023d5c1d31e7b8c33d4dca318c0b748bfd18163a76a3658248a339d"
I0819 13:46:49.513886 152452 cri.go:89] found id: ""
I0819 13:46:49.513967 152452 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0819 13:46:49.531615 152452 cri.go:116] JSON = null
W0819 13:46:49.531721 152452 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0819 13:46:49.531931 152452 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0819 13:46:49.542453 152452 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0819 13:46:49.542519 152452 kubeadm.go:593] restartPrimaryControlPlane start ...
I0819 13:46:49.542605 152452 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0819 13:46:49.552038 152452 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0819 13:46:49.552622 152452 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-914579" does not appear in /home/jenkins/minikube-integration/19479-4141166/kubeconfig
I0819 13:46:49.552801 152452 kubeconfig.go:62] /home/jenkins/minikube-integration/19479-4141166/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-914579" cluster setting kubeconfig missing "old-k8s-version-914579" context setting]
I0819 13:46:49.553174 152452 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19479-4141166/kubeconfig: {Name:mk7b0eea2060f71726f692d0256a33fdf7565e94 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 13:46:49.554746 152452 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0819 13:46:49.569391 152452 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.76.2
I0819 13:46:49.569471 152452 kubeadm.go:597] duration metric: took 26.93265ms to restartPrimaryControlPlane
I0819 13:46:49.569497 152452 kubeadm.go:394] duration metric: took 123.607695ms to StartCluster
I0819 13:46:49.569541 152452 settings.go:142] acquiring lock: {Name:mkaa4019b166703efd95aaa3737397f414197f00 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 13:46:49.569627 152452 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19479-4141166/kubeconfig
I0819 13:46:49.570312 152452 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19479-4141166/kubeconfig: {Name:mk7b0eea2060f71726f692d0256a33fdf7565e94 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 13:46:49.570622 152452 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0819 13:46:49.570989 152452 config.go:182] Loaded profile config "old-k8s-version-914579": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0819 13:46:49.571147 152452 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0819 13:46:49.571323 152452 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-914579"
I0819 13:46:49.571554 152452 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-914579"
W0819 13:46:49.571600 152452 addons.go:243] addon storage-provisioner should already be in state true
I0819 13:46:49.571558 152452 addons.go:69] Setting dashboard=true in profile "old-k8s-version-914579"
I0819 13:46:49.571662 152452 addons.go:234] Setting addon dashboard=true in "old-k8s-version-914579"
W0819 13:46:49.571674 152452 addons.go:243] addon dashboard should already be in state true
I0819 13:46:49.571698 152452 host.go:66] Checking if "old-k8s-version-914579" exists ...
I0819 13:46:49.571708 152452 host.go:66] Checking if "old-k8s-version-914579" exists ...
I0819 13:46:49.572291 152452 cli_runner.go:164] Run: docker container inspect old-k8s-version-914579 --format={{.State.Status}}
I0819 13:46:49.572532 152452 cli_runner.go:164] Run: docker container inspect old-k8s-version-914579 --format={{.State.Status}}
I0819 13:46:49.571574 152452 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-914579"
I0819 13:46:49.572857 152452 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-914579"
W0819 13:46:49.572908 152452 addons.go:243] addon metrics-server should already be in state true
I0819 13:46:49.572939 152452 host.go:66] Checking if "old-k8s-version-914579" exists ...
I0819 13:46:49.573377 152452 cli_runner.go:164] Run: docker container inspect old-k8s-version-914579 --format={{.State.Status}}
I0819 13:46:49.571569 152452 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-914579"
I0819 13:46:49.573942 152452 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-914579"
I0819 13:46:49.574253 152452 cli_runner.go:164] Run: docker container inspect old-k8s-version-914579 --format={{.State.Status}}
I0819 13:46:49.583745 152452 out.go:177] * Verifying Kubernetes components...
I0819 13:46:49.586822 152452 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0819 13:46:49.630859 152452 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0819 13:46:49.637847 152452 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0819 13:46:49.640535 152452 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0819 13:46:49.640565 152452 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0819 13:46:49.640651 152452 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-914579
I0819 13:46:49.661987 152452 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0819 13:46:49.662315 152452 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-914579"
W0819 13:46:49.662329 152452 addons.go:243] addon default-storageclass should already be in state true
I0819 13:46:49.662355 152452 host.go:66] Checking if "old-k8s-version-914579" exists ...
I0819 13:46:49.662781 152452 cli_runner.go:164] Run: docker container inspect old-k8s-version-914579 --format={{.State.Status}}
I0819 13:46:49.667873 152452 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0819 13:46:49.667903 152452 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0819 13:46:49.667984 152452 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-914579
I0819 13:46:49.687921 152452 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0819 13:46:49.690685 152452 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0819 13:46:49.690715 152452 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0819 13:46:49.690805 152452 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-914579
I0819 13:46:49.704657 152452 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0819 13:46:49.704680 152452 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0819 13:46:49.704742 152452 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-914579
I0819 13:46:49.759968 152452 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38550 SSHKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/machines/old-k8s-version-914579/id_rsa Username:docker}
I0819 13:46:49.761250 152452 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38550 SSHKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/machines/old-k8s-version-914579/id_rsa Username:docker}
I0819 13:46:49.783569 152452 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38550 SSHKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/machines/old-k8s-version-914579/id_rsa Username:docker}
I0819 13:46:49.784326 152452 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38550 SSHKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/machines/old-k8s-version-914579/id_rsa Username:docker}
I0819 13:46:49.864751 152452 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0819 13:46:49.928269 152452 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-914579" to be "Ready" ...
I0819 13:46:49.976451 152452 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0819 13:46:49.976628 152452 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0819 13:46:50.030842 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0819 13:46:50.049612 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0819 13:46:50.060847 152452 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0819 13:46:50.060924 152452 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0819 13:46:50.081563 152452 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0819 13:46:50.081644 152452 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0819 13:46:50.147968 152452 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0819 13:46:50.148046 152452 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0819 13:46:50.215879 152452 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0819 13:46:50.215954 152452 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0819 13:46:50.263086 152452 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0819 13:46:50.263165 152452 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0819 13:46:50.361252 152452 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0819 13:46:50.361347 152452 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0819 13:46:50.386496 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0819 13:46:50.522223 152452 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0819 13:46:50.522245 152452 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
W0819 13:46:50.542563 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:50.542595 152452 retry.go:31] will retry after 305.889128ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0819 13:46:50.542629 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:50.542638 152452 retry.go:31] will retry after 193.605989ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:50.594991 152452 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0819 13:46:50.595019 152452 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
W0819 13:46:50.690735 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:50.690764 152452 retry.go:31] will retry after 359.345218ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:50.698981 152452 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0819 13:46:50.699006 152452 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0819 13:46:50.725448 152452 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0819 13:46:50.725470 152452 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0819 13:46:50.736812 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0819 13:46:50.759892 152452 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0819 13:46:50.759914 152452 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0819 13:46:50.819824 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0819 13:46:50.848989 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0819 13:46:51.028571 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:51.028602 152452 retry.go:31] will retry after 410.691713ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:51.050890 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0819 13:46:51.173982 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:51.174015 152452 retry.go:31] will retry after 344.425642ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0819 13:46:51.223765 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:51.223843 152452 retry.go:31] will retry after 193.145682ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0819 13:46:51.367934 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:51.367967 152452 retry.go:31] will retry after 227.843924ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:51.417173 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0819 13:46:51.439912 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0819 13:46:51.519415 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0819 13:46:51.596505 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0819 13:46:51.703592 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:51.703623 152452 retry.go:31] will retry after 681.284661ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0819 13:46:51.703656 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:51.703664 152452 retry.go:31] will retry after 645.182918ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0819 13:46:51.820838 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:51.820873 152452 retry.go:31] will retry after 193.798349ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0819 13:46:51.820921 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:51.820933 152452 retry.go:31] will retry after 636.752008ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:51.929600 152452 node_ready.go:53] error getting node "old-k8s-version-914579": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-914579": dial tcp 192.168.76.2:8443: connect: connection refused
I0819 13:46:52.014930 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0819 13:46:52.120444 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:52.120497 152452 retry.go:31] will retry after 640.146917ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:52.349917 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0819 13:46:52.385404 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0819 13:46:52.458426 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0819 13:46:52.521928 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:52.521989 152452 retry.go:31] will retry after 1.007422691s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0819 13:46:52.531994 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:52.532026 152452 retry.go:31] will retry after 1.080401041s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0819 13:46:52.611283 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:52.611313 152452 retry.go:31] will retry after 984.017631ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:52.761687 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0819 13:46:52.848922 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:52.848951 152452 retry.go:31] will retry after 807.826263ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:53.530586 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0819 13:46:53.595903 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0819 13:46:53.613172 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0819 13:46:53.649424 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:53.649459 152452 retry.go:31] will retry after 957.402629ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:53.657783 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0819 13:46:53.823990 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:53.824026 152452 retry.go:31] will retry after 714.256418ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0819 13:46:53.841304 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:53.841345 152452 retry.go:31] will retry after 1.585998141s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0819 13:46:53.841386 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:53.841399 152452 retry.go:31] will retry after 1.643077205s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:54.429665 152452 node_ready.go:53] error getting node "old-k8s-version-914579": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-914579": dial tcp 192.168.76.2:8443: connect: connection refused
I0819 13:46:54.538828 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0819 13:46:54.607265 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0819 13:46:54.671435 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:54.671480 152452 retry.go:31] will retry after 2.449668237s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0819 13:46:54.728759 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:54.728813 152452 retry.go:31] will retry after 1.776198385s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:55.427991 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0819 13:46:55.485556 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0819 13:46:55.519744 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:55.519859 152452 retry.go:31] will retry after 1.166136875s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0819 13:46:55.614837 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:55.614912 152452 retry.go:31] will retry after 1.810440222s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:56.506131 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0819 13:46:56.615493 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:56.615574 152452 retry.go:31] will retry after 2.393632434s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:56.686915 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0819 13:46:56.792175 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:56.792255 152452 retry.go:31] will retry after 1.591780893s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:56.929796 152452 node_ready.go:53] error getting node "old-k8s-version-914579": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-914579": dial tcp 192.168.76.2:8443: connect: connection refused
I0819 13:46:57.122077 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0819 13:46:57.221046 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:57.221127 152452 retry.go:31] will retry after 3.519218405s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:57.426391 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0819 13:46:57.548336 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:57.548365 152452 retry.go:31] will retry after 3.067290425s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:58.384306 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0819 13:46:58.681702 152452 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:58.681748 152452 retry.go:31] will retry after 2.346030581s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0819 13:46:59.009844 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0819 13:47:00.616809 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0819 13:47:00.741113 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0819 13:47:01.028760 152452 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0819 13:47:08.675291 152452 node_ready.go:49] node "old-k8s-version-914579" has status "Ready":"True"
I0819 13:47:08.675315 152452 node_ready.go:38] duration metric: took 18.746964094s for node "old-k8s-version-914579" to be "Ready" ...
I0819 13:47:08.675325 152452 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0819 13:47:08.900971 152452 pod_ready.go:79] waiting up to 6m0s for pod "coredns-74ff55c5b-8qwdj" in "kube-system" namespace to be "Ready" ...
I0819 13:47:09.270141 152452 pod_ready.go:93] pod "coredns-74ff55c5b-8qwdj" in "kube-system" namespace has status "Ready":"True"
I0819 13:47:09.270167 152452 pod_ready.go:82] duration metric: took 369.119832ms for pod "coredns-74ff55c5b-8qwdj" in "kube-system" namespace to be "Ready" ...
I0819 13:47:09.270179 152452 pod_ready.go:79] waiting up to 6m0s for pod "etcd-old-k8s-version-914579" in "kube-system" namespace to be "Ready" ...
I0819 13:47:09.345675 152452 pod_ready.go:93] pod "etcd-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"True"
I0819 13:47:09.345745 152452 pod_ready.go:82] duration metric: took 75.557542ms for pod "etcd-old-k8s-version-914579" in "kube-system" namespace to be "Ready" ...
I0819 13:47:09.345776 152452 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-914579" in "kube-system" namespace to be "Ready" ...
I0819 13:47:09.409874 152452 pod_ready.go:93] pod "kube-apiserver-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"True"
I0819 13:47:09.409940 152452 pod_ready.go:82] duration metric: took 64.142073ms for pod "kube-apiserver-old-k8s-version-914579" in "kube-system" namespace to be "Ready" ...
I0819 13:47:09.409967 152452 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace to be "Ready" ...
I0819 13:47:11.241034 152452 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (12.231145825s)
I0819 13:47:11.428491 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:47:11.610086 152452 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (10.993214369s)
I0819 13:47:11.610356 152452 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (10.581569563s)
I0819 13:47:11.610549 152452 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (10.869181403s)
I0819 13:47:11.610582 152452 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-914579"
I0819 13:47:11.612939 152452 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-914579 addons enable metrics-server
I0819 13:47:11.629306 152452 out.go:177] * Enabled addons: storage-provisioner, metrics-server, dashboard, default-storageclass
I0819 13:47:11.632221 152452 addons.go:510] duration metric: took 22.06106473s for enable addons: enabled=[storage-provisioner metrics-server dashboard default-storageclass]
I0819 13:47:13.917263 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:47:15.917297 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:47:17.917947 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:47:19.918630 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:47:22.416228 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:47:24.417067 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:47:26.418088 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:47:28.917346 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:47:31.418645 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:47:33.949103 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:47:36.419506 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:47:38.472532 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:47:40.917380 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:47:42.917553 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:47:45.420432 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:47:47.916245 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:47:49.917474 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:47:52.417057 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:47:54.917315 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:47:57.416720 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:47:59.426078 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:01.918821 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:04.416130 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:06.416672 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:08.416877 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:10.919567 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:13.416852 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:15.916725 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:17.916776 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:20.420472 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:22.918816 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:24.916247 152452 pod_ready.go:93] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"True"
I0819 13:48:24.916273 152452 pod_ready.go:82] duration metric: took 1m15.506252507s for pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace to be "Ready" ...
I0819 13:48:24.916287 152452 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-h74p7" in "kube-system" namespace to be "Ready" ...
I0819 13:48:24.921504 152452 pod_ready.go:93] pod "kube-proxy-h74p7" in "kube-system" namespace has status "Ready":"True"
I0819 13:48:24.921529 152452 pod_ready.go:82] duration metric: took 5.235022ms for pod "kube-proxy-h74p7" in "kube-system" namespace to be "Ready" ...
I0819 13:48:24.921541 152452 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-914579" in "kube-system" namespace to be "Ready" ...
I0819 13:48:26.932620 152452 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:29.428314 152452 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:31.928244 152452 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:33.928780 152452 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:34.928259 152452 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"True"
I0819 13:48:34.928291 152452 pod_ready.go:82] duration metric: took 10.006741707s for pod "kube-scheduler-old-k8s-version-914579" in "kube-system" namespace to be "Ready" ...
I0819 13:48:34.928304 152452 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace to be "Ready" ...
I0819 13:48:36.934720 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:38.962296 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:41.433908 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:43.435418 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:45.934634 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:48.434821 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:50.934608 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:52.934845 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:55.433832 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:57.434466 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:59.434579 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:01.934503 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:03.934901 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:06.435134 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:08.934952 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:11.434322 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:13.434874 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:15.934454 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:18.435150 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:20.935216 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:23.434770 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:25.434829 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:27.934477 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:29.934921 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:32.434702 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:34.936027 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:37.434753 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:39.492846 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:41.934580 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:43.935230 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:45.935307 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:48.435447 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:50.935387 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:53.434796 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:55.935376 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:58.434485 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:00.466805 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:02.935170 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:04.935322 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:07.434833 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:09.936204 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:12.434526 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:14.935092 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:16.935611 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:19.433957 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:21.438984 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:23.934582 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:25.935760 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:28.434454 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:30.436079 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:32.934427 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:34.934763 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:36.935055 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:39.435039 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:41.435936 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:43.934346 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:45.935139 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:47.935651 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:50.434768 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:52.435137 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:54.934726 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:57.434128 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:59.935544 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:01.936231 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:04.434264 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:06.441299 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:08.934048 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:10.934468 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:12.934719 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:15.434024 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:17.438817 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:19.935273 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:21.936911 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:24.434460 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:26.935401 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:29.434401 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:31.435212 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:33.935129 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:36.434032 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:38.434748 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:40.935437 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:43.434596 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:45.435727 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:47.934998 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:49.935071 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:51.935315 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:54.434496 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:56.434591 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:58.434895 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:00.492651 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:02.934662 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:05.434898 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:07.934929 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:09.935287 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:12.434870 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:14.934271 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:16.935007 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:18.937904 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:21.434619 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:23.434906 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:25.934891 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:28.435242 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:30.935637 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:33.439917 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:34.935755 152452 pod_ready.go:82] duration metric: took 4m0.007436285s for pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace to be "Ready" ...
E0819 13:52:34.935829 152452 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I0819 13:52:34.935840 152452 pod_ready.go:39] duration metric: took 5m26.260504475s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0819 13:52:34.935859 152452 api_server.go:52] waiting for apiserver process to appear ...
I0819 13:52:34.935897 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0819 13:52:34.935964 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0819 13:52:34.983562 152452 cri.go:89] found id: "b779c421112b8e180714c33a49f2622b00391462fc2a2bfb51100d7824fdb234"
I0819 13:52:34.983594 152452 cri.go:89] found id: "fcd65a8439964dae437d73a25791d2c38189fd5f9e340dc4e33ca0cc390524ef"
I0819 13:52:34.983600 152452 cri.go:89] found id: ""
I0819 13:52:34.983607 152452 logs.go:276] 2 containers: [b779c421112b8e180714c33a49f2622b00391462fc2a2bfb51100d7824fdb234 fcd65a8439964dae437d73a25791d2c38189fd5f9e340dc4e33ca0cc390524ef]
I0819 13:52:34.983673 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:34.987405 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:34.991212 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0819 13:52:34.991322 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0819 13:52:35.038233 152452 cri.go:89] found id: "a93e658c9c6602282efd1636668d5404651e1df0eaba230af4e0430877ea618d"
I0819 13:52:35.038256 152452 cri.go:89] found id: "6c7959865023d5c1d31e7b8c33d4dca318c0b748bfd18163a76a3658248a339d"
I0819 13:52:35.038261 152452 cri.go:89] found id: ""
I0819 13:52:35.038269 152452 logs.go:276] 2 containers: [a93e658c9c6602282efd1636668d5404651e1df0eaba230af4e0430877ea618d 6c7959865023d5c1d31e7b8c33d4dca318c0b748bfd18163a76a3658248a339d]
I0819 13:52:35.038330 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.042886 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.047062 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0819 13:52:35.047139 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0819 13:52:35.088211 152452 cri.go:89] found id: "2c334d0b02f94acf867081f56ef726d597384f48a9f72e1851695738231ec36d"
I0819 13:52:35.088252 152452 cri.go:89] found id: "8344283822b374d886d00d290f18631a7790271c48c1d318d5b00a1cf12609a5"
I0819 13:52:35.088258 152452 cri.go:89] found id: ""
I0819 13:52:35.088268 152452 logs.go:276] 2 containers: [2c334d0b02f94acf867081f56ef726d597384f48a9f72e1851695738231ec36d 8344283822b374d886d00d290f18631a7790271c48c1d318d5b00a1cf12609a5]
I0819 13:52:35.088394 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.092837 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.097676 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0819 13:52:35.097870 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0819 13:52:35.144630 152452 cri.go:89] found id: "db9a1d56a8be5f2c08c944dc19babddbd855957ea6d3d8e032408575130a610c"
I0819 13:52:35.144652 152452 cri.go:89] found id: "c2b76e34da1effdab4751291934d76bf6fae4d64b9a57c2e308028866ca67cc7"
I0819 13:52:35.144657 152452 cri.go:89] found id: ""
I0819 13:52:35.144665 152452 logs.go:276] 2 containers: [db9a1d56a8be5f2c08c944dc19babddbd855957ea6d3d8e032408575130a610c c2b76e34da1effdab4751291934d76bf6fae4d64b9a57c2e308028866ca67cc7]
I0819 13:52:35.144726 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.148679 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.152190 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0819 13:52:35.152273 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0819 13:52:35.196608 152452 cri.go:89] found id: "024882e3d4a5aa678ba55df81b6f10533d9f05f6977090d57dc692926959b303"
I0819 13:52:35.196690 152452 cri.go:89] found id: "d8e9102405c0bfd7286b17e5f2348226ea534b03ab646ed8bc5c514f697bdd28"
I0819 13:52:35.196704 152452 cri.go:89] found id: ""
I0819 13:52:35.196713 152452 logs.go:276] 2 containers: [024882e3d4a5aa678ba55df81b6f10533d9f05f6977090d57dc692926959b303 d8e9102405c0bfd7286b17e5f2348226ea534b03ab646ed8bc5c514f697bdd28]
I0819 13:52:35.196773 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.201290 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.204963 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0819 13:52:35.205039 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0819 13:52:35.249246 152452 cri.go:89] found id: "fa88625298f23e335aba94d646c993344de4ef6b8da759e9d9f176ae78f9a1fe"
I0819 13:52:35.249266 152452 cri.go:89] found id: "ff300c34901ca29544018036fcfb1d22bafcc0bace0dcf64fe0bd253b66ef58e"
I0819 13:52:35.249271 152452 cri.go:89] found id: ""
I0819 13:52:35.249279 152452 logs.go:276] 2 containers: [fa88625298f23e335aba94d646c993344de4ef6b8da759e9d9f176ae78f9a1fe ff300c34901ca29544018036fcfb1d22bafcc0bace0dcf64fe0bd253b66ef58e]
I0819 13:52:35.249349 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.254569 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.258220 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0819 13:52:35.258299 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0819 13:52:35.300607 152452 cri.go:89] found id: "c846487e7ff859548debeb2531a1f0b42651196f23aa0606336373cbd8cc2cb4"
I0819 13:52:35.300633 152452 cri.go:89] found id: "765975197bf640c76b530d4282ed5d13d03238e0ae93cd4aca67241e2f5152e9"
I0819 13:52:35.300638 152452 cri.go:89] found id: ""
I0819 13:52:35.300646 152452 logs.go:276] 2 containers: [c846487e7ff859548debeb2531a1f0b42651196f23aa0606336373cbd8cc2cb4 765975197bf640c76b530d4282ed5d13d03238e0ae93cd4aca67241e2f5152e9]
I0819 13:52:35.300704 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.304359 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.307967 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0819 13:52:35.308109 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0819 13:52:35.359383 152452 cri.go:89] found id: "65c22339ea6f7f88b4be1592c18662038b27eacd8db0d2a2f924fadc09a4238b"
I0819 13:52:35.359409 152452 cri.go:89] found id: "13a46bd05c3c5fdc6450ed883a254f38627921b9e47309563f0258e3056dc8fa"
I0819 13:52:35.359414 152452 cri.go:89] found id: ""
I0819 13:52:35.359422 152452 logs.go:276] 2 containers: [65c22339ea6f7f88b4be1592c18662038b27eacd8db0d2a2f924fadc09a4238b 13a46bd05c3c5fdc6450ed883a254f38627921b9e47309563f0258e3056dc8fa]
I0819 13:52:35.359535 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.363613 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.367561 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0819 13:52:35.367641 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0819 13:52:35.406825 152452 cri.go:89] found id: "15bd5cc6d84b0d0c4efce828950c59f373f1bc865ae66f1949d2eef2c9a95b75"
I0819 13:52:35.406849 152452 cri.go:89] found id: ""
I0819 13:52:35.406857 152452 logs.go:276] 1 containers: [15bd5cc6d84b0d0c4efce828950c59f373f1bc865ae66f1949d2eef2c9a95b75]
I0819 13:52:35.406914 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.410940 152452 logs.go:123] Gathering logs for storage-provisioner [13a46bd05c3c5fdc6450ed883a254f38627921b9e47309563f0258e3056dc8fa] ...
I0819 13:52:35.410966 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 13a46bd05c3c5fdc6450ed883a254f38627921b9e47309563f0258e3056dc8fa"
I0819 13:52:35.465154 152452 logs.go:123] Gathering logs for containerd ...
I0819 13:52:35.465182 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0819 13:52:35.532935 152452 logs.go:123] Gathering logs for kube-apiserver [fcd65a8439964dae437d73a25791d2c38189fd5f9e340dc4e33ca0cc390524ef] ...
I0819 13:52:35.532976 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fcd65a8439964dae437d73a25791d2c38189fd5f9e340dc4e33ca0cc390524ef"
I0819 13:52:35.591317 152452 logs.go:123] Gathering logs for coredns [2c334d0b02f94acf867081f56ef726d597384f48a9f72e1851695738231ec36d] ...
I0819 13:52:35.591395 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2c334d0b02f94acf867081f56ef726d597384f48a9f72e1851695738231ec36d"
I0819 13:52:35.650002 152452 logs.go:123] Gathering logs for kube-scheduler [c2b76e34da1effdab4751291934d76bf6fae4d64b9a57c2e308028866ca67cc7] ...
I0819 13:52:35.650029 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c2b76e34da1effdab4751291934d76bf6fae4d64b9a57c2e308028866ca67cc7"
I0819 13:52:35.700068 152452 logs.go:123] Gathering logs for kube-proxy [024882e3d4a5aa678ba55df81b6f10533d9f05f6977090d57dc692926959b303] ...
I0819 13:52:35.700098 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 024882e3d4a5aa678ba55df81b6f10533d9f05f6977090d57dc692926959b303"
I0819 13:52:35.746365 152452 logs.go:123] Gathering logs for kindnet [765975197bf640c76b530d4282ed5d13d03238e0ae93cd4aca67241e2f5152e9] ...
I0819 13:52:35.746394 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 765975197bf640c76b530d4282ed5d13d03238e0ae93cd4aca67241e2f5152e9"
I0819 13:52:35.798143 152452 logs.go:123] Gathering logs for kubernetes-dashboard [15bd5cc6d84b0d0c4efce828950c59f373f1bc865ae66f1949d2eef2c9a95b75] ...
I0819 13:52:35.798174 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 15bd5cc6d84b0d0c4efce828950c59f373f1bc865ae66f1949d2eef2c9a95b75"
I0819 13:52:35.839938 152452 logs.go:123] Gathering logs for kubelet ...
I0819 13:52:35.839967 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0819 13:52:35.898330 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505154 660 reflector.go:138] object-"kube-system"/"coredns-token-mgkqs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-mgkqs" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:35.898580 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505275 660 reflector.go:138] object-"kube-system"/"storage-provisioner-token-vrkdd": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-vrkdd" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:35.898804 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505337 660 reflector.go:138] object-"kube-system"/"metrics-server-token-gngrg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-gngrg" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:35.899032 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505397 660 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:35.899252 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505458 660 reflector.go:138] object-"kube-system"/"kube-proxy-token-gvnrc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-gvnrc" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:35.899472 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505515 660 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:35.899698 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505568 660 reflector.go:138] object-"kube-system"/"kindnet-token-db6v8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-db6v8" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:35.899941 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505619 660 reflector.go:138] object-"default"/"default-token-ldqq4": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-ldqq4" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:35.907521 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:11 old-k8s-version-914579 kubelet[660]: E0819 13:47:11.700916 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0819 13:52:35.907711 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:11 old-k8s-version-914579 kubelet[660]: E0819 13:47:11.923497 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.910569 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:23 old-k8s-version-914579 kubelet[660]: E0819 13:47:23.556884 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0819 13:52:35.912575 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:38 old-k8s-version-914579 kubelet[660]: E0819 13:47:38.547027 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.913031 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:41 old-k8s-version-914579 kubelet[660]: E0819 13:47:41.081116 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.913488 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:42 old-k8s-version-914579 kubelet[660]: E0819 13:47:42.088354 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.913930 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:43 old-k8s-version-914579 kubelet[660]: E0819 13:47:43.093385 660 pod_workers.go:191] Error syncing pod e088dd49-745a-4473-b25c-b8b1bdef35d2 ("storage-provisioner_kube-system(e088dd49-745a-4473-b25c-b8b1bdef35d2)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(e088dd49-745a-4473-b25c-b8b1bdef35d2)"
W0819 13:52:35.914587 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:50 old-k8s-version-914579 kubelet[660]: E0819 13:47:50.143364 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.917029 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:50 old-k8s-version-914579 kubelet[660]: E0819 13:47:50.539102 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0819 13:52:35.917347 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:04 old-k8s-version-914579 kubelet[660]: E0819 13:48:04.530531 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.917951 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:06 old-k8s-version-914579 kubelet[660]: E0819 13:48:06.204897 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.918275 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:10 old-k8s-version-914579 kubelet[660]: E0819 13:48:10.144306 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.918461 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:17 old-k8s-version-914579 kubelet[660]: E0819 13:48:17.533996 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.918787 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:22 old-k8s-version-914579 kubelet[660]: E0819 13:48:22.534681 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.918970 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:28 old-k8s-version-914579 kubelet[660]: E0819 13:48:28.530752 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.919435 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:35 old-k8s-version-914579 kubelet[660]: E0819 13:48:35.289738 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.919895 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:40 old-k8s-version-914579 kubelet[660]: E0819 13:48:40.144100 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.922351 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:40 old-k8s-version-914579 kubelet[660]: E0819 13:48:40.550260 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0819 13:52:35.922678 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:53 old-k8s-version-914579 kubelet[660]: E0819 13:48:53.530760 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.922862 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:54 old-k8s-version-914579 kubelet[660]: E0819 13:48:54.530590 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.923186 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:05 old-k8s-version-914579 kubelet[660]: E0819 13:49:05.530108 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.923368 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:06 old-k8s-version-914579 kubelet[660]: E0819 13:49:06.531043 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.923551 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:19 old-k8s-version-914579 kubelet[660]: E0819 13:49:19.533642 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.924153 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:21 old-k8s-version-914579 kubelet[660]: E0819 13:49:21.435392 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.924483 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:30 old-k8s-version-914579 kubelet[660]: E0819 13:49:30.144187 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.924667 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:32 old-k8s-version-914579 kubelet[660]: E0819 13:49:32.530403 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.924993 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:41 old-k8s-version-914579 kubelet[660]: E0819 13:49:41.530796 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.925176 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:44 old-k8s-version-914579 kubelet[660]: E0819 13:49:44.530365 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.925501 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:55 old-k8s-version-914579 kubelet[660]: E0819 13:49:55.530750 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.925688 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:57 old-k8s-version-914579 kubelet[660]: E0819 13:49:57.534986 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.926015 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:07 old-k8s-version-914579 kubelet[660]: E0819 13:50:07.530719 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.928455 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:11 old-k8s-version-914579 kubelet[660]: E0819 13:50:11.538819 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0819 13:52:35.928791 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:22 old-k8s-version-914579 kubelet[660]: E0819 13:50:22.530086 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.928974 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:25 old-k8s-version-914579 kubelet[660]: E0819 13:50:25.531673 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.929326 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:35 old-k8s-version-914579 kubelet[660]: E0819 13:50:35.530288 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.929510 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:38 old-k8s-version-914579 kubelet[660]: E0819 13:50:38.536408 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.929836 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:50 old-k8s-version-914579 kubelet[660]: E0819 13:50:50.531928 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.930292 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:50 old-k8s-version-914579 kubelet[660]: E0819 13:50:50.676624 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.930620 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:00 old-k8s-version-914579 kubelet[660]: E0819 13:51:00.175960 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.930808 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:05 old-k8s-version-914579 kubelet[660]: E0819 13:51:05.532058 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.931133 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:13 old-k8s-version-914579 kubelet[660]: E0819 13:51:13.534019 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.931316 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:18 old-k8s-version-914579 kubelet[660]: E0819 13:51:18.530498 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.931826 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:25 old-k8s-version-914579 kubelet[660]: E0819 13:51:25.530598 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.932029 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:31 old-k8s-version-914579 kubelet[660]: E0819 13:51:31.530699 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.932414 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:36 old-k8s-version-914579 kubelet[660]: E0819 13:51:36.530142 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.932607 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:42 old-k8s-version-914579 kubelet[660]: E0819 13:51:42.530485 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.932933 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:48 old-k8s-version-914579 kubelet[660]: E0819 13:51:48.530149 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.933116 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:54 old-k8s-version-914579 kubelet[660]: E0819 13:51:54.530585 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.933493 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:02 old-k8s-version-914579 kubelet[660]: E0819 13:52:02.531227 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.933689 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:07 old-k8s-version-914579 kubelet[660]: E0819 13:52:07.531110 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.934037 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:16 old-k8s-version-914579 kubelet[660]: E0819 13:52:16.530020 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.934225 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:22 old-k8s-version-914579 kubelet[660]: E0819 13:52:22.530508 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.934560 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:31 old-k8s-version-914579 kubelet[660]: E0819 13:52:31.532198 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.934746 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:33 old-k8s-version-914579 kubelet[660]: E0819 13:52:33.531083 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0819 13:52:35.934760 152452 logs.go:123] Gathering logs for describe nodes ...
I0819 13:52:35.934778 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0819 13:52:36.093366 152452 logs.go:123] Gathering logs for etcd [a93e658c9c6602282efd1636668d5404651e1df0eaba230af4e0430877ea618d] ...
I0819 13:52:36.093398 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a93e658c9c6602282efd1636668d5404651e1df0eaba230af4e0430877ea618d"
I0819 13:52:36.140421 152452 logs.go:123] Gathering logs for kube-controller-manager [fa88625298f23e335aba94d646c993344de4ef6b8da759e9d9f176ae78f9a1fe] ...
I0819 13:52:36.140454 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fa88625298f23e335aba94d646c993344de4ef6b8da759e9d9f176ae78f9a1fe"
I0819 13:52:36.207906 152452 logs.go:123] Gathering logs for kube-apiserver [b779c421112b8e180714c33a49f2622b00391462fc2a2bfb51100d7824fdb234] ...
I0819 13:52:36.207941 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b779c421112b8e180714c33a49f2622b00391462fc2a2bfb51100d7824fdb234"
I0819 13:52:36.281081 152452 logs.go:123] Gathering logs for etcd [6c7959865023d5c1d31e7b8c33d4dca318c0b748bfd18163a76a3658248a339d] ...
I0819 13:52:36.281117 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6c7959865023d5c1d31e7b8c33d4dca318c0b748bfd18163a76a3658248a339d"
I0819 13:52:36.371336 152452 logs.go:123] Gathering logs for container status ...
I0819 13:52:36.371370 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0819 13:52:36.423185 152452 logs.go:123] Gathering logs for kube-controller-manager [ff300c34901ca29544018036fcfb1d22bafcc0bace0dcf64fe0bd253b66ef58e] ...
I0819 13:52:36.423217 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ff300c34901ca29544018036fcfb1d22bafcc0bace0dcf64fe0bd253b66ef58e"
I0819 13:52:36.477465 152452 logs.go:123] Gathering logs for kindnet [c846487e7ff859548debeb2531a1f0b42651196f23aa0606336373cbd8cc2cb4] ...
I0819 13:52:36.477500 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c846487e7ff859548debeb2531a1f0b42651196f23aa0606336373cbd8cc2cb4"
I0819 13:52:36.551026 152452 logs.go:123] Gathering logs for storage-provisioner [65c22339ea6f7f88b4be1592c18662038b27eacd8db0d2a2f924fadc09a4238b] ...
I0819 13:52:36.551090 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 65c22339ea6f7f88b4be1592c18662038b27eacd8db0d2a2f924fadc09a4238b"
I0819 13:52:36.605781 152452 logs.go:123] Gathering logs for dmesg ...
I0819 13:52:36.605810 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0819 13:52:36.625534 152452 logs.go:123] Gathering logs for coredns [8344283822b374d886d00d290f18631a7790271c48c1d318d5b00a1cf12609a5] ...
I0819 13:52:36.625564 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8344283822b374d886d00d290f18631a7790271c48c1d318d5b00a1cf12609a5"
I0819 13:52:36.665220 152452 logs.go:123] Gathering logs for kube-scheduler [db9a1d56a8be5f2c08c944dc19babddbd855957ea6d3d8e032408575130a610c] ...
I0819 13:52:36.665250 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 db9a1d56a8be5f2c08c944dc19babddbd855957ea6d3d8e032408575130a610c"
I0819 13:52:36.706249 152452 logs.go:123] Gathering logs for kube-proxy [d8e9102405c0bfd7286b17e5f2348226ea534b03ab646ed8bc5c514f697bdd28] ...
I0819 13:52:36.706279 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d8e9102405c0bfd7286b17e5f2348226ea534b03ab646ed8bc5c514f697bdd28"
I0819 13:52:36.751297 152452 out.go:358] Setting ErrFile to fd 2...
I0819 13:52:36.751324 152452 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0819 13:52:36.751378 152452 out.go:270] X Problems detected in kubelet:
X Problems detected in kubelet:
W0819 13:52:36.751394 152452 out.go:270] Aug 19 13:52:07 old-k8s-version-914579 kubelet[660]: E0819 13:52:07.531110 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 19 13:52:07 old-k8s-version-914579 kubelet[660]: E0819 13:52:07.531110 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:36.751404 152452 out.go:270] Aug 19 13:52:16 old-k8s-version-914579 kubelet[660]: E0819 13:52:16.530020 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
Aug 19 13:52:16 old-k8s-version-914579 kubelet[660]: E0819 13:52:16.530020 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:36.751419 152452 out.go:270] Aug 19 13:52:22 old-k8s-version-914579 kubelet[660]: E0819 13:52:22.530508 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 19 13:52:22 old-k8s-version-914579 kubelet[660]: E0819 13:52:22.530508 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:36.751425 152452 out.go:270] Aug 19 13:52:31 old-k8s-version-914579 kubelet[660]: E0819 13:52:31.532198 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
Aug 19 13:52:31 old-k8s-version-914579 kubelet[660]: E0819 13:52:31.532198 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:36.751434 152452 out.go:270] Aug 19 13:52:33 old-k8s-version-914579 kubelet[660]: E0819 13:52:33.531083 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 19 13:52:33 old-k8s-version-914579 kubelet[660]: E0819 13:52:33.531083 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0819 13:52:36.751439 152452 out.go:358] Setting ErrFile to fd 2...
I0819 13:52:36.751445 152452 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0819 13:52:46.752339 152452 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0819 13:52:46.770079 152452 api_server.go:72] duration metric: took 5m57.199385315s to wait for apiserver process to appear ...
I0819 13:52:46.770108 152452 api_server.go:88] waiting for apiserver healthz status ...
I0819 13:52:46.770164 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0819 13:52:46.770245 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0819 13:52:46.856422 152452 cri.go:89] found id: "b779c421112b8e180714c33a49f2622b00391462fc2a2bfb51100d7824fdb234"
I0819 13:52:46.856452 152452 cri.go:89] found id: "fcd65a8439964dae437d73a25791d2c38189fd5f9e340dc4e33ca0cc390524ef"
I0819 13:52:46.856457 152452 cri.go:89] found id: ""
I0819 13:52:46.856466 152452 logs.go:276] 2 containers: [b779c421112b8e180714c33a49f2622b00391462fc2a2bfb51100d7824fdb234 fcd65a8439964dae437d73a25791d2c38189fd5f9e340dc4e33ca0cc390524ef]
I0819 13:52:46.856537 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:46.860669 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:46.865075 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0819 13:52:46.865149 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0819 13:52:46.936606 152452 cri.go:89] found id: "a93e658c9c6602282efd1636668d5404651e1df0eaba230af4e0430877ea618d"
I0819 13:52:46.936634 152452 cri.go:89] found id: "6c7959865023d5c1d31e7b8c33d4dca318c0b748bfd18163a76a3658248a339d"
I0819 13:52:46.936640 152452 cri.go:89] found id: ""
I0819 13:52:46.936648 152452 logs.go:276] 2 containers: [a93e658c9c6602282efd1636668d5404651e1df0eaba230af4e0430877ea618d 6c7959865023d5c1d31e7b8c33d4dca318c0b748bfd18163a76a3658248a339d]
I0819 13:52:46.936720 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:46.942994 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:46.948231 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0819 13:52:46.948310 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0819 13:52:47.020145 152452 cri.go:89] found id: "2c334d0b02f94acf867081f56ef726d597384f48a9f72e1851695738231ec36d"
I0819 13:52:47.020172 152452 cri.go:89] found id: "8344283822b374d886d00d290f18631a7790271c48c1d318d5b00a1cf12609a5"
I0819 13:52:47.020177 152452 cri.go:89] found id: ""
I0819 13:52:47.020188 152452 logs.go:276] 2 containers: [2c334d0b02f94acf867081f56ef726d597384f48a9f72e1851695738231ec36d 8344283822b374d886d00d290f18631a7790271c48c1d318d5b00a1cf12609a5]
I0819 13:52:47.020279 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.024967 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.034264 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0819 13:52:47.034360 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0819 13:52:47.096009 152452 cri.go:89] found id: "db9a1d56a8be5f2c08c944dc19babddbd855957ea6d3d8e032408575130a610c"
I0819 13:52:47.096031 152452 cri.go:89] found id: "c2b76e34da1effdab4751291934d76bf6fae4d64b9a57c2e308028866ca67cc7"
I0819 13:52:47.096036 152452 cri.go:89] found id: ""
I0819 13:52:47.096043 152452 logs.go:276] 2 containers: [db9a1d56a8be5f2c08c944dc19babddbd855957ea6d3d8e032408575130a610c c2b76e34da1effdab4751291934d76bf6fae4d64b9a57c2e308028866ca67cc7]
I0819 13:52:47.096111 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.102562 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.109207 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0819 13:52:47.109283 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0819 13:52:47.184806 152452 cri.go:89] found id: "024882e3d4a5aa678ba55df81b6f10533d9f05f6977090d57dc692926959b303"
I0819 13:52:47.184828 152452 cri.go:89] found id: "d8e9102405c0bfd7286b17e5f2348226ea534b03ab646ed8bc5c514f697bdd28"
I0819 13:52:47.184833 152452 cri.go:89] found id: ""
I0819 13:52:47.184842 152452 logs.go:276] 2 containers: [024882e3d4a5aa678ba55df81b6f10533d9f05f6977090d57dc692926959b303 d8e9102405c0bfd7286b17e5f2348226ea534b03ab646ed8bc5c514f697bdd28]
I0819 13:52:47.184903 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.189384 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.194364 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0819 13:52:47.194448 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0819 13:52:47.265188 152452 cri.go:89] found id: "fa88625298f23e335aba94d646c993344de4ef6b8da759e9d9f176ae78f9a1fe"
I0819 13:52:47.265218 152452 cri.go:89] found id: "ff300c34901ca29544018036fcfb1d22bafcc0bace0dcf64fe0bd253b66ef58e"
I0819 13:52:47.265224 152452 cri.go:89] found id: ""
I0819 13:52:47.265231 152452 logs.go:276] 2 containers: [fa88625298f23e335aba94d646c993344de4ef6b8da759e9d9f176ae78f9a1fe ff300c34901ca29544018036fcfb1d22bafcc0bace0dcf64fe0bd253b66ef58e]
I0819 13:52:47.265303 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.269862 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.273980 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0819 13:52:47.274061 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0819 13:52:47.338484 152452 cri.go:89] found id: "c846487e7ff859548debeb2531a1f0b42651196f23aa0606336373cbd8cc2cb4"
I0819 13:52:47.338509 152452 cri.go:89] found id: "765975197bf640c76b530d4282ed5d13d03238e0ae93cd4aca67241e2f5152e9"
I0819 13:52:47.338515 152452 cri.go:89] found id: ""
I0819 13:52:47.338522 152452 logs.go:276] 2 containers: [c846487e7ff859548debeb2531a1f0b42651196f23aa0606336373cbd8cc2cb4 765975197bf640c76b530d4282ed5d13d03238e0ae93cd4aca67241e2f5152e9]
I0819 13:52:47.338580 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.343202 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.370668 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0819 13:52:47.370745 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0819 13:52:47.432108 152452 cri.go:89] found id: "65c22339ea6f7f88b4be1592c18662038b27eacd8db0d2a2f924fadc09a4238b"
I0819 13:52:47.432132 152452 cri.go:89] found id: "13a46bd05c3c5fdc6450ed883a254f38627921b9e47309563f0258e3056dc8fa"
I0819 13:52:47.432137 152452 cri.go:89] found id: ""
I0819 13:52:47.432160 152452 logs.go:276] 2 containers: [65c22339ea6f7f88b4be1592c18662038b27eacd8db0d2a2f924fadc09a4238b 13a46bd05c3c5fdc6450ed883a254f38627921b9e47309563f0258e3056dc8fa]
I0819 13:52:47.432231 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.438213 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.446636 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0819 13:52:47.446722 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0819 13:52:47.510037 152452 cri.go:89] found id: "15bd5cc6d84b0d0c4efce828950c59f373f1bc865ae66f1949d2eef2c9a95b75"
I0819 13:52:47.510060 152452 cri.go:89] found id: ""
I0819 13:52:47.510069 152452 logs.go:276] 1 containers: [15bd5cc6d84b0d0c4efce828950c59f373f1bc865ae66f1949d2eef2c9a95b75]
I0819 13:52:47.510144 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.515774 152452 logs.go:123] Gathering logs for etcd [a93e658c9c6602282efd1636668d5404651e1df0eaba230af4e0430877ea618d] ...
I0819 13:52:47.515814 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a93e658c9c6602282efd1636668d5404651e1df0eaba230af4e0430877ea618d"
I0819 13:52:47.636906 152452 logs.go:123] Gathering logs for storage-provisioner [65c22339ea6f7f88b4be1592c18662038b27eacd8db0d2a2f924fadc09a4238b] ...
I0819 13:52:47.636943 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 65c22339ea6f7f88b4be1592c18662038b27eacd8db0d2a2f924fadc09a4238b"
I0819 13:52:47.704121 152452 logs.go:123] Gathering logs for kubernetes-dashboard [15bd5cc6d84b0d0c4efce828950c59f373f1bc865ae66f1949d2eef2c9a95b75] ...
I0819 13:52:47.704152 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 15bd5cc6d84b0d0c4efce828950c59f373f1bc865ae66f1949d2eef2c9a95b75"
I0819 13:52:47.805660 152452 logs.go:123] Gathering logs for container status ...
I0819 13:52:47.805689 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0819 13:52:47.889024 152452 logs.go:123] Gathering logs for kubelet ...
I0819 13:52:47.889055 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0819 13:52:47.950679 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505154 660 reflector.go:138] object-"kube-system"/"coredns-token-mgkqs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-mgkqs" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:47.950954 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505275 660 reflector.go:138] object-"kube-system"/"storage-provisioner-token-vrkdd": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-vrkdd" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:47.951176 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505337 660 reflector.go:138] object-"kube-system"/"metrics-server-token-gngrg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-gngrg" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:47.951381 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505397 660 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:47.951596 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505458 660 reflector.go:138] object-"kube-system"/"kube-proxy-token-gvnrc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-gvnrc" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:47.951821 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505515 660 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:47.952031 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505568 660 reflector.go:138] object-"kube-system"/"kindnet-token-db6v8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-db6v8" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:47.952238 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505619 660 reflector.go:138] object-"default"/"default-token-ldqq4": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-ldqq4" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:47.959838 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:11 old-k8s-version-914579 kubelet[660]: E0819 13:47:11.700916 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0819 13:52:47.960028 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:11 old-k8s-version-914579 kubelet[660]: E0819 13:47:11.923497 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.962801 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:23 old-k8s-version-914579 kubelet[660]: E0819 13:47:23.556884 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0819 13:52:47.964806 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:38 old-k8s-version-914579 kubelet[660]: E0819 13:47:38.547027 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.965259 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:41 old-k8s-version-914579 kubelet[660]: E0819 13:47:41.081116 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.965718 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:42 old-k8s-version-914579 kubelet[660]: E0819 13:47:42.088354 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.966157 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:43 old-k8s-version-914579 kubelet[660]: E0819 13:47:43.093385 660 pod_workers.go:191] Error syncing pod e088dd49-745a-4473-b25c-b8b1bdef35d2 ("storage-provisioner_kube-system(e088dd49-745a-4473-b25c-b8b1bdef35d2)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(e088dd49-745a-4473-b25c-b8b1bdef35d2)"
W0819 13:52:47.966810 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:50 old-k8s-version-914579 kubelet[660]: E0819 13:47:50.143364 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.969243 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:50 old-k8s-version-914579 kubelet[660]: E0819 13:47:50.539102 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0819 13:52:47.969559 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:04 old-k8s-version-914579 kubelet[660]: E0819 13:48:04.530531 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.970145 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:06 old-k8s-version-914579 kubelet[660]: E0819 13:48:06.204897 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.970473 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:10 old-k8s-version-914579 kubelet[660]: E0819 13:48:10.144306 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.970654 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:17 old-k8s-version-914579 kubelet[660]: E0819 13:48:17.533996 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.970983 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:22 old-k8s-version-914579 kubelet[660]: E0819 13:48:22.534681 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.971164 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:28 old-k8s-version-914579 kubelet[660]: E0819 13:48:28.530752 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.971618 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:35 old-k8s-version-914579 kubelet[660]: E0819 13:48:35.289738 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.972083 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:40 old-k8s-version-914579 kubelet[660]: E0819 13:48:40.144100 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.974502 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:40 old-k8s-version-914579 kubelet[660]: E0819 13:48:40.550260 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0819 13:52:47.974827 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:53 old-k8s-version-914579 kubelet[660]: E0819 13:48:53.530760 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.975011 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:54 old-k8s-version-914579 kubelet[660]: E0819 13:48:54.530590 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.975335 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:05 old-k8s-version-914579 kubelet[660]: E0819 13:49:05.530108 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.975517 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:06 old-k8s-version-914579 kubelet[660]: E0819 13:49:06.531043 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.975699 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:19 old-k8s-version-914579 kubelet[660]: E0819 13:49:19.533642 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.976287 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:21 old-k8s-version-914579 kubelet[660]: E0819 13:49:21.435392 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.976615 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:30 old-k8s-version-914579 kubelet[660]: E0819 13:49:30.144187 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.976800 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:32 old-k8s-version-914579 kubelet[660]: E0819 13:49:32.530403 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.977129 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:41 old-k8s-version-914579 kubelet[660]: E0819 13:49:41.530796 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.977314 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:44 old-k8s-version-914579 kubelet[660]: E0819 13:49:44.530365 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.977643 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:55 old-k8s-version-914579 kubelet[660]: E0819 13:49:55.530750 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.977826 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:57 old-k8s-version-914579 kubelet[660]: E0819 13:49:57.534986 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.978150 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:07 old-k8s-version-914579 kubelet[660]: E0819 13:50:07.530719 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.980581 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:11 old-k8s-version-914579 kubelet[660]: E0819 13:50:11.538819 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0819 13:52:47.980908 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:22 old-k8s-version-914579 kubelet[660]: E0819 13:50:22.530086 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.981091 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:25 old-k8s-version-914579 kubelet[660]: E0819 13:50:25.531673 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.981423 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:35 old-k8s-version-914579 kubelet[660]: E0819 13:50:35.530288 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.981610 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:38 old-k8s-version-914579 kubelet[660]: E0819 13:50:38.536408 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.981975 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:50 old-k8s-version-914579 kubelet[660]: E0819 13:50:50.531928 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.982431 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:50 old-k8s-version-914579 kubelet[660]: E0819 13:50:50.676624 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.982758 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:00 old-k8s-version-914579 kubelet[660]: E0819 13:51:00.175960 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.982940 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:05 old-k8s-version-914579 kubelet[660]: E0819 13:51:05.532058 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.983266 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:13 old-k8s-version-914579 kubelet[660]: E0819 13:51:13.534019 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.983448 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:18 old-k8s-version-914579 kubelet[660]: E0819 13:51:18.530498 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.983773 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:25 old-k8s-version-914579 kubelet[660]: E0819 13:51:25.530598 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.983961 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:31 old-k8s-version-914579 kubelet[660]: E0819 13:51:31.530699 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.984287 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:36 old-k8s-version-914579 kubelet[660]: E0819 13:51:36.530142 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.984471 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:42 old-k8s-version-914579 kubelet[660]: E0819 13:51:42.530485 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.984797 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:48 old-k8s-version-914579 kubelet[660]: E0819 13:51:48.530149 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.984991 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:54 old-k8s-version-914579 kubelet[660]: E0819 13:51:54.530585 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.985325 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:02 old-k8s-version-914579 kubelet[660]: E0819 13:52:02.531227 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.985511 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:07 old-k8s-version-914579 kubelet[660]: E0819 13:52:07.531110 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.985850 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:16 old-k8s-version-914579 kubelet[660]: E0819 13:52:16.530020 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.986033 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:22 old-k8s-version-914579 kubelet[660]: E0819 13:52:22.530508 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.986358 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:31 old-k8s-version-914579 kubelet[660]: E0819 13:52:31.532198 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.986541 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:33 old-k8s-version-914579 kubelet[660]: E0819 13:52:33.531083 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.986866 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:45 old-k8s-version-914579 kubelet[660]: E0819 13:52:45.532025 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.987049 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:45 old-k8s-version-914579 kubelet[660]: E0819 13:52:45.532731 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0819 13:52:47.987058 152452 logs.go:123] Gathering logs for kube-apiserver [b779c421112b8e180714c33a49f2622b00391462fc2a2bfb51100d7824fdb234] ...
I0819 13:52:47.987074 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b779c421112b8e180714c33a49f2622b00391462fc2a2bfb51100d7824fdb234"
I0819 13:52:48.072238 152452 logs.go:123] Gathering logs for kube-apiserver [fcd65a8439964dae437d73a25791d2c38189fd5f9e340dc4e33ca0cc390524ef] ...
I0819 13:52:48.072277 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fcd65a8439964dae437d73a25791d2c38189fd5f9e340dc4e33ca0cc390524ef"
I0819 13:52:48.144742 152452 logs.go:123] Gathering logs for coredns [8344283822b374d886d00d290f18631a7790271c48c1d318d5b00a1cf12609a5] ...
I0819 13:52:48.144795 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8344283822b374d886d00d290f18631a7790271c48c1d318d5b00a1cf12609a5"
I0819 13:52:48.193011 152452 logs.go:123] Gathering logs for dmesg ...
I0819 13:52:48.193038 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0819 13:52:48.210157 152452 logs.go:123] Gathering logs for describe nodes ...
I0819 13:52:48.210198 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0819 13:52:48.374447 152452 logs.go:123] Gathering logs for kube-controller-manager [ff300c34901ca29544018036fcfb1d22bafcc0bace0dcf64fe0bd253b66ef58e] ...
I0819 13:52:48.374478 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ff300c34901ca29544018036fcfb1d22bafcc0bace0dcf64fe0bd253b66ef58e"
I0819 13:52:48.431668 152452 logs.go:123] Gathering logs for kindnet [765975197bf640c76b530d4282ed5d13d03238e0ae93cd4aca67241e2f5152e9] ...
I0819 13:52:48.431701 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 765975197bf640c76b530d4282ed5d13d03238e0ae93cd4aca67241e2f5152e9"
I0819 13:52:48.487205 152452 logs.go:123] Gathering logs for storage-provisioner [13a46bd05c3c5fdc6450ed883a254f38627921b9e47309563f0258e3056dc8fa] ...
I0819 13:52:48.487242 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 13a46bd05c3c5fdc6450ed883a254f38627921b9e47309563f0258e3056dc8fa"
I0819 13:52:48.547481 152452 logs.go:123] Gathering logs for containerd ...
I0819 13:52:48.547514 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0819 13:52:48.610774 152452 logs.go:123] Gathering logs for etcd [6c7959865023d5c1d31e7b8c33d4dca318c0b748bfd18163a76a3658248a339d] ...
I0819 13:52:48.610815 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6c7959865023d5c1d31e7b8c33d4dca318c0b748bfd18163a76a3658248a339d"
I0819 13:52:48.676770 152452 logs.go:123] Gathering logs for coredns [2c334d0b02f94acf867081f56ef726d597384f48a9f72e1851695738231ec36d] ...
I0819 13:52:48.676811 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2c334d0b02f94acf867081f56ef726d597384f48a9f72e1851695738231ec36d"
I0819 13:52:48.719917 152452 logs.go:123] Gathering logs for kube-scheduler [db9a1d56a8be5f2c08c944dc19babddbd855957ea6d3d8e032408575130a610c] ...
I0819 13:52:48.719995 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 db9a1d56a8be5f2c08c944dc19babddbd855957ea6d3d8e032408575130a610c"
I0819 13:52:48.764294 152452 logs.go:123] Gathering logs for kube-scheduler [c2b76e34da1effdab4751291934d76bf6fae4d64b9a57c2e308028866ca67cc7] ...
I0819 13:52:48.764367 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c2b76e34da1effdab4751291934d76bf6fae4d64b9a57c2e308028866ca67cc7"
I0819 13:52:48.807362 152452 logs.go:123] Gathering logs for kube-proxy [024882e3d4a5aa678ba55df81b6f10533d9f05f6977090d57dc692926959b303] ...
I0819 13:52:48.807437 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 024882e3d4a5aa678ba55df81b6f10533d9f05f6977090d57dc692926959b303"
I0819 13:52:48.846905 152452 logs.go:123] Gathering logs for kube-proxy [d8e9102405c0bfd7286b17e5f2348226ea534b03ab646ed8bc5c514f697bdd28] ...
I0819 13:52:48.846935 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d8e9102405c0bfd7286b17e5f2348226ea534b03ab646ed8bc5c514f697bdd28"
I0819 13:52:48.887930 152452 logs.go:123] Gathering logs for kube-controller-manager [fa88625298f23e335aba94d646c993344de4ef6b8da759e9d9f176ae78f9a1fe] ...
I0819 13:52:48.887962 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fa88625298f23e335aba94d646c993344de4ef6b8da759e9d9f176ae78f9a1fe"
I0819 13:52:48.948162 152452 logs.go:123] Gathering logs for kindnet [c846487e7ff859548debeb2531a1f0b42651196f23aa0606336373cbd8cc2cb4] ...
I0819 13:52:48.948198 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c846487e7ff859548debeb2531a1f0b42651196f23aa0606336373cbd8cc2cb4"
I0819 13:52:49.017994 152452 out.go:358] Setting ErrFile to fd 2...
I0819 13:52:49.018028 152452 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0819 13:52:49.018115 152452 out.go:270] X Problems detected in kubelet:
X Problems detected in kubelet:
W0819 13:52:49.018145 152452 out.go:270] Aug 19 13:52:22 old-k8s-version-914579 kubelet[660]: E0819 13:52:22.530508 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 19 13:52:22 old-k8s-version-914579 kubelet[660]: E0819 13:52:22.530508 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:49.018161 152452 out.go:270] Aug 19 13:52:31 old-k8s-version-914579 kubelet[660]: E0819 13:52:31.532198 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
Aug 19 13:52:31 old-k8s-version-914579 kubelet[660]: E0819 13:52:31.532198 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:49.018169 152452 out.go:270] Aug 19 13:52:33 old-k8s-version-914579 kubelet[660]: E0819 13:52:33.531083 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 19 13:52:33 old-k8s-version-914579 kubelet[660]: E0819 13:52:33.531083 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:49.018195 152452 out.go:270] Aug 19 13:52:45 old-k8s-version-914579 kubelet[660]: E0819 13:52:45.532025 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
Aug 19 13:52:45 old-k8s-version-914579 kubelet[660]: E0819 13:52:45.532025 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:49.018204 152452 out.go:270] Aug 19 13:52:45 old-k8s-version-914579 kubelet[660]: E0819 13:52:45.532731 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 19 13:52:45 old-k8s-version-914579 kubelet[660]: E0819 13:52:45.532731 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0819 13:52:49.018210 152452 out.go:358] Setting ErrFile to fd 2...
I0819 13:52:49.018223 152452 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0819 13:52:59.019588 152452 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0819 13:52:59.031741 152452 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0819 13:52:59.034833 152452 out.go:201]
W0819 13:52:59.037405 152452 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0819 13:52:59.037441 152452 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0819 13:52:59.037463 152452 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0819 13:52:59.037469 152452 out.go:270] *
*
W0819 13:52:59.038452 152452 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0819 13:52:59.042159 152452 out.go:201]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-914579 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-914579
helpers_test.go:235: (dbg) docker inspect old-k8s-version-914579:
-- stdout --
[
{
"Id": "7d362767646f5d274b702c77f9b75f9f2a1eac2d616eedcbae4b14767a077f35",
"Created": "2024-08-19T13:44:10.431331676Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 152836,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-08-19T13:46:41.573104142Z",
"FinishedAt": "2024-08-19T13:46:39.998561489Z"
},
"Image": "sha256:decdd59746a9dba10062a73f6cd4b910c7b4e60613660b1022f8357747681c4d",
"ResolvConfPath": "/var/lib/docker/containers/7d362767646f5d274b702c77f9b75f9f2a1eac2d616eedcbae4b14767a077f35/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/7d362767646f5d274b702c77f9b75f9f2a1eac2d616eedcbae4b14767a077f35/hostname",
"HostsPath": "/var/lib/docker/containers/7d362767646f5d274b702c77f9b75f9f2a1eac2d616eedcbae4b14767a077f35/hosts",
"LogPath": "/var/lib/docker/containers/7d362767646f5d274b702c77f9b75f9f2a1eac2d616eedcbae4b14767a077f35/7d362767646f5d274b702c77f9b75f9f2a1eac2d616eedcbae4b14767a077f35-json.log",
"Name": "/old-k8s-version-914579",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-914579:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-914579",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/eb924d6f85b97306f54c59f563c7cbd0a4cabec52b2f0e15ecdb35c30a7db0b5-init/diff:/var/lib/docker/overlay2/f9730c920ad297aa3b42f5a0ebbe1c9311721ca848f3268205322d3e26bf32e0/diff",
"MergedDir": "/var/lib/docker/overlay2/eb924d6f85b97306f54c59f563c7cbd0a4cabec52b2f0e15ecdb35c30a7db0b5/merged",
"UpperDir": "/var/lib/docker/overlay2/eb924d6f85b97306f54c59f563c7cbd0a4cabec52b2f0e15ecdb35c30a7db0b5/diff",
"WorkDir": "/var/lib/docker/overlay2/eb924d6f85b97306f54c59f563c7cbd0a4cabec52b2f0e15ecdb35c30a7db0b5/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-914579",
"Source": "/var/lib/docker/volumes/old-k8s-version-914579/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-914579",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-914579",
"name.minikube.sigs.k8s.io": "old-k8s-version-914579",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "e60bc8038f4507ff4b84637abcdb15c0e165cd87b0023be5c0cbf695d4d54798",
"SandboxKey": "/var/run/docker/netns/e60bc8038f45",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "38550"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "38551"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "38554"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "38552"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "38553"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-914579": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null,
"NetworkID": "76c7dc0c8baf84f4be3d9b423a96ee8317b7226b8748fb037d5e3e8cb8f1ad54",
"EndpointID": "ae4cbd2172b61a45705ec2e1808903fb71218c3976906196649c69660f2b19ac",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-914579",
"7d362767646f"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-914579 -n old-k8s-version-914579
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-914579 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-914579 logs -n 25: (2.61701181s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| ssh | -p cilium-386048 sudo | cilium-386048 | jenkins | v1.33.1 | 19 Aug 24 13:42 UTC | |
| | containerd config dump | | | | | |
| ssh | -p cilium-386048 sudo | cilium-386048 | jenkins | v1.33.1 | 19 Aug 24 13:42 UTC | |
| | systemctl status crio --all | | | | | |
| | --full --no-pager | | | | | |
| ssh | -p cilium-386048 sudo | cilium-386048 | jenkins | v1.33.1 | 19 Aug 24 13:42 UTC | |
| | systemctl cat crio --no-pager | | | | | |
| ssh | -p cilium-386048 sudo find | cilium-386048 | jenkins | v1.33.1 | 19 Aug 24 13:42 UTC | |
| | /etc/crio -type f -exec sh -c | | | | | |
| | 'echo {}; cat {}' \; | | | | | |
| ssh | -p cilium-386048 sudo crio | cilium-386048 | jenkins | v1.33.1 | 19 Aug 24 13:42 UTC | |
| | config | | | | | |
| delete | -p cilium-386048 | cilium-386048 | jenkins | v1.33.1 | 19 Aug 24 13:42 UTC | 19 Aug 24 13:42 UTC |
| start | -p cert-expiration-072717 | cert-expiration-072717 | jenkins | v1.33.1 | 19 Aug 24 13:42 UTC | 19 Aug 24 13:43 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-env-896390 | force-systemd-env-896390 | jenkins | v1.33.1 | 19 Aug 24 13:43 UTC | 19 Aug 24 13:43 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-env-896390 | force-systemd-env-896390 | jenkins | v1.33.1 | 19 Aug 24 13:43 UTC | 19 Aug 24 13:43 UTC |
| start | -p cert-options-854184 | cert-options-854184 | jenkins | v1.33.1 | 19 Aug 24 13:43 UTC | 19 Aug 24 13:43 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-854184 ssh | cert-options-854184 | jenkins | v1.33.1 | 19 Aug 24 13:43 UTC | 19 Aug 24 13:44 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-854184 -- sudo | cert-options-854184 | jenkins | v1.33.1 | 19 Aug 24 13:44 UTC | 19 Aug 24 13:44 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-854184 | cert-options-854184 | jenkins | v1.33.1 | 19 Aug 24 13:44 UTC | 19 Aug 24 13:44 UTC |
| start | -p old-k8s-version-914579 | old-k8s-version-914579 | jenkins | v1.33.1 | 19 Aug 24 13:44 UTC | 19 Aug 24 13:46 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p old-k8s-version-914579 | old-k8s-version-914579 | jenkins | v1.33.1 | 19 Aug 24 13:46 UTC | 19 Aug 24 13:46 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-914579 | old-k8s-version-914579 | jenkins | v1.33.1 | 19 Aug 24 13:46 UTC | 19 Aug 24 13:46 UTC |
| | --alsologtostderr -v=3 | | | | | |
| start | -p cert-expiration-072717 | cert-expiration-072717 | jenkins | v1.33.1 | 19 Aug 24 13:46 UTC | 19 Aug 24 13:46 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-072717 | cert-expiration-072717 | jenkins | v1.33.1 | 19 Aug 24 13:46 UTC | 19 Aug 24 13:46 UTC |
| addons | enable dashboard -p old-k8s-version-914579 | old-k8s-version-914579 | jenkins | v1.33.1 | 19 Aug 24 13:46 UTC | 19 Aug 24 13:46 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-895877 | no-preload-895877 | jenkins | v1.33.1 | 19 Aug 24 13:46 UTC | 19 Aug 24 13:48 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0 | | | | | |
| start | -p old-k8s-version-914579 | old-k8s-version-914579 | jenkins | v1.33.1 | 19 Aug 24 13:46 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-895877 | no-preload-895877 | jenkins | v1.33.1 | 19 Aug 24 13:48 UTC | 19 Aug 24 13:48 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-895877 | no-preload-895877 | jenkins | v1.33.1 | 19 Aug 24 13:48 UTC | 19 Aug 24 13:48 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-895877 | no-preload-895877 | jenkins | v1.33.1 | 19 Aug 24 13:48 UTC | 19 Aug 24 13:48 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-895877 | no-preload-895877 | jenkins | v1.33.1 | 19 Aug 24 13:48 UTC | 19 Aug 24 13:52 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0 | | | | | |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/08/19 13:48:23
Running on machine: ip-172-31-21-244
Binary: Built with gc go1.22.5 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0819 13:48:23.057348 159859 out.go:345] Setting OutFile to fd 1 ...
I0819 13:48:23.057584 159859 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0819 13:48:23.057618 159859 out.go:358] Setting ErrFile to fd 2...
I0819 13:48:23.057640 159859 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0819 13:48:23.057945 159859 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19479-4141166/.minikube/bin
I0819 13:48:23.058381 159859 out.go:352] Setting JSON to false
I0819 13:48:23.059586 159859 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":99047,"bootTime":1723976256,"procs":241,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1067-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
I0819 13:48:23.059696 159859 start.go:139] virtualization:
I0819 13:48:23.062109 159859 out.go:177] * [no-preload-895877] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0819 13:48:23.063429 159859 out.go:177] - MINIKUBE_LOCATION=19479
I0819 13:48:23.063513 159859 notify.go:220] Checking for updates...
I0819 13:48:23.066319 159859 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0819 13:48:23.067872 159859 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19479-4141166/kubeconfig
I0819 13:48:23.069284 159859 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19479-4141166/.minikube
I0819 13:48:23.070622 159859 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0819 13:48:23.071864 159859 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0819 13:48:23.073587 159859 config.go:182] Loaded profile config "no-preload-895877": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0819 13:48:23.074130 159859 driver.go:392] Setting default libvirt URI to qemu:///system
I0819 13:48:23.103892 159859 docker.go:123] docker version: linux-27.1.2:Docker Engine - Community
I0819 13:48:23.104002 159859 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0819 13:48:23.167753 159859 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:41 OomKillDisable:true NGoroutines:53 SystemTime:2024-08-19 13:48:23.15802675 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1067-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.1.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0819 13:48:23.167988 159859 docker.go:307] overlay module found
I0819 13:48:23.169996 159859 out.go:177] * Using the docker driver based on existing profile
I0819 13:48:23.171499 159859 start.go:297] selected driver: docker
I0819 13:48:23.171522 159859 start.go:901] validating driver "docker" against &{Name:no-preload-895877 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:no-preload-895877 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false Mount
String:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0819 13:48:23.171661 159859 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0819 13:48:23.172333 159859 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0819 13:48:23.225990 159859 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:41 OomKillDisable:true NGoroutines:53 SystemTime:2024-08-19 13:48:23.21598955 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1067-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.1.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0819 13:48:23.226351 159859 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0819 13:48:23.226383 159859 cni.go:84] Creating CNI manager for ""
I0819 13:48:23.226391 159859 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0819 13:48:23.226430 159859 start.go:340] cluster config:
{Name:no-preload-895877 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:no-preload-895877 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Moun
tIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0819 13:48:23.227744 159859 out.go:177] * Starting "no-preload-895877" primary control-plane node in "no-preload-895877" cluster
I0819 13:48:23.228905 159859 cache.go:121] Beginning downloading kic base image for docker with containerd
I0819 13:48:23.230371 159859 out.go:177] * Pulling base image v0.0.44-1723740748-19452 ...
I0819 13:48:23.231747 159859 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0819 13:48:23.231858 159859 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d in local docker daemon
I0819 13:48:23.232231 159859 profile.go:143] Saving config to /home/jenkins/minikube-integration/19479-4141166/.minikube/profiles/no-preload-895877/config.json ...
I0819 13:48:23.232562 159859 cache.go:107] acquiring lock: {Name:mk0435f120e3615424228517dffddda9f2d1a462 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0819 13:48:23.232650 159859 cache.go:115] /home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
I0819 13:48:23.232664 159859 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 107.601µs
I0819 13:48:23.232678 159859 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
I0819 13:48:23.232692 159859 cache.go:107] acquiring lock: {Name:mkb0412fa022c0128c30eeeb14fb1092141293cd Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0819 13:48:23.232727 159859 cache.go:115] /home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0 exists
I0819 13:48:23.232738 159859 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.31.0" -> "/home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0" took 47.433µs
I0819 13:48:23.232744 159859 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.31.0 -> /home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0 succeeded
I0819 13:48:23.232759 159859 cache.go:107] acquiring lock: {Name:mk4794cdc2eba693f0c8a75ff1419dbc17713015 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0819 13:48:23.232792 159859 cache.go:115] /home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0 exists
I0819 13:48:23.232802 159859 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.31.0" -> "/home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0" took 44.184µs
I0819 13:48:23.232809 159859 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.31.0 -> /home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0 succeeded
I0819 13:48:23.232822 159859 cache.go:107] acquiring lock: {Name:mk56937c24f200dd7dd76a6b43d70e549c5b8446 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0819 13:48:23.232918 159859 cache.go:115] /home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0 exists
I0819 13:48:23.232931 159859 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.31.0" -> "/home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0" took 109.71µs
I0819 13:48:23.232937 159859 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.31.0 -> /home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0 succeeded
I0819 13:48:23.232958 159859 cache.go:107] acquiring lock: {Name:mk4a09ee05b7a465c20582b2aa1b983c03eb25b2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0819 13:48:23.232997 159859 cache.go:115] /home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0 exists
I0819 13:48:23.233008 159859 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.31.0" -> "/home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0" took 51.806µs
I0819 13:48:23.233015 159859 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.31.0 -> /home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0 succeeded
I0819 13:48:23.233033 159859 cache.go:107] acquiring lock: {Name:mk70a897e2f7919b44821e23fc981b384d592661 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0819 13:48:23.233110 159859 cache.go:107] acquiring lock: {Name:mk8dcb3139b47d733691caf4bc0167a8e9e61ce2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0819 13:48:23.233139 159859 cache.go:107] acquiring lock: {Name:mkcc80ee107b53bd7a80a54cf140eff50ca3f763 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0819 13:48:23.233229 159859 cache.go:115] /home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 exists
I0819 13:48:23.233253 159859 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1" took 114.304µs
I0819 13:48:23.233275 159859 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
I0819 13:48:23.233285 159859 cache.go:115] /home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 exists
I0819 13:48:23.233323 159859 cache.go:96] cache image "registry.k8s.io/etcd:3.5.15-0" -> "/home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0" took 214.349µs
I0819 13:48:23.233343 159859 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.15-0 -> /home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 succeeded
I0819 13:48:23.233261 159859 cache.go:115] /home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 exists
I0819 13:48:23.233387 159859 cache.go:96] cache image "registry.k8s.io/pause:3.10" -> "/home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10" took 354.655µs
I0819 13:48:23.233463 159859 cache.go:80] save to tar file registry.k8s.io/pause:3.10 -> /home/jenkins/minikube-integration/19479-4141166/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 succeeded
I0819 13:48:23.233522 159859 cache.go:87] Successfully saved all images to host disk.
W0819 13:48:23.260105 159859 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d is of wrong architecture
I0819 13:48:23.260129 159859 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d to local cache
I0819 13:48:23.260212 159859 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d in local cache directory
I0819 13:48:23.260237 159859 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d in local cache directory, skipping pull
I0819 13:48:23.260245 159859 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d exists in cache, skipping pull
I0819 13:48:23.260253 159859 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d as a tarball
I0819 13:48:23.260259 159859 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d from local cache
I0819 13:48:23.383144 159859 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d from cached tarball
I0819 13:48:23.383200 159859 cache.go:194] Successfully downloaded all kic artifacts
I0819 13:48:23.383238 159859 start.go:360] acquireMachinesLock for no-preload-895877: {Name:mk35f055cc39e8adadc670a96ac80dee273bd1aa Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0819 13:48:23.383316 159859 start.go:364] duration metric: took 54.268µs to acquireMachinesLock for "no-preload-895877"
I0819 13:48:23.383343 159859 start.go:96] Skipping create...Using existing machine configuration
I0819 13:48:23.383354 159859 fix.go:54] fixHost starting:
I0819 13:48:23.383646 159859 cli_runner.go:164] Run: docker container inspect no-preload-895877 --format={{.State.Status}}
I0819 13:48:23.400858 159859 fix.go:112] recreateIfNeeded on no-preload-895877: state=Stopped err=<nil>
W0819 13:48:23.400898 159859 fix.go:138] unexpected machine state, will restart: <nil>
I0819 13:48:23.403896 159859 out.go:177] * Restarting existing docker container for "no-preload-895877" ...
I0819 13:48:22.918816 152452 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:24.916247 152452 pod_ready.go:93] pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"True"
I0819 13:48:24.916273 152452 pod_ready.go:82] duration metric: took 1m15.506252507s for pod "kube-controller-manager-old-k8s-version-914579" in "kube-system" namespace to be "Ready" ...
I0819 13:48:24.916287 152452 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-h74p7" in "kube-system" namespace to be "Ready" ...
I0819 13:48:24.921504 152452 pod_ready.go:93] pod "kube-proxy-h74p7" in "kube-system" namespace has status "Ready":"True"
I0819 13:48:24.921529 152452 pod_ready.go:82] duration metric: took 5.235022ms for pod "kube-proxy-h74p7" in "kube-system" namespace to be "Ready" ...
I0819 13:48:24.921541 152452 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-914579" in "kube-system" namespace to be "Ready" ...
I0819 13:48:23.406294 159859 cli_runner.go:164] Run: docker start no-preload-895877
I0819 13:48:23.747950 159859 cli_runner.go:164] Run: docker container inspect no-preload-895877 --format={{.State.Status}}
I0819 13:48:23.783056 159859 kic.go:430] container "no-preload-895877" state is running.
I0819 13:48:23.785117 159859 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-895877
I0819 13:48:23.816532 159859 profile.go:143] Saving config to /home/jenkins/minikube-integration/19479-4141166/.minikube/profiles/no-preload-895877/config.json ...
I0819 13:48:23.816880 159859 machine.go:93] provisionDockerMachine start ...
I0819 13:48:23.816989 159859 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-895877
I0819 13:48:23.847559 159859 main.go:141] libmachine: Using SSH client type: native
I0819 13:48:23.847865 159859 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 38560 <nil> <nil>}
I0819 13:48:23.847876 159859 main.go:141] libmachine: About to run SSH command:
hostname
I0819 13:48:23.849133 159859 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:51670->127.0.0.1:38560: read: connection reset by peer
I0819 13:48:26.987702 159859 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-895877
I0819 13:48:26.987728 159859 ubuntu.go:169] provisioning hostname "no-preload-895877"
I0819 13:48:26.987884 159859 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-895877
I0819 13:48:27.011662 159859 main.go:141] libmachine: Using SSH client type: native
I0819 13:48:27.011981 159859 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 38560 <nil> <nil>}
I0819 13:48:27.012001 159859 main.go:141] libmachine: About to run SSH command:
sudo hostname no-preload-895877 && echo "no-preload-895877" | sudo tee /etc/hostname
I0819 13:48:27.161893 159859 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-895877
I0819 13:48:27.161993 159859 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-895877
I0819 13:48:27.184819 159859 main.go:141] libmachine: Using SSH client type: native
I0819 13:48:27.185077 159859 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 38560 <nil> <nil>}
I0819 13:48:27.185102 159859 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-895877' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-895877/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-895877' | sudo tee -a /etc/hosts;
fi
fi
I0819 13:48:27.320264 159859 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0819 13:48:27.320292 159859 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19479-4141166/.minikube CaCertPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19479-4141166/.minikube}
I0819 13:48:27.320326 159859 ubuntu.go:177] setting up certificates
I0819 13:48:27.320336 159859 provision.go:84] configureAuth start
I0819 13:48:27.320406 159859 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-895877
I0819 13:48:27.338774 159859 provision.go:143] copyHostCerts
I0819 13:48:27.338848 159859 exec_runner.go:144] found /home/jenkins/minikube-integration/19479-4141166/.minikube/ca.pem, removing ...
I0819 13:48:27.338864 159859 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19479-4141166/.minikube/ca.pem
I0819 13:48:27.338944 159859 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19479-4141166/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19479-4141166/.minikube/ca.pem (1082 bytes)
I0819 13:48:27.339112 159859 exec_runner.go:144] found /home/jenkins/minikube-integration/19479-4141166/.minikube/cert.pem, removing ...
I0819 13:48:27.339126 159859 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19479-4141166/.minikube/cert.pem
I0819 13:48:27.339160 159859 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19479-4141166/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19479-4141166/.minikube/cert.pem (1123 bytes)
I0819 13:48:27.339227 159859 exec_runner.go:144] found /home/jenkins/minikube-integration/19479-4141166/.minikube/key.pem, removing ...
I0819 13:48:27.339236 159859 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19479-4141166/.minikube/key.pem
I0819 13:48:27.339261 159859 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19479-4141166/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19479-4141166/.minikube/key.pem (1675 bytes)
I0819 13:48:27.339316 159859 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19479-4141166/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19479-4141166/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19479-4141166/.minikube/certs/ca-key.pem org=jenkins.no-preload-895877 san=[127.0.0.1 192.168.85.2 localhost minikube no-preload-895877]
I0819 13:48:28.251915 159859 provision.go:177] copyRemoteCerts
I0819 13:48:28.251993 159859 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0819 13:48:28.252052 159859 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-895877
I0819 13:48:28.277952 159859 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38560 SSHKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/machines/no-preload-895877/id_rsa Username:docker}
I0819 13:48:28.377778 159859 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0819 13:48:28.405031 159859 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0819 13:48:28.440875 159859 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0819 13:48:28.466770 159859 provision.go:87] duration metric: took 1.146416294s to configureAuth
I0819 13:48:28.466797 159859 ubuntu.go:193] setting minikube options for container-runtime
I0819 13:48:28.466997 159859 config.go:182] Loaded profile config "no-preload-895877": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0819 13:48:28.467010 159859 machine.go:96] duration metric: took 4.650119053s to provisionDockerMachine
I0819 13:48:28.467019 159859 start.go:293] postStartSetup for "no-preload-895877" (driver="docker")
I0819 13:48:28.467034 159859 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0819 13:48:28.467093 159859 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0819 13:48:28.467136 159859 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-895877
I0819 13:48:28.486081 159859 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38560 SSHKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/machines/no-preload-895877/id_rsa Username:docker}
I0819 13:48:28.581396 159859 ssh_runner.go:195] Run: cat /etc/os-release
I0819 13:48:28.585114 159859 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0819 13:48:28.585151 159859 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0819 13:48:28.585162 159859 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0819 13:48:28.585170 159859 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0819 13:48:28.585180 159859 filesync.go:126] Scanning /home/jenkins/minikube-integration/19479-4141166/.minikube/addons for local assets ...
I0819 13:48:28.585241 159859 filesync.go:126] Scanning /home/jenkins/minikube-integration/19479-4141166/.minikube/files for local assets ...
I0819 13:48:28.585325 159859 filesync.go:149] local asset: /home/jenkins/minikube-integration/19479-4141166/.minikube/files/etc/ssl/certs/41465472.pem -> 41465472.pem in /etc/ssl/certs
I0819 13:48:28.585443 159859 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0819 13:48:28.594870 159859 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/files/etc/ssl/certs/41465472.pem --> /etc/ssl/certs/41465472.pem (1708 bytes)
I0819 13:48:28.620940 159859 start.go:296] duration metric: took 153.899866ms for postStartSetup
I0819 13:48:28.621080 159859 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0819 13:48:28.621149 159859 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-895877
I0819 13:48:28.639991 159859 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38560 SSHKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/machines/no-preload-895877/id_rsa Username:docker}
I0819 13:48:28.729482 159859 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0819 13:48:28.734389 159859 fix.go:56] duration metric: took 5.351026132s for fixHost
I0819 13:48:28.734420 159859 start.go:83] releasing machines lock for "no-preload-895877", held for 5.351090804s
I0819 13:48:28.734496 159859 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-895877
I0819 13:48:28.751955 159859 ssh_runner.go:195] Run: cat /version.json
I0819 13:48:28.751983 159859 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0819 13:48:28.752013 159859 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-895877
I0819 13:48:28.752053 159859 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-895877
I0819 13:48:28.770446 159859 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38560 SSHKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/machines/no-preload-895877/id_rsa Username:docker}
I0819 13:48:28.773397 159859 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38560 SSHKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/machines/no-preload-895877/id_rsa Username:docker}
I0819 13:48:29.013451 159859 ssh_runner.go:195] Run: systemctl --version
I0819 13:48:29.018290 159859 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0819 13:48:29.023207 159859 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0819 13:48:29.046651 159859 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0819 13:48:29.046747 159859 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0819 13:48:29.056736 159859 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0819 13:48:29.056803 159859 start.go:495] detecting cgroup driver to use...
I0819 13:48:29.056844 159859 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0819 13:48:29.056902 159859 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0819 13:48:29.071640 159859 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0819 13:48:29.084803 159859 docker.go:217] disabling cri-docker service (if available) ...
I0819 13:48:29.084878 159859 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0819 13:48:29.098236 159859 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0819 13:48:29.110467 159859 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0819 13:48:29.194791 159859 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0819 13:48:29.290308 159859 docker.go:233] disabling docker service ...
I0819 13:48:29.290377 159859 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0819 13:48:29.306239 159859 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0819 13:48:29.321712 159859 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0819 13:48:29.421775 159859 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0819 13:48:29.518912 159859 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0819 13:48:29.537685 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0819 13:48:29.555752 159859 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0819 13:48:29.567178 159859 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0819 13:48:29.577940 159859 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0819 13:48:29.578060 159859 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0819 13:48:29.588606 159859 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0819 13:48:29.599578 159859 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0819 13:48:29.610152 159859 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0819 13:48:29.620814 159859 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0819 13:48:29.630821 159859 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0819 13:48:29.641816 159859 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0819 13:48:29.651992 159859 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0819 13:48:29.662490 159859 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0819 13:48:29.671917 159859 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0819 13:48:29.680568 159859 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0819 13:48:29.770563 159859 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0819 13:48:29.945992 159859 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0819 13:48:29.946064 159859 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0819 13:48:29.949921 159859 start.go:563] Will wait 60s for crictl version
I0819 13:48:29.949986 159859 ssh_runner.go:195] Run: which crictl
I0819 13:48:29.953488 159859 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0819 13:48:29.995094 159859 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.20
RuntimeApiVersion: v1
I0819 13:48:29.995163 159859 ssh_runner.go:195] Run: containerd --version
I0819 13:48:30.057384 159859 ssh_runner.go:195] Run: containerd --version
I0819 13:48:30.097682 159859 out.go:177] * Preparing Kubernetes v1.31.0 on containerd 1.7.20 ...
I0819 13:48:26.932620 152452 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:29.428314 152452 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:30.100749 159859 cli_runner.go:164] Run: docker network inspect no-preload-895877 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0819 13:48:30.119962 159859 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0819 13:48:30.124878 159859 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0819 13:48:30.139723 159859 kubeadm.go:883] updating cluster {Name:no-preload-895877 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:no-preload-895877 Namespace:default APIServerHAVIP: APIServerName:minikubeCA API
ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenk
ins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0819 13:48:30.139936 159859 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0819 13:48:30.139995 159859 ssh_runner.go:195] Run: sudo crictl images --output json
I0819 13:48:30.184142 159859 containerd.go:627] all images are preloaded for containerd runtime.
I0819 13:48:30.184170 159859 cache_images.go:84] Images are preloaded, skipping loading
I0819 13:48:30.184179 159859 kubeadm.go:934] updating node { 192.168.85.2 8443 v1.31.0 containerd true true} ...
I0819 13:48:30.184345 159859 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=no-preload-895877 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.31.0 ClusterName:no-preload-895877 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0819 13:48:30.184424 159859 ssh_runner.go:195] Run: sudo crictl info
I0819 13:48:30.233266 159859 cni.go:84] Creating CNI manager for ""
I0819 13:48:30.233293 159859 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0819 13:48:30.233306 159859 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0819 13:48:30.233363 159859 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.31.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-895877 NodeName:no-preload-895877 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodP
ath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0819 13:48:30.233518 159859 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "no-preload-895877"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0819 13:48:30.233592 159859 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.0
I0819 13:48:30.244384 159859 binaries.go:44] Found k8s binaries, skipping transfer
I0819 13:48:30.244461 159859 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0819 13:48:30.253829 159859 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (321 bytes)
I0819 13:48:30.274896 159859 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0819 13:48:30.294265 159859 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2171 bytes)
I0819 13:48:30.315410 159859 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0819 13:48:30.319072 159859 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0819 13:48:30.331376 159859 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0819 13:48:30.431565 159859 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0819 13:48:30.447573 159859 certs.go:68] Setting up /home/jenkins/minikube-integration/19479-4141166/.minikube/profiles/no-preload-895877 for IP: 192.168.85.2
I0819 13:48:30.447642 159859 certs.go:194] generating shared ca certs ...
I0819 13:48:30.447675 159859 certs.go:226] acquiring lock for ca certs: {Name:mkb3362db9c120e28de14409a94f066387768cf1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 13:48:30.447886 159859 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19479-4141166/.minikube/ca.key
I0819 13:48:30.447982 159859 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19479-4141166/.minikube/proxy-client-ca.key
I0819 13:48:30.448012 159859 certs.go:256] generating profile certs ...
I0819 13:48:30.448143 159859 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19479-4141166/.minikube/profiles/no-preload-895877/client.key
I0819 13:48:30.448247 159859 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19479-4141166/.minikube/profiles/no-preload-895877/apiserver.key.6d2bf100
I0819 13:48:30.448328 159859 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19479-4141166/.minikube/profiles/no-preload-895877/proxy-client.key
I0819 13:48:30.448491 159859 certs.go:484] found cert: /home/jenkins/minikube-integration/19479-4141166/.minikube/certs/4146547.pem (1338 bytes)
W0819 13:48:30.448556 159859 certs.go:480] ignoring /home/jenkins/minikube-integration/19479-4141166/.minikube/certs/4146547_empty.pem, impossibly tiny 0 bytes
I0819 13:48:30.448582 159859 certs.go:484] found cert: /home/jenkins/minikube-integration/19479-4141166/.minikube/certs/ca-key.pem (1675 bytes)
I0819 13:48:30.448640 159859 certs.go:484] found cert: /home/jenkins/minikube-integration/19479-4141166/.minikube/certs/ca.pem (1082 bytes)
I0819 13:48:30.448708 159859 certs.go:484] found cert: /home/jenkins/minikube-integration/19479-4141166/.minikube/certs/cert.pem (1123 bytes)
I0819 13:48:30.448773 159859 certs.go:484] found cert: /home/jenkins/minikube-integration/19479-4141166/.minikube/certs/key.pem (1675 bytes)
I0819 13:48:30.448864 159859 certs.go:484] found cert: /home/jenkins/minikube-integration/19479-4141166/.minikube/files/etc/ssl/certs/41465472.pem (1708 bytes)
I0819 13:48:30.449782 159859 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0819 13:48:30.482666 159859 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0819 13:48:30.513124 159859 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0819 13:48:30.561401 159859 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0819 13:48:30.594308 159859 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/profiles/no-preload-895877/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0819 13:48:30.626186 159859 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/profiles/no-preload-895877/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0819 13:48:30.655405 159859 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/profiles/no-preload-895877/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0819 13:48:30.681061 159859 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/profiles/no-preload-895877/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0819 13:48:30.715833 159859 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/certs/4146547.pem --> /usr/share/ca-certificates/4146547.pem (1338 bytes)
I0819 13:48:30.755853 159859 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/files/etc/ssl/certs/41465472.pem --> /usr/share/ca-certificates/41465472.pem (1708 bytes)
I0819 13:48:30.785092 159859 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-4141166/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0819 13:48:30.814608 159859 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0819 13:48:30.833983 159859 ssh_runner.go:195] Run: openssl version
I0819 13:48:30.842737 159859 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/4146547.pem && ln -fs /usr/share/ca-certificates/4146547.pem /etc/ssl/certs/4146547.pem"
I0819 13:48:30.853628 159859 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/4146547.pem
I0819 13:48:30.857335 159859 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 19 13:06 /usr/share/ca-certificates/4146547.pem
I0819 13:48:30.857422 159859 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/4146547.pem
I0819 13:48:30.865319 159859 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/4146547.pem /etc/ssl/certs/51391683.0"
I0819 13:48:30.874681 159859 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/41465472.pem && ln -fs /usr/share/ca-certificates/41465472.pem /etc/ssl/certs/41465472.pem"
I0819 13:48:30.884432 159859 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/41465472.pem
I0819 13:48:30.888733 159859 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 19 13:06 /usr/share/ca-certificates/41465472.pem
I0819 13:48:30.888804 159859 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/41465472.pem
I0819 13:48:30.897649 159859 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/41465472.pem /etc/ssl/certs/3ec20f2e.0"
I0819 13:48:30.906721 159859 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0819 13:48:30.916450 159859 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0819 13:48:30.920177 159859 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 19 12:56 /usr/share/ca-certificates/minikubeCA.pem
I0819 13:48:30.920283 159859 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0819 13:48:30.928467 159859 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0819 13:48:30.938078 159859 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0819 13:48:30.941924 159859 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0819 13:48:30.949058 159859 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0819 13:48:30.956250 159859 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0819 13:48:30.963360 159859 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0819 13:48:30.970754 159859 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0819 13:48:30.978177 159859 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0819 13:48:30.985988 159859 kubeadm.go:392] StartCluster: {Name:no-preload-895877 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:no-preload-895877 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins
:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0819 13:48:30.986089 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0819 13:48:30.986171 159859 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0819 13:48:31.043608 159859 cri.go:89] found id: "6f5b16f013f8d9677cb7b065862e53df5d82fd3fc59a75567ab2b934b923bafd"
I0819 13:48:31.043630 159859 cri.go:89] found id: "72f86ce2e020cf467a960cedb19e56cde7e0f6cf8509a46304c45072f11a64a2"
I0819 13:48:31.043636 159859 cri.go:89] found id: "6b9abbc8ffb0d57218a397dad761cf2aff19c9771afaf4600ebc8c066ec59d5a"
I0819 13:48:31.043650 159859 cri.go:89] found id: "d144fb57c1f864d402cb71f0708356473c2ebcf103514d671338129531d25e14"
I0819 13:48:31.043654 159859 cri.go:89] found id: "ff22ac16052d2c43ed9793c39a004d6a1901a8669144d994e07415585f265b2b"
I0819 13:48:31.043658 159859 cri.go:89] found id: "c2667c90b1c00f50d02ddaf922cd598827148598792fca8aa690697e65a98744"
I0819 13:48:31.043661 159859 cri.go:89] found id: "7466e02589549507e8614ae43605f4e6f4605606ee4e61167b26d408b8078137"
I0819 13:48:31.043685 159859 cri.go:89] found id: "7dd9e79429542dbb8adda3b3a2334949bacde3c045dfd5a276eb9ece3d9f29ad"
I0819 13:48:31.043694 159859 cri.go:89] found id: ""
I0819 13:48:31.043767 159859 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0819 13:48:31.060844 159859 cri.go:116] JSON = null
W0819 13:48:31.060919 159859 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0819 13:48:31.061041 159859 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0819 13:48:31.074778 159859 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0819 13:48:31.074798 159859 kubeadm.go:593] restartPrimaryControlPlane start ...
I0819 13:48:31.074872 159859 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0819 13:48:31.086119 159859 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0819 13:48:31.086811 159859 kubeconfig.go:47] verify endpoint returned: get endpoint: "no-preload-895877" does not appear in /home/jenkins/minikube-integration/19479-4141166/kubeconfig
I0819 13:48:31.087135 159859 kubeconfig.go:62] /home/jenkins/minikube-integration/19479-4141166/kubeconfig needs updating (will repair): [kubeconfig missing "no-preload-895877" cluster setting kubeconfig missing "no-preload-895877" context setting]
I0819 13:48:31.087678 159859 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19479-4141166/kubeconfig: {Name:mk7b0eea2060f71726f692d0256a33fdf7565e94 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 13:48:31.089213 159859 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0819 13:48:31.104537 159859 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.85.2
I0819 13:48:31.104615 159859 kubeadm.go:597] duration metric: took 29.809734ms to restartPrimaryControlPlane
I0819 13:48:31.104650 159859 kubeadm.go:394] duration metric: took 118.665377ms to StartCluster
I0819 13:48:31.104681 159859 settings.go:142] acquiring lock: {Name:mkaa4019b166703efd95aaa3737397f414197f00 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 13:48:31.104771 159859 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19479-4141166/kubeconfig
I0819 13:48:31.105752 159859 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19479-4141166/kubeconfig: {Name:mk7b0eea2060f71726f692d0256a33fdf7565e94 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 13:48:31.106035 159859 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0819 13:48:31.106387 159859 config.go:182] Loaded profile config "no-preload-895877": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0819 13:48:31.106666 159859 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0819 13:48:31.106781 159859 addons.go:69] Setting storage-provisioner=true in profile "no-preload-895877"
I0819 13:48:31.106806 159859 addons.go:234] Setting addon storage-provisioner=true in "no-preload-895877"
W0819 13:48:31.106813 159859 addons.go:243] addon storage-provisioner should already be in state true
I0819 13:48:31.106837 159859 host.go:66] Checking if "no-preload-895877" exists ...
I0819 13:48:31.107287 159859 cli_runner.go:164] Run: docker container inspect no-preload-895877 --format={{.State.Status}}
I0819 13:48:31.107473 159859 addons.go:69] Setting default-storageclass=true in profile "no-preload-895877"
I0819 13:48:31.107514 159859 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-895877"
I0819 13:48:31.107704 159859 addons.go:69] Setting metrics-server=true in profile "no-preload-895877"
I0819 13:48:31.107738 159859 addons.go:234] Setting addon metrics-server=true in "no-preload-895877"
W0819 13:48:31.107752 159859 addons.go:243] addon metrics-server should already be in state true
I0819 13:48:31.107800 159859 host.go:66] Checking if "no-preload-895877" exists ...
I0819 13:48:31.107906 159859 cli_runner.go:164] Run: docker container inspect no-preload-895877 --format={{.State.Status}}
I0819 13:48:31.108207 159859 cli_runner.go:164] Run: docker container inspect no-preload-895877 --format={{.State.Status}}
I0819 13:48:31.110728 159859 out.go:177] * Verifying Kubernetes components...
I0819 13:48:31.110843 159859 addons.go:69] Setting dashboard=true in profile "no-preload-895877"
I0819 13:48:31.110907 159859 addons.go:234] Setting addon dashboard=true in "no-preload-895877"
W0819 13:48:31.110935 159859 addons.go:243] addon dashboard should already be in state true
I0819 13:48:31.110984 159859 host.go:66] Checking if "no-preload-895877" exists ...
I0819 13:48:31.111470 159859 cli_runner.go:164] Run: docker container inspect no-preload-895877 --format={{.State.Status}}
I0819 13:48:31.116236 159859 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0819 13:48:31.160705 159859 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0819 13:48:31.164046 159859 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0819 13:48:31.164074 159859 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0819 13:48:31.164144 159859 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-895877
I0819 13:48:31.167098 159859 addons.go:234] Setting addon default-storageclass=true in "no-preload-895877"
W0819 13:48:31.167120 159859 addons.go:243] addon default-storageclass should already be in state true
I0819 13:48:31.167147 159859 host.go:66] Checking if "no-preload-895877" exists ...
I0819 13:48:31.167578 159859 cli_runner.go:164] Run: docker container inspect no-preload-895877 --format={{.State.Status}}
I0819 13:48:31.217117 159859 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0819 13:48:31.221158 159859 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0819 13:48:31.221186 159859 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0819 13:48:31.221261 159859 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-895877
I0819 13:48:31.234983 159859 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0819 13:48:31.237698 159859 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0819 13:48:31.240510 159859 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0819 13:48:31.240536 159859 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0819 13:48:31.240613 159859 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-895877
I0819 13:48:31.249998 159859 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38560 SSHKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/machines/no-preload-895877/id_rsa Username:docker}
I0819 13:48:31.255585 159859 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0819 13:48:31.255605 159859 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0819 13:48:31.255667 159859 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-895877
I0819 13:48:31.293351 159859 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38560 SSHKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/machines/no-preload-895877/id_rsa Username:docker}
I0819 13:48:31.305403 159859 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38560 SSHKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/machines/no-preload-895877/id_rsa Username:docker}
I0819 13:48:31.311379 159859 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38560 SSHKeyPath:/home/jenkins/minikube-integration/19479-4141166/.minikube/machines/no-preload-895877/id_rsa Username:docker}
I0819 13:48:31.365493 159859 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0819 13:48:31.433554 159859 node_ready.go:35] waiting up to 6m0s for node "no-preload-895877" to be "Ready" ...
I0819 13:48:31.511511 159859 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0819 13:48:31.540279 159859 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0819 13:48:31.540353 159859 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0819 13:48:31.612644 159859 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0819 13:48:31.630754 159859 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0819 13:48:31.630824 159859 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0819 13:48:31.651896 159859 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0819 13:48:31.651977 159859 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0819 13:48:31.731552 159859 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0819 13:48:31.731629 159859 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0819 13:48:31.765553 159859 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0819 13:48:31.765633 159859 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0819 13:48:31.772876 159859 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0819 13:48:31.772954 159859 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0819 13:48:31.819465 159859 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0819 13:48:31.851050 159859 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0819 13:48:31.851070 159859 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
W0819 13:48:31.997474 159859 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0819 13:48:31.997562 159859 retry.go:31] will retry after 288.63713ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W0819 13:48:32.106678 159859 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0819 13:48:32.106759 159859 retry.go:31] will retry after 133.564512ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0819 13:48:32.176528 159859 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0819 13:48:32.176603 159859 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0819 13:48:32.241034 159859 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0819 13:48:32.286791 159859 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0819 13:48:32.322509 159859 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0819 13:48:32.322535 159859 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0819 13:48:32.382486 159859 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0819 13:48:32.382513 159859 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0819 13:48:32.546197 159859 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0819 13:48:32.546225 159859 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0819 13:48:32.671774 159859 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0819 13:48:32.671846 159859 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0819 13:48:32.782065 159859 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0819 13:48:31.928244 152452 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:33.928780 152452 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:34.928259 152452 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-914579" in "kube-system" namespace has status "Ready":"True"
I0819 13:48:34.928291 152452 pod_ready.go:82] duration metric: took 10.006741707s for pod "kube-scheduler-old-k8s-version-914579" in "kube-system" namespace to be "Ready" ...
I0819 13:48:34.928304 152452 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace to be "Ready" ...
I0819 13:48:36.639325 159859 node_ready.go:49] node "no-preload-895877" has status "Ready":"True"
I0819 13:48:36.639355 159859 node_ready.go:38] duration metric: took 5.205723105s for node "no-preload-895877" to be "Ready" ...
I0819 13:48:36.639366 159859 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0819 13:48:36.759851 159859 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-fgrp5" in "kube-system" namespace to be "Ready" ...
I0819 13:48:36.821739 159859 pod_ready.go:93] pod "coredns-6f6b679f8f-fgrp5" in "kube-system" namespace has status "Ready":"True"
I0819 13:48:36.821769 159859 pod_ready.go:82] duration metric: took 61.88001ms for pod "coredns-6f6b679f8f-fgrp5" in "kube-system" namespace to be "Ready" ...
I0819 13:48:36.821782 159859 pod_ready.go:79] waiting up to 6m0s for pod "etcd-no-preload-895877" in "kube-system" namespace to be "Ready" ...
I0819 13:48:36.838273 159859 pod_ready.go:93] pod "etcd-no-preload-895877" in "kube-system" namespace has status "Ready":"True"
I0819 13:48:36.838309 159859 pod_ready.go:82] duration metric: took 16.518883ms for pod "etcd-no-preload-895877" in "kube-system" namespace to be "Ready" ...
I0819 13:48:36.838324 159859 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-no-preload-895877" in "kube-system" namespace to be "Ready" ...
I0819 13:48:36.897225 159859 pod_ready.go:93] pod "kube-apiserver-no-preload-895877" in "kube-system" namespace has status "Ready":"True"
I0819 13:48:36.897251 159859 pod_ready.go:82] duration metric: took 58.91993ms for pod "kube-apiserver-no-preload-895877" in "kube-system" namespace to be "Ready" ...
I0819 13:48:36.897265 159859 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-no-preload-895877" in "kube-system" namespace to be "Ready" ...
I0819 13:48:36.931093 159859 pod_ready.go:93] pod "kube-controller-manager-no-preload-895877" in "kube-system" namespace has status "Ready":"True"
I0819 13:48:36.931119 159859 pod_ready.go:82] duration metric: took 33.846974ms for pod "kube-controller-manager-no-preload-895877" in "kube-system" namespace to be "Ready" ...
I0819 13:48:36.931133 159859 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-9q48v" in "kube-system" namespace to be "Ready" ...
I0819 13:48:36.990754 159859 pod_ready.go:93] pod "kube-proxy-9q48v" in "kube-system" namespace has status "Ready":"True"
I0819 13:48:36.990789 159859 pod_ready.go:82] duration metric: took 59.648966ms for pod "kube-proxy-9q48v" in "kube-system" namespace to be "Ready" ...
I0819 13:48:36.990801 159859 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-no-preload-895877" in "kube-system" namespace to be "Ready" ...
I0819 13:48:37.245777 159859 pod_ready.go:93] pod "kube-scheduler-no-preload-895877" in "kube-system" namespace has status "Ready":"True"
I0819 13:48:37.245805 159859 pod_ready.go:82] duration metric: took 254.996306ms for pod "kube-scheduler-no-preload-895877" in "kube-system" namespace to be "Ready" ...
I0819 13:48:37.245818 159859 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace to be "Ready" ...
I0819 13:48:39.253176 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:40.292845 159859 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.473338045s)
I0819 13:48:40.292879 159859 addons.go:475] Verifying addon metrics-server=true in "no-preload-895877"
I0819 13:48:40.292915 159859 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (8.051807446s)
I0819 13:48:40.414318 159859 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (8.127443297s)
I0819 13:48:40.538107 159859 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (7.755984289s)
I0819 13:48:40.540658 159859 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p no-preload-895877 addons enable metrics-server
I0819 13:48:40.543592 159859 out.go:177] * Enabled addons: metrics-server, default-storageclass, storage-provisioner, dashboard
I0819 13:48:36.934720 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:38.962296 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:40.546196 159859 addons.go:510] duration metric: took 9.439531097s for enable addons: enabled=[metrics-server default-storageclass storage-provisioner dashboard]
I0819 13:48:41.253544 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:41.433908 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:43.435418 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:43.751681 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:45.751936 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:45.934634 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:48.434821 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:48.256450 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:50.751871 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:52.752231 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:50.934608 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:52.934845 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:55.433832 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:55.252312 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:57.751987 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:57.434466 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:59.434579 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:48:59.752098 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:01.754240 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:01.934503 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:03.934901 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:04.253030 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:06.253609 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:06.435134 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:08.934952 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:08.752272 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:10.752789 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:11.434322 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:13.434874 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:13.252783 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:15.756579 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:15.934454 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:18.435150 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:18.254223 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:20.752470 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:20.935216 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:23.434770 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:25.434829 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:23.252128 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:25.751944 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:27.752479 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:27.934477 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:29.934921 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:29.752613 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:32.251975 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:32.434702 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:34.936027 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:34.252591 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:36.252850 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:37.434753 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:39.492846 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:38.751694 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:40.752753 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:41.934580 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:43.935230 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:43.252825 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:45.264347 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:47.752029 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:45.935307 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:48.435447 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:50.251323 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:52.252894 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:50.935387 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:53.434796 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:54.253140 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:56.752233 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:55.935376 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:58.434485 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:00.466805 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:49:59.252022 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:01.256104 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:02.935170 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:04.935322 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:03.752302 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:06.253451 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:07.434833 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:09.936204 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:08.253573 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:10.752710 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:12.434526 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:14.935092 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:13.252889 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:15.753254 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:16.935611 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:19.433957 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:18.252325 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:20.753297 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:21.438984 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:23.934582 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:23.252841 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:25.752377 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:25.935760 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:28.434454 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:30.436079 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:28.252194 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:30.252743 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:32.752444 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:32.934427 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:34.934763 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:34.752631 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:37.252322 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:36.935055 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:39.435039 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:39.752027 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:41.759765 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:41.435936 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:43.934346 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:44.253068 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:46.752621 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:45.935139 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:47.935651 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:50.434768 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:49.251910 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:51.252221 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:52.435137 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:54.934726 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:53.252499 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:55.252709 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:57.751681 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:57.434128 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:59.935544 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:50:59.752200 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:01.752510 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:01.936231 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:04.434264 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:04.252618 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:06.751606 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:06.441299 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:08.934048 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:08.753239 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:11.253501 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:10.934468 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:12.934719 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:15.434024 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:13.752777 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:16.252992 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:17.438817 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:19.935273 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:18.254096 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:20.752336 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:21.936911 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:24.434460 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:23.252020 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:25.752107 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:27.752290 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:26.935401 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:29.434401 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:30.252267 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:32.756406 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:31.435212 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:33.935129 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:35.253151 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:37.752395 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:36.434032 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:38.434748 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:39.753032 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:42.255583 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:40.935437 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:43.434596 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:45.435727 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:44.752347 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:47.252795 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:47.934998 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:49.935071 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:49.751936 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:51.752716 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:51.935315 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:54.434496 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:54.251697 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:56.252610 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:56.434591 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:58.434895 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:00.492651 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:51:58.252826 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:00.361946 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:02.752354 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:02.934662 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:05.434898 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:05.252886 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:07.752220 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:07.934929 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:09.935287 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:10.252746 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:12.253297 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:12.434870 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:14.934271 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:14.752180 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:17.251910 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:16.935007 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:18.937904 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:19.752199 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:21.752631 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:21.434619 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:23.434906 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:24.252905 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:26.254234 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:25.934891 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:28.435242 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:28.752021 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:30.752630 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:32.754409 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:30.935637 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:33.439917 152452 pod_ready.go:103] pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:34.935755 152452 pod_ready.go:82] duration metric: took 4m0.007436285s for pod "metrics-server-9975d5f86-ncd6r" in "kube-system" namespace to be "Ready" ...
E0819 13:52:34.935829 152452 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I0819 13:52:34.935840 152452 pod_ready.go:39] duration metric: took 5m26.260504475s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0819 13:52:34.935859 152452 api_server.go:52] waiting for apiserver process to appear ...
I0819 13:52:34.935897 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0819 13:52:34.935964 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0819 13:52:34.983562 152452 cri.go:89] found id: "b779c421112b8e180714c33a49f2622b00391462fc2a2bfb51100d7824fdb234"
I0819 13:52:34.983594 152452 cri.go:89] found id: "fcd65a8439964dae437d73a25791d2c38189fd5f9e340dc4e33ca0cc390524ef"
I0819 13:52:34.983600 152452 cri.go:89] found id: ""
I0819 13:52:34.983607 152452 logs.go:276] 2 containers: [b779c421112b8e180714c33a49f2622b00391462fc2a2bfb51100d7824fdb234 fcd65a8439964dae437d73a25791d2c38189fd5f9e340dc4e33ca0cc390524ef]
I0819 13:52:34.983673 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:34.987405 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:34.991212 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0819 13:52:34.991322 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0819 13:52:35.038233 152452 cri.go:89] found id: "a93e658c9c6602282efd1636668d5404651e1df0eaba230af4e0430877ea618d"
I0819 13:52:35.038256 152452 cri.go:89] found id: "6c7959865023d5c1d31e7b8c33d4dca318c0b748bfd18163a76a3658248a339d"
I0819 13:52:35.038261 152452 cri.go:89] found id: ""
I0819 13:52:35.038269 152452 logs.go:276] 2 containers: [a93e658c9c6602282efd1636668d5404651e1df0eaba230af4e0430877ea618d 6c7959865023d5c1d31e7b8c33d4dca318c0b748bfd18163a76a3658248a339d]
I0819 13:52:35.038330 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.042886 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.047062 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0819 13:52:35.047139 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0819 13:52:35.088211 152452 cri.go:89] found id: "2c334d0b02f94acf867081f56ef726d597384f48a9f72e1851695738231ec36d"
I0819 13:52:35.088252 152452 cri.go:89] found id: "8344283822b374d886d00d290f18631a7790271c48c1d318d5b00a1cf12609a5"
I0819 13:52:35.088258 152452 cri.go:89] found id: ""
I0819 13:52:35.088268 152452 logs.go:276] 2 containers: [2c334d0b02f94acf867081f56ef726d597384f48a9f72e1851695738231ec36d 8344283822b374d886d00d290f18631a7790271c48c1d318d5b00a1cf12609a5]
I0819 13:52:35.088394 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.092837 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.097676 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0819 13:52:35.097870 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0819 13:52:35.144630 152452 cri.go:89] found id: "db9a1d56a8be5f2c08c944dc19babddbd855957ea6d3d8e032408575130a610c"
I0819 13:52:35.144652 152452 cri.go:89] found id: "c2b76e34da1effdab4751291934d76bf6fae4d64b9a57c2e308028866ca67cc7"
I0819 13:52:35.144657 152452 cri.go:89] found id: ""
I0819 13:52:35.144665 152452 logs.go:276] 2 containers: [db9a1d56a8be5f2c08c944dc19babddbd855957ea6d3d8e032408575130a610c c2b76e34da1effdab4751291934d76bf6fae4d64b9a57c2e308028866ca67cc7]
I0819 13:52:35.144726 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.148679 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.152190 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0819 13:52:35.152273 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0819 13:52:35.196608 152452 cri.go:89] found id: "024882e3d4a5aa678ba55df81b6f10533d9f05f6977090d57dc692926959b303"
I0819 13:52:35.196690 152452 cri.go:89] found id: "d8e9102405c0bfd7286b17e5f2348226ea534b03ab646ed8bc5c514f697bdd28"
I0819 13:52:35.196704 152452 cri.go:89] found id: ""
I0819 13:52:35.196713 152452 logs.go:276] 2 containers: [024882e3d4a5aa678ba55df81b6f10533d9f05f6977090d57dc692926959b303 d8e9102405c0bfd7286b17e5f2348226ea534b03ab646ed8bc5c514f697bdd28]
I0819 13:52:35.196773 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.201290 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.204963 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0819 13:52:35.205039 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0819 13:52:35.249246 152452 cri.go:89] found id: "fa88625298f23e335aba94d646c993344de4ef6b8da759e9d9f176ae78f9a1fe"
I0819 13:52:35.249266 152452 cri.go:89] found id: "ff300c34901ca29544018036fcfb1d22bafcc0bace0dcf64fe0bd253b66ef58e"
I0819 13:52:35.249271 152452 cri.go:89] found id: ""
I0819 13:52:35.249279 152452 logs.go:276] 2 containers: [fa88625298f23e335aba94d646c993344de4ef6b8da759e9d9f176ae78f9a1fe ff300c34901ca29544018036fcfb1d22bafcc0bace0dcf64fe0bd253b66ef58e]
I0819 13:52:35.249349 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.254569 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.258220 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0819 13:52:35.258299 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0819 13:52:35.300607 152452 cri.go:89] found id: "c846487e7ff859548debeb2531a1f0b42651196f23aa0606336373cbd8cc2cb4"
I0819 13:52:35.300633 152452 cri.go:89] found id: "765975197bf640c76b530d4282ed5d13d03238e0ae93cd4aca67241e2f5152e9"
I0819 13:52:35.300638 152452 cri.go:89] found id: ""
I0819 13:52:35.300646 152452 logs.go:276] 2 containers: [c846487e7ff859548debeb2531a1f0b42651196f23aa0606336373cbd8cc2cb4 765975197bf640c76b530d4282ed5d13d03238e0ae93cd4aca67241e2f5152e9]
I0819 13:52:35.300704 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.304359 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.307967 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0819 13:52:35.308109 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0819 13:52:35.359383 152452 cri.go:89] found id: "65c22339ea6f7f88b4be1592c18662038b27eacd8db0d2a2f924fadc09a4238b"
I0819 13:52:35.359409 152452 cri.go:89] found id: "13a46bd05c3c5fdc6450ed883a254f38627921b9e47309563f0258e3056dc8fa"
I0819 13:52:35.359414 152452 cri.go:89] found id: ""
I0819 13:52:35.359422 152452 logs.go:276] 2 containers: [65c22339ea6f7f88b4be1592c18662038b27eacd8db0d2a2f924fadc09a4238b 13a46bd05c3c5fdc6450ed883a254f38627921b9e47309563f0258e3056dc8fa]
I0819 13:52:35.359535 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.363613 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.367561 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0819 13:52:35.367641 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0819 13:52:35.406825 152452 cri.go:89] found id: "15bd5cc6d84b0d0c4efce828950c59f373f1bc865ae66f1949d2eef2c9a95b75"
I0819 13:52:35.406849 152452 cri.go:89] found id: ""
I0819 13:52:35.406857 152452 logs.go:276] 1 containers: [15bd5cc6d84b0d0c4efce828950c59f373f1bc865ae66f1949d2eef2c9a95b75]
I0819 13:52:35.406914 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:35.410940 152452 logs.go:123] Gathering logs for storage-provisioner [13a46bd05c3c5fdc6450ed883a254f38627921b9e47309563f0258e3056dc8fa] ...
I0819 13:52:35.410966 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 13a46bd05c3c5fdc6450ed883a254f38627921b9e47309563f0258e3056dc8fa"
I0819 13:52:35.465154 152452 logs.go:123] Gathering logs for containerd ...
I0819 13:52:35.465182 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0819 13:52:35.532935 152452 logs.go:123] Gathering logs for kube-apiserver [fcd65a8439964dae437d73a25791d2c38189fd5f9e340dc4e33ca0cc390524ef] ...
I0819 13:52:35.532976 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fcd65a8439964dae437d73a25791d2c38189fd5f9e340dc4e33ca0cc390524ef"
I0819 13:52:35.591317 152452 logs.go:123] Gathering logs for coredns [2c334d0b02f94acf867081f56ef726d597384f48a9f72e1851695738231ec36d] ...
I0819 13:52:35.591395 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2c334d0b02f94acf867081f56ef726d597384f48a9f72e1851695738231ec36d"
I0819 13:52:35.650002 152452 logs.go:123] Gathering logs for kube-scheduler [c2b76e34da1effdab4751291934d76bf6fae4d64b9a57c2e308028866ca67cc7] ...
I0819 13:52:35.650029 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c2b76e34da1effdab4751291934d76bf6fae4d64b9a57c2e308028866ca67cc7"
I0819 13:52:35.700068 152452 logs.go:123] Gathering logs for kube-proxy [024882e3d4a5aa678ba55df81b6f10533d9f05f6977090d57dc692926959b303] ...
I0819 13:52:35.700098 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 024882e3d4a5aa678ba55df81b6f10533d9f05f6977090d57dc692926959b303"
I0819 13:52:35.746365 152452 logs.go:123] Gathering logs for kindnet [765975197bf640c76b530d4282ed5d13d03238e0ae93cd4aca67241e2f5152e9] ...
I0819 13:52:35.746394 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 765975197bf640c76b530d4282ed5d13d03238e0ae93cd4aca67241e2f5152e9"
I0819 13:52:35.798143 152452 logs.go:123] Gathering logs for kubernetes-dashboard [15bd5cc6d84b0d0c4efce828950c59f373f1bc865ae66f1949d2eef2c9a95b75] ...
I0819 13:52:35.798174 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 15bd5cc6d84b0d0c4efce828950c59f373f1bc865ae66f1949d2eef2c9a95b75"
I0819 13:52:35.839938 152452 logs.go:123] Gathering logs for kubelet ...
I0819 13:52:35.839967 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0819 13:52:35.253341 159859 pod_ready.go:103] pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace has status "Ready":"False"
I0819 13:52:37.252374 159859 pod_ready.go:82] duration metric: took 4m0.006540359s for pod "metrics-server-6867b74b74-jhj2b" in "kube-system" namespace to be "Ready" ...
E0819 13:52:37.252406 159859 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I0819 13:52:37.252416 159859 pod_ready.go:39] duration metric: took 4m0.613038721s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0819 13:52:37.252430 159859 api_server.go:52] waiting for apiserver process to appear ...
I0819 13:52:37.252461 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0819 13:52:37.252519 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0819 13:52:37.293044 159859 cri.go:89] found id: "31427da9f6f535c6d8c0bfe81742ea748ad4b6e794d6f5a32b75e28cfdda811f"
I0819 13:52:37.293067 159859 cri.go:89] found id: "ff22ac16052d2c43ed9793c39a004d6a1901a8669144d994e07415585f265b2b"
I0819 13:52:37.293073 159859 cri.go:89] found id: ""
I0819 13:52:37.293081 159859 logs.go:276] 2 containers: [31427da9f6f535c6d8c0bfe81742ea748ad4b6e794d6f5a32b75e28cfdda811f ff22ac16052d2c43ed9793c39a004d6a1901a8669144d994e07415585f265b2b]
I0819 13:52:37.293160 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:37.297219 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:37.300777 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0819 13:52:37.300897 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0819 13:52:37.341906 159859 cri.go:89] found id: "4e1354ba690cd91d28549484fc0f3383f07194d995caa4d76f819da5e993a297"
I0819 13:52:37.341929 159859 cri.go:89] found id: "c2667c90b1c00f50d02ddaf922cd598827148598792fca8aa690697e65a98744"
I0819 13:52:37.341934 159859 cri.go:89] found id: ""
I0819 13:52:37.341942 159859 logs.go:276] 2 containers: [4e1354ba690cd91d28549484fc0f3383f07194d995caa4d76f819da5e993a297 c2667c90b1c00f50d02ddaf922cd598827148598792fca8aa690697e65a98744]
I0819 13:52:37.342022 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:37.346412 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:37.353190 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0819 13:52:37.353266 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0819 13:52:37.392848 159859 cri.go:89] found id: "28d9baa2b6e93e092f31f623ea40f5dc0b3c07d7117c2886a7a9a34666c927c6"
I0819 13:52:37.392871 159859 cri.go:89] found id: "6f5b16f013f8d9677cb7b065862e53df5d82fd3fc59a75567ab2b934b923bafd"
I0819 13:52:37.392879 159859 cri.go:89] found id: ""
I0819 13:52:37.392887 159859 logs.go:276] 2 containers: [28d9baa2b6e93e092f31f623ea40f5dc0b3c07d7117c2886a7a9a34666c927c6 6f5b16f013f8d9677cb7b065862e53df5d82fd3fc59a75567ab2b934b923bafd]
I0819 13:52:37.392964 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:37.396561 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:37.399721 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0819 13:52:37.399843 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0819 13:52:37.437523 159859 cri.go:89] found id: "494769b089cf99a12deae58e0f27768f8a83fee5c330bd4d796e04286252e9cc"
I0819 13:52:37.437549 159859 cri.go:89] found id: "7466e02589549507e8614ae43605f4e6f4605606ee4e61167b26d408b8078137"
I0819 13:52:37.437554 159859 cri.go:89] found id: ""
I0819 13:52:37.437561 159859 logs.go:276] 2 containers: [494769b089cf99a12deae58e0f27768f8a83fee5c330bd4d796e04286252e9cc 7466e02589549507e8614ae43605f4e6f4605606ee4e61167b26d408b8078137]
I0819 13:52:37.437626 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:37.441414 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:37.444746 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0819 13:52:37.444815 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0819 13:52:37.482649 159859 cri.go:89] found id: "3fabea8e04f6abca30b247c4889af7e3c503181c02673fe407b6feebf8604a07"
I0819 13:52:37.482672 159859 cri.go:89] found id: "d144fb57c1f864d402cb71f0708356473c2ebcf103514d671338129531d25e14"
I0819 13:52:37.482676 159859 cri.go:89] found id: ""
I0819 13:52:37.482684 159859 logs.go:276] 2 containers: [3fabea8e04f6abca30b247c4889af7e3c503181c02673fe407b6feebf8604a07 d144fb57c1f864d402cb71f0708356473c2ebcf103514d671338129531d25e14]
I0819 13:52:37.482741 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:37.486371 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:37.490148 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0819 13:52:37.490221 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0819 13:52:37.541825 159859 cri.go:89] found id: "661f3f8d6b252e80a5c64d55369634b0a08dbd0a66c8d22573770fe6a428c119"
I0819 13:52:37.541849 159859 cri.go:89] found id: "7dd9e79429542dbb8adda3b3a2334949bacde3c045dfd5a276eb9ece3d9f29ad"
I0819 13:52:37.541854 159859 cri.go:89] found id: ""
I0819 13:52:37.541862 159859 logs.go:276] 2 containers: [661f3f8d6b252e80a5c64d55369634b0a08dbd0a66c8d22573770fe6a428c119 7dd9e79429542dbb8adda3b3a2334949bacde3c045dfd5a276eb9ece3d9f29ad]
I0819 13:52:37.541920 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:37.545678 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:37.549199 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0819 13:52:37.549268 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0819 13:52:37.587433 159859 cri.go:89] found id: "885b37e08c80c553570637679785115f4c325b8bec8dc444bd754dab1ee3ce7c"
I0819 13:52:37.587495 159859 cri.go:89] found id: "72f86ce2e020cf467a960cedb19e56cde7e0f6cf8509a46304c45072f11a64a2"
I0819 13:52:37.587525 159859 cri.go:89] found id: ""
I0819 13:52:37.587548 159859 logs.go:276] 2 containers: [885b37e08c80c553570637679785115f4c325b8bec8dc444bd754dab1ee3ce7c 72f86ce2e020cf467a960cedb19e56cde7e0f6cf8509a46304c45072f11a64a2]
I0819 13:52:37.587638 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:37.591405 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:37.595407 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0819 13:52:37.595487 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0819 13:52:37.656301 159859 cri.go:89] found id: "e30b6d2a2ef745c854e592691b57aac843e7d42c5fe1b6897816cbdb178742b1"
I0819 13:52:37.656366 159859 cri.go:89] found id: "b48d9970f1c04b6885e9082b0ebb5f77664385fc74bb82287e4a67e2257afc4d"
I0819 13:52:37.656386 159859 cri.go:89] found id: ""
I0819 13:52:37.656413 159859 logs.go:276] 2 containers: [e30b6d2a2ef745c854e592691b57aac843e7d42c5fe1b6897816cbdb178742b1 b48d9970f1c04b6885e9082b0ebb5f77664385fc74bb82287e4a67e2257afc4d]
I0819 13:52:37.656502 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:37.660253 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:37.664137 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0819 13:52:37.664293 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0819 13:52:37.708406 159859 cri.go:89] found id: "8e6cdd6bed0c2b81a41d0803db003f1d2f29612971965d14486dd8440d84ae93"
I0819 13:52:37.708470 159859 cri.go:89] found id: ""
I0819 13:52:37.708494 159859 logs.go:276] 1 containers: [8e6cdd6bed0c2b81a41d0803db003f1d2f29612971965d14486dd8440d84ae93]
I0819 13:52:37.708563 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:37.712304 159859 logs.go:123] Gathering logs for describe nodes ...
I0819 13:52:37.712330 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0819 13:52:37.860429 159859 logs.go:123] Gathering logs for kube-apiserver [ff22ac16052d2c43ed9793c39a004d6a1901a8669144d994e07415585f265b2b] ...
I0819 13:52:37.860461 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ff22ac16052d2c43ed9793c39a004d6a1901a8669144d994e07415585f265b2b"
I0819 13:52:37.932440 159859 logs.go:123] Gathering logs for etcd [4e1354ba690cd91d28549484fc0f3383f07194d995caa4d76f819da5e993a297] ...
I0819 13:52:37.932477 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4e1354ba690cd91d28549484fc0f3383f07194d995caa4d76f819da5e993a297"
I0819 13:52:37.981770 159859 logs.go:123] Gathering logs for coredns [28d9baa2b6e93e092f31f623ea40f5dc0b3c07d7117c2886a7a9a34666c927c6] ...
I0819 13:52:37.981805 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 28d9baa2b6e93e092f31f623ea40f5dc0b3c07d7117c2886a7a9a34666c927c6"
I0819 13:52:38.029337 159859 logs.go:123] Gathering logs for kube-proxy [d144fb57c1f864d402cb71f0708356473c2ebcf103514d671338129531d25e14] ...
I0819 13:52:38.029371 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d144fb57c1f864d402cb71f0708356473c2ebcf103514d671338129531d25e14"
W0819 13:52:35.898330 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505154 660 reflector.go:138] object-"kube-system"/"coredns-token-mgkqs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-mgkqs" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:35.898580 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505275 660 reflector.go:138] object-"kube-system"/"storage-provisioner-token-vrkdd": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-vrkdd" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:35.898804 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505337 660 reflector.go:138] object-"kube-system"/"metrics-server-token-gngrg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-gngrg" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:35.899032 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505397 660 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:35.899252 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505458 660 reflector.go:138] object-"kube-system"/"kube-proxy-token-gvnrc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-gvnrc" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:35.899472 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505515 660 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:35.899698 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505568 660 reflector.go:138] object-"kube-system"/"kindnet-token-db6v8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-db6v8" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:35.899941 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505619 660 reflector.go:138] object-"default"/"default-token-ldqq4": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-ldqq4" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:35.907521 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:11 old-k8s-version-914579 kubelet[660]: E0819 13:47:11.700916 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0819 13:52:35.907711 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:11 old-k8s-version-914579 kubelet[660]: E0819 13:47:11.923497 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.910569 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:23 old-k8s-version-914579 kubelet[660]: E0819 13:47:23.556884 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0819 13:52:35.912575 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:38 old-k8s-version-914579 kubelet[660]: E0819 13:47:38.547027 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.913031 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:41 old-k8s-version-914579 kubelet[660]: E0819 13:47:41.081116 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.913488 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:42 old-k8s-version-914579 kubelet[660]: E0819 13:47:42.088354 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.913930 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:43 old-k8s-version-914579 kubelet[660]: E0819 13:47:43.093385 660 pod_workers.go:191] Error syncing pod e088dd49-745a-4473-b25c-b8b1bdef35d2 ("storage-provisioner_kube-system(e088dd49-745a-4473-b25c-b8b1bdef35d2)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(e088dd49-745a-4473-b25c-b8b1bdef35d2)"
W0819 13:52:35.914587 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:50 old-k8s-version-914579 kubelet[660]: E0819 13:47:50.143364 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.917029 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:50 old-k8s-version-914579 kubelet[660]: E0819 13:47:50.539102 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0819 13:52:35.917347 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:04 old-k8s-version-914579 kubelet[660]: E0819 13:48:04.530531 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.917951 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:06 old-k8s-version-914579 kubelet[660]: E0819 13:48:06.204897 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.918275 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:10 old-k8s-version-914579 kubelet[660]: E0819 13:48:10.144306 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.918461 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:17 old-k8s-version-914579 kubelet[660]: E0819 13:48:17.533996 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.918787 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:22 old-k8s-version-914579 kubelet[660]: E0819 13:48:22.534681 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.918970 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:28 old-k8s-version-914579 kubelet[660]: E0819 13:48:28.530752 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.919435 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:35 old-k8s-version-914579 kubelet[660]: E0819 13:48:35.289738 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.919895 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:40 old-k8s-version-914579 kubelet[660]: E0819 13:48:40.144100 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.922351 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:40 old-k8s-version-914579 kubelet[660]: E0819 13:48:40.550260 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0819 13:52:35.922678 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:53 old-k8s-version-914579 kubelet[660]: E0819 13:48:53.530760 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.922862 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:54 old-k8s-version-914579 kubelet[660]: E0819 13:48:54.530590 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.923186 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:05 old-k8s-version-914579 kubelet[660]: E0819 13:49:05.530108 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.923368 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:06 old-k8s-version-914579 kubelet[660]: E0819 13:49:06.531043 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.923551 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:19 old-k8s-version-914579 kubelet[660]: E0819 13:49:19.533642 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.924153 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:21 old-k8s-version-914579 kubelet[660]: E0819 13:49:21.435392 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.924483 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:30 old-k8s-version-914579 kubelet[660]: E0819 13:49:30.144187 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.924667 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:32 old-k8s-version-914579 kubelet[660]: E0819 13:49:32.530403 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.924993 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:41 old-k8s-version-914579 kubelet[660]: E0819 13:49:41.530796 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.925176 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:44 old-k8s-version-914579 kubelet[660]: E0819 13:49:44.530365 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.925501 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:55 old-k8s-version-914579 kubelet[660]: E0819 13:49:55.530750 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.925688 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:57 old-k8s-version-914579 kubelet[660]: E0819 13:49:57.534986 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.926015 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:07 old-k8s-version-914579 kubelet[660]: E0819 13:50:07.530719 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.928455 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:11 old-k8s-version-914579 kubelet[660]: E0819 13:50:11.538819 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0819 13:52:35.928791 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:22 old-k8s-version-914579 kubelet[660]: E0819 13:50:22.530086 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.928974 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:25 old-k8s-version-914579 kubelet[660]: E0819 13:50:25.531673 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.929326 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:35 old-k8s-version-914579 kubelet[660]: E0819 13:50:35.530288 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.929510 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:38 old-k8s-version-914579 kubelet[660]: E0819 13:50:38.536408 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.929836 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:50 old-k8s-version-914579 kubelet[660]: E0819 13:50:50.531928 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.930292 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:50 old-k8s-version-914579 kubelet[660]: E0819 13:50:50.676624 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.930620 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:00 old-k8s-version-914579 kubelet[660]: E0819 13:51:00.175960 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.930808 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:05 old-k8s-version-914579 kubelet[660]: E0819 13:51:05.532058 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.931133 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:13 old-k8s-version-914579 kubelet[660]: E0819 13:51:13.534019 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.931316 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:18 old-k8s-version-914579 kubelet[660]: E0819 13:51:18.530498 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.931826 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:25 old-k8s-version-914579 kubelet[660]: E0819 13:51:25.530598 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.932029 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:31 old-k8s-version-914579 kubelet[660]: E0819 13:51:31.530699 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.932414 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:36 old-k8s-version-914579 kubelet[660]: E0819 13:51:36.530142 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.932607 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:42 old-k8s-version-914579 kubelet[660]: E0819 13:51:42.530485 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.932933 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:48 old-k8s-version-914579 kubelet[660]: E0819 13:51:48.530149 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.933116 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:54 old-k8s-version-914579 kubelet[660]: E0819 13:51:54.530585 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.933493 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:02 old-k8s-version-914579 kubelet[660]: E0819 13:52:02.531227 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.933689 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:07 old-k8s-version-914579 kubelet[660]: E0819 13:52:07.531110 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.934037 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:16 old-k8s-version-914579 kubelet[660]: E0819 13:52:16.530020 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.934225 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:22 old-k8s-version-914579 kubelet[660]: E0819 13:52:22.530508 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:35.934560 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:31 old-k8s-version-914579 kubelet[660]: E0819 13:52:31.532198 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:35.934746 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:33 old-k8s-version-914579 kubelet[660]: E0819 13:52:33.531083 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0819 13:52:35.934760 152452 logs.go:123] Gathering logs for describe nodes ...
I0819 13:52:35.934778 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0819 13:52:36.093366 152452 logs.go:123] Gathering logs for etcd [a93e658c9c6602282efd1636668d5404651e1df0eaba230af4e0430877ea618d] ...
I0819 13:52:36.093398 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a93e658c9c6602282efd1636668d5404651e1df0eaba230af4e0430877ea618d"
I0819 13:52:36.140421 152452 logs.go:123] Gathering logs for kube-controller-manager [fa88625298f23e335aba94d646c993344de4ef6b8da759e9d9f176ae78f9a1fe] ...
I0819 13:52:36.140454 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fa88625298f23e335aba94d646c993344de4ef6b8da759e9d9f176ae78f9a1fe"
I0819 13:52:36.207906 152452 logs.go:123] Gathering logs for kube-apiserver [b779c421112b8e180714c33a49f2622b00391462fc2a2bfb51100d7824fdb234] ...
I0819 13:52:36.207941 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b779c421112b8e180714c33a49f2622b00391462fc2a2bfb51100d7824fdb234"
I0819 13:52:36.281081 152452 logs.go:123] Gathering logs for etcd [6c7959865023d5c1d31e7b8c33d4dca318c0b748bfd18163a76a3658248a339d] ...
I0819 13:52:36.281117 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6c7959865023d5c1d31e7b8c33d4dca318c0b748bfd18163a76a3658248a339d"
I0819 13:52:36.371336 152452 logs.go:123] Gathering logs for container status ...
I0819 13:52:36.371370 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0819 13:52:36.423185 152452 logs.go:123] Gathering logs for kube-controller-manager [ff300c34901ca29544018036fcfb1d22bafcc0bace0dcf64fe0bd253b66ef58e] ...
I0819 13:52:36.423217 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ff300c34901ca29544018036fcfb1d22bafcc0bace0dcf64fe0bd253b66ef58e"
I0819 13:52:36.477465 152452 logs.go:123] Gathering logs for kindnet [c846487e7ff859548debeb2531a1f0b42651196f23aa0606336373cbd8cc2cb4] ...
I0819 13:52:36.477500 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c846487e7ff859548debeb2531a1f0b42651196f23aa0606336373cbd8cc2cb4"
I0819 13:52:36.551026 152452 logs.go:123] Gathering logs for storage-provisioner [65c22339ea6f7f88b4be1592c18662038b27eacd8db0d2a2f924fadc09a4238b] ...
I0819 13:52:36.551090 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 65c22339ea6f7f88b4be1592c18662038b27eacd8db0d2a2f924fadc09a4238b"
I0819 13:52:36.605781 152452 logs.go:123] Gathering logs for dmesg ...
I0819 13:52:36.605810 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0819 13:52:36.625534 152452 logs.go:123] Gathering logs for coredns [8344283822b374d886d00d290f18631a7790271c48c1d318d5b00a1cf12609a5] ...
I0819 13:52:36.625564 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8344283822b374d886d00d290f18631a7790271c48c1d318d5b00a1cf12609a5"
I0819 13:52:36.665220 152452 logs.go:123] Gathering logs for kube-scheduler [db9a1d56a8be5f2c08c944dc19babddbd855957ea6d3d8e032408575130a610c] ...
I0819 13:52:36.665250 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 db9a1d56a8be5f2c08c944dc19babddbd855957ea6d3d8e032408575130a610c"
I0819 13:52:36.706249 152452 logs.go:123] Gathering logs for kube-proxy [d8e9102405c0bfd7286b17e5f2348226ea534b03ab646ed8bc5c514f697bdd28] ...
I0819 13:52:36.706279 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d8e9102405c0bfd7286b17e5f2348226ea534b03ab646ed8bc5c514f697bdd28"
I0819 13:52:36.751297 152452 out.go:358] Setting ErrFile to fd 2...
I0819 13:52:36.751324 152452 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0819 13:52:36.751378 152452 out.go:270] X Problems detected in kubelet:
W0819 13:52:36.751394 152452 out.go:270] Aug 19 13:52:07 old-k8s-version-914579 kubelet[660]: E0819 13:52:07.531110 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:36.751404 152452 out.go:270] Aug 19 13:52:16 old-k8s-version-914579 kubelet[660]: E0819 13:52:16.530020 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:36.751419 152452 out.go:270] Aug 19 13:52:22 old-k8s-version-914579 kubelet[660]: E0819 13:52:22.530508 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:36.751425 152452 out.go:270] Aug 19 13:52:31 old-k8s-version-914579 kubelet[660]: E0819 13:52:31.532198 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:36.751434 152452 out.go:270] Aug 19 13:52:33 old-k8s-version-914579 kubelet[660]: E0819 13:52:33.531083 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0819 13:52:36.751439 152452 out.go:358] Setting ErrFile to fd 2...
I0819 13:52:36.751445 152452 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0819 13:52:38.073242 159859 logs.go:123] Gathering logs for kube-controller-manager [661f3f8d6b252e80a5c64d55369634b0a08dbd0a66c8d22573770fe6a428c119] ...
I0819 13:52:38.073270 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 661f3f8d6b252e80a5c64d55369634b0a08dbd0a66c8d22573770fe6a428c119"
I0819 13:52:38.151860 159859 logs.go:123] Gathering logs for kubelet ...
I0819 13:52:38.151894 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0819 13:52:38.238961 159859 logs.go:123] Gathering logs for dmesg ...
I0819 13:52:38.238999 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0819 13:52:38.264133 159859 logs.go:123] Gathering logs for kube-apiserver [31427da9f6f535c6d8c0bfe81742ea748ad4b6e794d6f5a32b75e28cfdda811f] ...
I0819 13:52:38.264165 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 31427da9f6f535c6d8c0bfe81742ea748ad4b6e794d6f5a32b75e28cfdda811f"
I0819 13:52:38.337136 159859 logs.go:123] Gathering logs for kube-scheduler [494769b089cf99a12deae58e0f27768f8a83fee5c330bd4d796e04286252e9cc] ...
I0819 13:52:38.337169 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 494769b089cf99a12deae58e0f27768f8a83fee5c330bd4d796e04286252e9cc"
I0819 13:52:38.385388 159859 logs.go:123] Gathering logs for kube-proxy [3fabea8e04f6abca30b247c4889af7e3c503181c02673fe407b6feebf8604a07] ...
I0819 13:52:38.385420 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3fabea8e04f6abca30b247c4889af7e3c503181c02673fe407b6feebf8604a07"
I0819 13:52:38.428817 159859 logs.go:123] Gathering logs for storage-provisioner [e30b6d2a2ef745c854e592691b57aac843e7d42c5fe1b6897816cbdb178742b1] ...
I0819 13:52:38.428848 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e30b6d2a2ef745c854e592691b57aac843e7d42c5fe1b6897816cbdb178742b1"
I0819 13:52:38.469504 159859 logs.go:123] Gathering logs for coredns [6f5b16f013f8d9677cb7b065862e53df5d82fd3fc59a75567ab2b934b923bafd] ...
I0819 13:52:38.469575 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6f5b16f013f8d9677cb7b065862e53df5d82fd3fc59a75567ab2b934b923bafd"
I0819 13:52:38.509318 159859 logs.go:123] Gathering logs for kindnet [72f86ce2e020cf467a960cedb19e56cde7e0f6cf8509a46304c45072f11a64a2] ...
I0819 13:52:38.509351 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 72f86ce2e020cf467a960cedb19e56cde7e0f6cf8509a46304c45072f11a64a2"
I0819 13:52:38.561112 159859 logs.go:123] Gathering logs for container status ...
I0819 13:52:38.561145 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0819 13:52:38.617116 159859 logs.go:123] Gathering logs for etcd [c2667c90b1c00f50d02ddaf922cd598827148598792fca8aa690697e65a98744] ...
I0819 13:52:38.617146 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c2667c90b1c00f50d02ddaf922cd598827148598792fca8aa690697e65a98744"
I0819 13:52:38.661490 159859 logs.go:123] Gathering logs for kube-scheduler [7466e02589549507e8614ae43605f4e6f4605606ee4e61167b26d408b8078137] ...
I0819 13:52:38.661526 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7466e02589549507e8614ae43605f4e6f4605606ee4e61167b26d408b8078137"
I0819 13:52:38.709998 159859 logs.go:123] Gathering logs for kube-controller-manager [7dd9e79429542dbb8adda3b3a2334949bacde3c045dfd5a276eb9ece3d9f29ad] ...
I0819 13:52:38.710032 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7dd9e79429542dbb8adda3b3a2334949bacde3c045dfd5a276eb9ece3d9f29ad"
I0819 13:52:38.772527 159859 logs.go:123] Gathering logs for kindnet [885b37e08c80c553570637679785115f4c325b8bec8dc444bd754dab1ee3ce7c] ...
I0819 13:52:38.772563 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 885b37e08c80c553570637679785115f4c325b8bec8dc444bd754dab1ee3ce7c"
I0819 13:52:38.826699 159859 logs.go:123] Gathering logs for storage-provisioner [b48d9970f1c04b6885e9082b0ebb5f77664385fc74bb82287e4a67e2257afc4d] ...
I0819 13:52:38.826736 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b48d9970f1c04b6885e9082b0ebb5f77664385fc74bb82287e4a67e2257afc4d"
I0819 13:52:38.867507 159859 logs.go:123] Gathering logs for kubernetes-dashboard [8e6cdd6bed0c2b81a41d0803db003f1d2f29612971965d14486dd8440d84ae93] ...
I0819 13:52:38.867537 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8e6cdd6bed0c2b81a41d0803db003f1d2f29612971965d14486dd8440d84ae93"
I0819 13:52:38.909543 159859 logs.go:123] Gathering logs for containerd ...
I0819 13:52:38.909573 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0819 13:52:41.475324 159859 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0819 13:52:41.495861 159859 api_server.go:72] duration metric: took 4m10.389757829s to wait for apiserver process to appear ...
I0819 13:52:41.495888 159859 api_server.go:88] waiting for apiserver healthz status ...
I0819 13:52:41.495923 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0819 13:52:41.495981 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0819 13:52:41.564966 159859 cri.go:89] found id: "31427da9f6f535c6d8c0bfe81742ea748ad4b6e794d6f5a32b75e28cfdda811f"
I0819 13:52:41.564987 159859 cri.go:89] found id: "ff22ac16052d2c43ed9793c39a004d6a1901a8669144d994e07415585f265b2b"
I0819 13:52:41.564992 159859 cri.go:89] found id: ""
I0819 13:52:41.564999 159859 logs.go:276] 2 containers: [31427da9f6f535c6d8c0bfe81742ea748ad4b6e794d6f5a32b75e28cfdda811f ff22ac16052d2c43ed9793c39a004d6a1901a8669144d994e07415585f265b2b]
I0819 13:52:41.565068 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:41.569835 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:41.578711 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0819 13:52:41.578780 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0819 13:52:41.626485 159859 cri.go:89] found id: "4e1354ba690cd91d28549484fc0f3383f07194d995caa4d76f819da5e993a297"
I0819 13:52:41.626505 159859 cri.go:89] found id: "c2667c90b1c00f50d02ddaf922cd598827148598792fca8aa690697e65a98744"
I0819 13:52:41.626509 159859 cri.go:89] found id: ""
I0819 13:52:41.626517 159859 logs.go:276] 2 containers: [4e1354ba690cd91d28549484fc0f3383f07194d995caa4d76f819da5e993a297 c2667c90b1c00f50d02ddaf922cd598827148598792fca8aa690697e65a98744]
I0819 13:52:41.626577 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:41.630642 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:41.634732 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0819 13:52:41.634806 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0819 13:52:41.688049 159859 cri.go:89] found id: "28d9baa2b6e93e092f31f623ea40f5dc0b3c07d7117c2886a7a9a34666c927c6"
I0819 13:52:41.688069 159859 cri.go:89] found id: "6f5b16f013f8d9677cb7b065862e53df5d82fd3fc59a75567ab2b934b923bafd"
I0819 13:52:41.688074 159859 cri.go:89] found id: ""
I0819 13:52:41.688081 159859 logs.go:276] 2 containers: [28d9baa2b6e93e092f31f623ea40f5dc0b3c07d7117c2886a7a9a34666c927c6 6f5b16f013f8d9677cb7b065862e53df5d82fd3fc59a75567ab2b934b923bafd]
I0819 13:52:41.688137 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:41.691553 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:41.695222 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0819 13:52:41.695291 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0819 13:52:41.736857 159859 cri.go:89] found id: "494769b089cf99a12deae58e0f27768f8a83fee5c330bd4d796e04286252e9cc"
I0819 13:52:41.736880 159859 cri.go:89] found id: "7466e02589549507e8614ae43605f4e6f4605606ee4e61167b26d408b8078137"
I0819 13:52:41.736885 159859 cri.go:89] found id: ""
I0819 13:52:41.736893 159859 logs.go:276] 2 containers: [494769b089cf99a12deae58e0f27768f8a83fee5c330bd4d796e04286252e9cc 7466e02589549507e8614ae43605f4e6f4605606ee4e61167b26d408b8078137]
I0819 13:52:41.736951 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:41.740660 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:41.744110 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0819 13:52:41.744188 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0819 13:52:41.786237 159859 cri.go:89] found id: "3fabea8e04f6abca30b247c4889af7e3c503181c02673fe407b6feebf8604a07"
I0819 13:52:41.786262 159859 cri.go:89] found id: "d144fb57c1f864d402cb71f0708356473c2ebcf103514d671338129531d25e14"
I0819 13:52:41.786267 159859 cri.go:89] found id: ""
I0819 13:52:41.786274 159859 logs.go:276] 2 containers: [3fabea8e04f6abca30b247c4889af7e3c503181c02673fe407b6feebf8604a07 d144fb57c1f864d402cb71f0708356473c2ebcf103514d671338129531d25e14]
I0819 13:52:41.786337 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:41.790247 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:41.793921 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0819 13:52:41.793994 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0819 13:52:41.833098 159859 cri.go:89] found id: "661f3f8d6b252e80a5c64d55369634b0a08dbd0a66c8d22573770fe6a428c119"
I0819 13:52:41.833122 159859 cri.go:89] found id: "7dd9e79429542dbb8adda3b3a2334949bacde3c045dfd5a276eb9ece3d9f29ad"
I0819 13:52:41.833127 159859 cri.go:89] found id: ""
I0819 13:52:41.833135 159859 logs.go:276] 2 containers: [661f3f8d6b252e80a5c64d55369634b0a08dbd0a66c8d22573770fe6a428c119 7dd9e79429542dbb8adda3b3a2334949bacde3c045dfd5a276eb9ece3d9f29ad]
I0819 13:52:41.833191 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:41.837201 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:41.840789 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0819 13:52:41.840905 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0819 13:52:41.880178 159859 cri.go:89] found id: "885b37e08c80c553570637679785115f4c325b8bec8dc444bd754dab1ee3ce7c"
I0819 13:52:41.880252 159859 cri.go:89] found id: "72f86ce2e020cf467a960cedb19e56cde7e0f6cf8509a46304c45072f11a64a2"
I0819 13:52:41.880263 159859 cri.go:89] found id: ""
I0819 13:52:41.880272 159859 logs.go:276] 2 containers: [885b37e08c80c553570637679785115f4c325b8bec8dc444bd754dab1ee3ce7c 72f86ce2e020cf467a960cedb19e56cde7e0f6cf8509a46304c45072f11a64a2]
I0819 13:52:41.880350 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:41.884179 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:41.888464 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0819 13:52:41.888545 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0819 13:52:41.932211 159859 cri.go:89] found id: "8e6cdd6bed0c2b81a41d0803db003f1d2f29612971965d14486dd8440d84ae93"
I0819 13:52:41.932278 159859 cri.go:89] found id: ""
I0819 13:52:41.932301 159859 logs.go:276] 1 containers: [8e6cdd6bed0c2b81a41d0803db003f1d2f29612971965d14486dd8440d84ae93]
I0819 13:52:41.932393 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:41.936233 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0819 13:52:41.936347 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0819 13:52:41.975658 159859 cri.go:89] found id: "e30b6d2a2ef745c854e592691b57aac843e7d42c5fe1b6897816cbdb178742b1"
I0819 13:52:41.975725 159859 cri.go:89] found id: "b48d9970f1c04b6885e9082b0ebb5f77664385fc74bb82287e4a67e2257afc4d"
I0819 13:52:41.975745 159859 cri.go:89] found id: ""
I0819 13:52:41.975771 159859 logs.go:276] 2 containers: [e30b6d2a2ef745c854e592691b57aac843e7d42c5fe1b6897816cbdb178742b1 b48d9970f1c04b6885e9082b0ebb5f77664385fc74bb82287e4a67e2257afc4d]
I0819 13:52:41.975906 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:41.979561 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:41.983120 159859 logs.go:123] Gathering logs for etcd [c2667c90b1c00f50d02ddaf922cd598827148598792fca8aa690697e65a98744] ...
I0819 13:52:41.983188 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c2667c90b1c00f50d02ddaf922cd598827148598792fca8aa690697e65a98744"
I0819 13:52:42.046470 159859 logs.go:123] Gathering logs for kube-scheduler [494769b089cf99a12deae58e0f27768f8a83fee5c330bd4d796e04286252e9cc] ...
I0819 13:52:42.046503 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 494769b089cf99a12deae58e0f27768f8a83fee5c330bd4d796e04286252e9cc"
I0819 13:52:42.097877 159859 logs.go:123] Gathering logs for kube-proxy [3fabea8e04f6abca30b247c4889af7e3c503181c02673fe407b6feebf8604a07] ...
I0819 13:52:42.097911 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3fabea8e04f6abca30b247c4889af7e3c503181c02673fe407b6feebf8604a07"
I0819 13:52:42.167030 159859 logs.go:123] Gathering logs for kube-proxy [d144fb57c1f864d402cb71f0708356473c2ebcf103514d671338129531d25e14] ...
I0819 13:52:42.167065 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d144fb57c1f864d402cb71f0708356473c2ebcf103514d671338129531d25e14"
I0819 13:52:42.227264 159859 logs.go:123] Gathering logs for kube-controller-manager [661f3f8d6b252e80a5c64d55369634b0a08dbd0a66c8d22573770fe6a428c119] ...
I0819 13:52:42.227300 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 661f3f8d6b252e80a5c64d55369634b0a08dbd0a66c8d22573770fe6a428c119"
I0819 13:52:42.328651 159859 logs.go:123] Gathering logs for kindnet [885b37e08c80c553570637679785115f4c325b8bec8dc444bd754dab1ee3ce7c] ...
I0819 13:52:42.328697 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 885b37e08c80c553570637679785115f4c325b8bec8dc444bd754dab1ee3ce7c"
I0819 13:52:42.396459 159859 logs.go:123] Gathering logs for kubelet ...
I0819 13:52:42.396505 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0819 13:52:42.474093 159859 logs.go:123] Gathering logs for kube-apiserver [31427da9f6f535c6d8c0bfe81742ea748ad4b6e794d6f5a32b75e28cfdda811f] ...
I0819 13:52:42.474130 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 31427da9f6f535c6d8c0bfe81742ea748ad4b6e794d6f5a32b75e28cfdda811f"
I0819 13:52:42.556358 159859 logs.go:123] Gathering logs for kubernetes-dashboard [8e6cdd6bed0c2b81a41d0803db003f1d2f29612971965d14486dd8440d84ae93] ...
I0819 13:52:42.556394 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8e6cdd6bed0c2b81a41d0803db003f1d2f29612971965d14486dd8440d84ae93"
I0819 13:52:42.600708 159859 logs.go:123] Gathering logs for etcd [4e1354ba690cd91d28549484fc0f3383f07194d995caa4d76f819da5e993a297] ...
I0819 13:52:42.600740 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4e1354ba690cd91d28549484fc0f3383f07194d995caa4d76f819da5e993a297"
I0819 13:52:42.653918 159859 logs.go:123] Gathering logs for kube-apiserver [ff22ac16052d2c43ed9793c39a004d6a1901a8669144d994e07415585f265b2b] ...
I0819 13:52:42.653952 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ff22ac16052d2c43ed9793c39a004d6a1901a8669144d994e07415585f265b2b"
I0819 13:52:42.701524 159859 logs.go:123] Gathering logs for coredns [6f5b16f013f8d9677cb7b065862e53df5d82fd3fc59a75567ab2b934b923bafd] ...
I0819 13:52:42.701556 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6f5b16f013f8d9677cb7b065862e53df5d82fd3fc59a75567ab2b934b923bafd"
I0819 13:52:42.754659 159859 logs.go:123] Gathering logs for storage-provisioner [e30b6d2a2ef745c854e592691b57aac843e7d42c5fe1b6897816cbdb178742b1] ...
I0819 13:52:42.754687 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e30b6d2a2ef745c854e592691b57aac843e7d42c5fe1b6897816cbdb178742b1"
I0819 13:52:42.795685 159859 logs.go:123] Gathering logs for storage-provisioner [b48d9970f1c04b6885e9082b0ebb5f77664385fc74bb82287e4a67e2257afc4d] ...
I0819 13:52:42.795714 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b48d9970f1c04b6885e9082b0ebb5f77664385fc74bb82287e4a67e2257afc4d"
I0819 13:52:42.835156 159859 logs.go:123] Gathering logs for container status ...
I0819 13:52:42.835186 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0819 13:52:42.884347 159859 logs.go:123] Gathering logs for dmesg ...
I0819 13:52:42.884378 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0819 13:52:42.901388 159859 logs.go:123] Gathering logs for describe nodes ...
I0819 13:52:42.901416 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0819 13:52:43.029106 159859 logs.go:123] Gathering logs for kube-controller-manager [7dd9e79429542dbb8adda3b3a2334949bacde3c045dfd5a276eb9ece3d9f29ad] ...
I0819 13:52:43.029144 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7dd9e79429542dbb8adda3b3a2334949bacde3c045dfd5a276eb9ece3d9f29ad"
I0819 13:52:43.089701 159859 logs.go:123] Gathering logs for kindnet [72f86ce2e020cf467a960cedb19e56cde7e0f6cf8509a46304c45072f11a64a2] ...
I0819 13:52:43.089739 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 72f86ce2e020cf467a960cedb19e56cde7e0f6cf8509a46304c45072f11a64a2"
I0819 13:52:43.141888 159859 logs.go:123] Gathering logs for containerd ...
I0819 13:52:43.141925 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0819 13:52:43.209170 159859 logs.go:123] Gathering logs for coredns [28d9baa2b6e93e092f31f623ea40f5dc0b3c07d7117c2886a7a9a34666c927c6] ...
I0819 13:52:43.209207 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 28d9baa2b6e93e092f31f623ea40f5dc0b3c07d7117c2886a7a9a34666c927c6"
I0819 13:52:43.259184 159859 logs.go:123] Gathering logs for kube-scheduler [7466e02589549507e8614ae43605f4e6f4605606ee4e61167b26d408b8078137] ...
I0819 13:52:43.259215 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7466e02589549507e8614ae43605f4e6f4605606ee4e61167b26d408b8078137"
I0819 13:52:45.807200 159859 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0819 13:52:45.815496 159859 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0819 13:52:45.817022 159859 api_server.go:141] control plane version: v1.31.0
I0819 13:52:45.817050 159859 api_server.go:131] duration metric: took 4.321155132s to wait for apiserver health ...
I0819 13:52:45.817061 159859 system_pods.go:43] waiting for kube-system pods to appear ...
I0819 13:52:45.817087 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0819 13:52:45.817163 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0819 13:52:45.856631 159859 cri.go:89] found id: "31427da9f6f535c6d8c0bfe81742ea748ad4b6e794d6f5a32b75e28cfdda811f"
I0819 13:52:45.856654 159859 cri.go:89] found id: "ff22ac16052d2c43ed9793c39a004d6a1901a8669144d994e07415585f265b2b"
I0819 13:52:45.856660 159859 cri.go:89] found id: ""
I0819 13:52:45.856667 159859 logs.go:276] 2 containers: [31427da9f6f535c6d8c0bfe81742ea748ad4b6e794d6f5a32b75e28cfdda811f ff22ac16052d2c43ed9793c39a004d6a1901a8669144d994e07415585f265b2b]
I0819 13:52:45.856725 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:45.860463 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:45.864546 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0819 13:52:45.864622 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0819 13:52:45.904207 159859 cri.go:89] found id: "4e1354ba690cd91d28549484fc0f3383f07194d995caa4d76f819da5e993a297"
I0819 13:52:45.904232 159859 cri.go:89] found id: "c2667c90b1c00f50d02ddaf922cd598827148598792fca8aa690697e65a98744"
I0819 13:52:45.904237 159859 cri.go:89] found id: ""
I0819 13:52:45.904245 159859 logs.go:276] 2 containers: [4e1354ba690cd91d28549484fc0f3383f07194d995caa4d76f819da5e993a297 c2667c90b1c00f50d02ddaf922cd598827148598792fca8aa690697e65a98744]
I0819 13:52:45.904306 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:45.908147 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:45.911741 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0819 13:52:45.911859 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0819 13:52:45.951384 159859 cri.go:89] found id: "28d9baa2b6e93e092f31f623ea40f5dc0b3c07d7117c2886a7a9a34666c927c6"
I0819 13:52:45.951410 159859 cri.go:89] found id: "6f5b16f013f8d9677cb7b065862e53df5d82fd3fc59a75567ab2b934b923bafd"
I0819 13:52:45.951415 159859 cri.go:89] found id: ""
I0819 13:52:45.951423 159859 logs.go:276] 2 containers: [28d9baa2b6e93e092f31f623ea40f5dc0b3c07d7117c2886a7a9a34666c927c6 6f5b16f013f8d9677cb7b065862e53df5d82fd3fc59a75567ab2b934b923bafd]
I0819 13:52:45.951480 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:45.955479 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:45.959281 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0819 13:52:45.959355 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0819 13:52:46.001880 159859 cri.go:89] found id: "494769b089cf99a12deae58e0f27768f8a83fee5c330bd4d796e04286252e9cc"
I0819 13:52:46.001902 159859 cri.go:89] found id: "7466e02589549507e8614ae43605f4e6f4605606ee4e61167b26d408b8078137"
I0819 13:52:46.001907 159859 cri.go:89] found id: ""
I0819 13:52:46.001916 159859 logs.go:276] 2 containers: [494769b089cf99a12deae58e0f27768f8a83fee5c330bd4d796e04286252e9cc 7466e02589549507e8614ae43605f4e6f4605606ee4e61167b26d408b8078137]
I0819 13:52:46.001999 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:46.013111 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:46.017550 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0819 13:52:46.017642 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0819 13:52:46.065187 159859 cri.go:89] found id: "3fabea8e04f6abca30b247c4889af7e3c503181c02673fe407b6feebf8604a07"
I0819 13:52:46.065211 159859 cri.go:89] found id: "d144fb57c1f864d402cb71f0708356473c2ebcf103514d671338129531d25e14"
I0819 13:52:46.065216 159859 cri.go:89] found id: ""
I0819 13:52:46.065224 159859 logs.go:276] 2 containers: [3fabea8e04f6abca30b247c4889af7e3c503181c02673fe407b6feebf8604a07 d144fb57c1f864d402cb71f0708356473c2ebcf103514d671338129531d25e14]
I0819 13:52:46.065281 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:46.069148 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:46.072779 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0819 13:52:46.072882 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0819 13:52:46.117738 159859 cri.go:89] found id: "661f3f8d6b252e80a5c64d55369634b0a08dbd0a66c8d22573770fe6a428c119"
I0819 13:52:46.117815 159859 cri.go:89] found id: "7dd9e79429542dbb8adda3b3a2334949bacde3c045dfd5a276eb9ece3d9f29ad"
I0819 13:52:46.117828 159859 cri.go:89] found id: ""
I0819 13:52:46.117836 159859 logs.go:276] 2 containers: [661f3f8d6b252e80a5c64d55369634b0a08dbd0a66c8d22573770fe6a428c119 7dd9e79429542dbb8adda3b3a2334949bacde3c045dfd5a276eb9ece3d9f29ad]
I0819 13:52:46.117909 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:46.121800 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:46.125875 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0819 13:52:46.125992 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0819 13:52:46.175766 159859 cri.go:89] found id: "885b37e08c80c553570637679785115f4c325b8bec8dc444bd754dab1ee3ce7c"
I0819 13:52:46.175894 159859 cri.go:89] found id: "72f86ce2e020cf467a960cedb19e56cde7e0f6cf8509a46304c45072f11a64a2"
I0819 13:52:46.175915 159859 cri.go:89] found id: ""
I0819 13:52:46.175942 159859 logs.go:276] 2 containers: [885b37e08c80c553570637679785115f4c325b8bec8dc444bd754dab1ee3ce7c 72f86ce2e020cf467a960cedb19e56cde7e0f6cf8509a46304c45072f11a64a2]
I0819 13:52:46.176038 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:46.179893 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:46.184065 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0819 13:52:46.184181 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0819 13:52:46.224013 159859 cri.go:89] found id: "8e6cdd6bed0c2b81a41d0803db003f1d2f29612971965d14486dd8440d84ae93"
I0819 13:52:46.224038 159859 cri.go:89] found id: ""
I0819 13:52:46.224047 159859 logs.go:276] 1 containers: [8e6cdd6bed0c2b81a41d0803db003f1d2f29612971965d14486dd8440d84ae93]
I0819 13:52:46.224106 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:46.228007 159859 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0819 13:52:46.228084 159859 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0819 13:52:46.267226 159859 cri.go:89] found id: "e30b6d2a2ef745c854e592691b57aac843e7d42c5fe1b6897816cbdb178742b1"
I0819 13:52:46.267253 159859 cri.go:89] found id: "b48d9970f1c04b6885e9082b0ebb5f77664385fc74bb82287e4a67e2257afc4d"
I0819 13:52:46.267259 159859 cri.go:89] found id: ""
I0819 13:52:46.267266 159859 logs.go:276] 2 containers: [e30b6d2a2ef745c854e592691b57aac843e7d42c5fe1b6897816cbdb178742b1 b48d9970f1c04b6885e9082b0ebb5f77664385fc74bb82287e4a67e2257afc4d]
I0819 13:52:46.267329 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:46.271227 159859 ssh_runner.go:195] Run: which crictl
I0819 13:52:46.274718 159859 logs.go:123] Gathering logs for container status ...
I0819 13:52:46.274787 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0819 13:52:46.332956 159859 logs.go:123] Gathering logs for kubelet ...
I0819 13:52:46.332983 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0819 13:52:46.413857 159859 logs.go:123] Gathering logs for kube-scheduler [7466e02589549507e8614ae43605f4e6f4605606ee4e61167b26d408b8078137] ...
I0819 13:52:46.413895 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7466e02589549507e8614ae43605f4e6f4605606ee4e61167b26d408b8078137"
I0819 13:52:46.466854 159859 logs.go:123] Gathering logs for storage-provisioner [b48d9970f1c04b6885e9082b0ebb5f77664385fc74bb82287e4a67e2257afc4d] ...
I0819 13:52:46.466884 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b48d9970f1c04b6885e9082b0ebb5f77664385fc74bb82287e4a67e2257afc4d"
I0819 13:52:46.510357 159859 logs.go:123] Gathering logs for kube-proxy [d144fb57c1f864d402cb71f0708356473c2ebcf103514d671338129531d25e14] ...
I0819 13:52:46.510384 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d144fb57c1f864d402cb71f0708356473c2ebcf103514d671338129531d25e14"
I0819 13:52:46.551172 159859 logs.go:123] Gathering logs for kindnet [72f86ce2e020cf467a960cedb19e56cde7e0f6cf8509a46304c45072f11a64a2] ...
I0819 13:52:46.551204 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 72f86ce2e020cf467a960cedb19e56cde7e0f6cf8509a46304c45072f11a64a2"
I0819 13:52:46.609693 159859 logs.go:123] Gathering logs for storage-provisioner [e30b6d2a2ef745c854e592691b57aac843e7d42c5fe1b6897816cbdb178742b1] ...
I0819 13:52:46.609725 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e30b6d2a2ef745c854e592691b57aac843e7d42c5fe1b6897816cbdb178742b1"
I0819 13:52:46.661281 159859 logs.go:123] Gathering logs for dmesg ...
I0819 13:52:46.661311 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0819 13:52:46.678849 159859 logs.go:123] Gathering logs for describe nodes ...
I0819 13:52:46.678924 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0819 13:52:46.841121 159859 logs.go:123] Gathering logs for coredns [28d9baa2b6e93e092f31f623ea40f5dc0b3c07d7117c2886a7a9a34666c927c6] ...
I0819 13:52:46.841171 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 28d9baa2b6e93e092f31f623ea40f5dc0b3c07d7117c2886a7a9a34666c927c6"
I0819 13:52:46.911212 159859 logs.go:123] Gathering logs for kube-controller-manager [661f3f8d6b252e80a5c64d55369634b0a08dbd0a66c8d22573770fe6a428c119] ...
I0819 13:52:46.911242 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 661f3f8d6b252e80a5c64d55369634b0a08dbd0a66c8d22573770fe6a428c119"
I0819 13:52:47.004071 159859 logs.go:123] Gathering logs for kindnet [885b37e08c80c553570637679785115f4c325b8bec8dc444bd754dab1ee3ce7c] ...
I0819 13:52:47.004122 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 885b37e08c80c553570637679785115f4c325b8bec8dc444bd754dab1ee3ce7c"
I0819 13:52:47.135649 159859 logs.go:123] Gathering logs for kubernetes-dashboard [8e6cdd6bed0c2b81a41d0803db003f1d2f29612971965d14486dd8440d84ae93] ...
I0819 13:52:47.135741 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8e6cdd6bed0c2b81a41d0803db003f1d2f29612971965d14486dd8440d84ae93"
I0819 13:52:47.200538 159859 logs.go:123] Gathering logs for containerd ...
I0819 13:52:47.200618 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0819 13:52:47.280278 159859 logs.go:123] Gathering logs for etcd [4e1354ba690cd91d28549484fc0f3383f07194d995caa4d76f819da5e993a297] ...
I0819 13:52:47.280360 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4e1354ba690cd91d28549484fc0f3383f07194d995caa4d76f819da5e993a297"
I0819 13:52:47.342950 159859 logs.go:123] Gathering logs for etcd [c2667c90b1c00f50d02ddaf922cd598827148598792fca8aa690697e65a98744] ...
I0819 13:52:47.343011 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c2667c90b1c00f50d02ddaf922cd598827148598792fca8aa690697e65a98744"
I0819 13:52:47.433712 159859 logs.go:123] Gathering logs for kube-proxy [3fabea8e04f6abca30b247c4889af7e3c503181c02673fe407b6feebf8604a07] ...
I0819 13:52:47.433772 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3fabea8e04f6abca30b247c4889af7e3c503181c02673fe407b6feebf8604a07"
I0819 13:52:47.500790 159859 logs.go:123] Gathering logs for kube-scheduler [494769b089cf99a12deae58e0f27768f8a83fee5c330bd4d796e04286252e9cc] ...
I0819 13:52:47.500818 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 494769b089cf99a12deae58e0f27768f8a83fee5c330bd4d796e04286252e9cc"
I0819 13:52:47.566508 159859 logs.go:123] Gathering logs for kube-controller-manager [7dd9e79429542dbb8adda3b3a2334949bacde3c045dfd5a276eb9ece3d9f29ad] ...
I0819 13:52:47.566540 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7dd9e79429542dbb8adda3b3a2334949bacde3c045dfd5a276eb9ece3d9f29ad"
I0819 13:52:47.665499 159859 logs.go:123] Gathering logs for kube-apiserver [31427da9f6f535c6d8c0bfe81742ea748ad4b6e794d6f5a32b75e28cfdda811f] ...
I0819 13:52:47.665544 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 31427da9f6f535c6d8c0bfe81742ea748ad4b6e794d6f5a32b75e28cfdda811f"
I0819 13:52:47.738075 159859 logs.go:123] Gathering logs for kube-apiserver [ff22ac16052d2c43ed9793c39a004d6a1901a8669144d994e07415585f265b2b] ...
I0819 13:52:47.738115 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ff22ac16052d2c43ed9793c39a004d6a1901a8669144d994e07415585f265b2b"
I0819 13:52:47.822848 159859 logs.go:123] Gathering logs for coredns [6f5b16f013f8d9677cb7b065862e53df5d82fd3fc59a75567ab2b934b923bafd] ...
I0819 13:52:47.822901 159859 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6f5b16f013f8d9677cb7b065862e53df5d82fd3fc59a75567ab2b934b923bafd"
I0819 13:52:50.383104 159859 system_pods.go:59] 9 kube-system pods found
I0819 13:52:50.383156 159859 system_pods.go:61] "coredns-6f6b679f8f-fgrp5" [94c8ef36-d04b-432e-aadb-beadb7c4dffe] Running
I0819 13:52:50.383163 159859 system_pods.go:61] "etcd-no-preload-895877" [4000f8d0-786d-46ca-80b2-fbcf4ff30c4f] Running
I0819 13:52:50.383169 159859 system_pods.go:61] "kindnet-rcssr" [d471cb38-8e84-4403-81f4-cc5da62cb710] Running
I0819 13:52:50.383174 159859 system_pods.go:61] "kube-apiserver-no-preload-895877" [c74151df-7e44-4a81-b1ca-848faa86f9fc] Running
I0819 13:52:50.383178 159859 system_pods.go:61] "kube-controller-manager-no-preload-895877" [1e0723f7-35e2-4b3b-9a07-5edb4fbff997] Running
I0819 13:52:50.383182 159859 system_pods.go:61] "kube-proxy-9q48v" [f30af7ca-281a-463e-8804-1becdd05a8ea] Running
I0819 13:52:50.383186 159859 system_pods.go:61] "kube-scheduler-no-preload-895877" [75de3346-94d2-4d32-b92a-6223bc6e3830] Running
I0819 13:52:50.383203 159859 system_pods.go:61] "metrics-server-6867b74b74-jhj2b" [38b73b25-64d5-4920-a9a7-24824f300411] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0819 13:52:50.383207 159859 system_pods.go:61] "storage-provisioner" [f2fc4812-201e-48d1-9c20-ad64b955f7a5] Running
I0819 13:52:50.383215 159859 system_pods.go:74] duration metric: took 4.566148261s to wait for pod list to return data ...
I0819 13:52:50.383228 159859 default_sa.go:34] waiting for default service account to be created ...
I0819 13:52:50.386892 159859 default_sa.go:45] found service account: "default"
I0819 13:52:50.386919 159859 default_sa.go:55] duration metric: took 3.68357ms for default service account to be created ...
I0819 13:52:50.386929 159859 system_pods.go:116] waiting for k8s-apps to be running ...
I0819 13:52:50.393143 159859 system_pods.go:86] 9 kube-system pods found
I0819 13:52:50.393194 159859 system_pods.go:89] "coredns-6f6b679f8f-fgrp5" [94c8ef36-d04b-432e-aadb-beadb7c4dffe] Running
I0819 13:52:50.393202 159859 system_pods.go:89] "etcd-no-preload-895877" [4000f8d0-786d-46ca-80b2-fbcf4ff30c4f] Running
I0819 13:52:50.393207 159859 system_pods.go:89] "kindnet-rcssr" [d471cb38-8e84-4403-81f4-cc5da62cb710] Running
I0819 13:52:50.393212 159859 system_pods.go:89] "kube-apiserver-no-preload-895877" [c74151df-7e44-4a81-b1ca-848faa86f9fc] Running
I0819 13:52:50.393218 159859 system_pods.go:89] "kube-controller-manager-no-preload-895877" [1e0723f7-35e2-4b3b-9a07-5edb4fbff997] Running
I0819 13:52:50.393228 159859 system_pods.go:89] "kube-proxy-9q48v" [f30af7ca-281a-463e-8804-1becdd05a8ea] Running
I0819 13:52:50.393232 159859 system_pods.go:89] "kube-scheduler-no-preload-895877" [75de3346-94d2-4d32-b92a-6223bc6e3830] Running
I0819 13:52:50.393240 159859 system_pods.go:89] "metrics-server-6867b74b74-jhj2b" [38b73b25-64d5-4920-a9a7-24824f300411] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0819 13:52:50.393257 159859 system_pods.go:89] "storage-provisioner" [f2fc4812-201e-48d1-9c20-ad64b955f7a5] Running
I0819 13:52:50.393266 159859 system_pods.go:126] duration metric: took 6.330982ms to wait for k8s-apps to be running ...
I0819 13:52:50.393287 159859 system_svc.go:44] waiting for kubelet service to be running ....
I0819 13:52:50.393354 159859 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0819 13:52:50.405536 159859 system_svc.go:56] duration metric: took 12.241618ms WaitForService to wait for kubelet
I0819 13:52:50.405575 159859 kubeadm.go:582] duration metric: took 4m19.299477613s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0819 13:52:50.405606 159859 node_conditions.go:102] verifying NodePressure condition ...
I0819 13:52:50.408805 159859 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0819 13:52:50.408852 159859 node_conditions.go:123] node cpu capacity is 2
I0819 13:52:50.408865 159859 node_conditions.go:105] duration metric: took 3.250984ms to run NodePressure ...
I0819 13:52:50.408879 159859 start.go:241] waiting for startup goroutines ...
I0819 13:52:50.408886 159859 start.go:246] waiting for cluster config update ...
I0819 13:52:50.408898 159859 start.go:255] writing updated cluster config ...
I0819 13:52:50.409189 159859 ssh_runner.go:195] Run: rm -f paused
I0819 13:52:50.472652 159859 start.go:600] kubectl: 1.31.0, cluster: 1.31.0 (minor skew: 0)
I0819 13:52:50.475887 159859 out.go:177] * Done! kubectl is now configured to use "no-preload-895877" cluster and "default" namespace by default
I0819 13:52:46.752339 152452 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0819 13:52:46.770079 152452 api_server.go:72] duration metric: took 5m57.199385315s to wait for apiserver process to appear ...
I0819 13:52:46.770108 152452 api_server.go:88] waiting for apiserver healthz status ...
I0819 13:52:46.770164 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0819 13:52:46.770245 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0819 13:52:46.856422 152452 cri.go:89] found id: "b779c421112b8e180714c33a49f2622b00391462fc2a2bfb51100d7824fdb234"
I0819 13:52:46.856452 152452 cri.go:89] found id: "fcd65a8439964dae437d73a25791d2c38189fd5f9e340dc4e33ca0cc390524ef"
I0819 13:52:46.856457 152452 cri.go:89] found id: ""
I0819 13:52:46.856466 152452 logs.go:276] 2 containers: [b779c421112b8e180714c33a49f2622b00391462fc2a2bfb51100d7824fdb234 fcd65a8439964dae437d73a25791d2c38189fd5f9e340dc4e33ca0cc390524ef]
I0819 13:52:46.856537 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:46.860669 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:46.865075 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0819 13:52:46.865149 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0819 13:52:46.936606 152452 cri.go:89] found id: "a93e658c9c6602282efd1636668d5404651e1df0eaba230af4e0430877ea618d"
I0819 13:52:46.936634 152452 cri.go:89] found id: "6c7959865023d5c1d31e7b8c33d4dca318c0b748bfd18163a76a3658248a339d"
I0819 13:52:46.936640 152452 cri.go:89] found id: ""
I0819 13:52:46.936648 152452 logs.go:276] 2 containers: [a93e658c9c6602282efd1636668d5404651e1df0eaba230af4e0430877ea618d 6c7959865023d5c1d31e7b8c33d4dca318c0b748bfd18163a76a3658248a339d]
I0819 13:52:46.936720 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:46.942994 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:46.948231 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0819 13:52:46.948310 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0819 13:52:47.020145 152452 cri.go:89] found id: "2c334d0b02f94acf867081f56ef726d597384f48a9f72e1851695738231ec36d"
I0819 13:52:47.020172 152452 cri.go:89] found id: "8344283822b374d886d00d290f18631a7790271c48c1d318d5b00a1cf12609a5"
I0819 13:52:47.020177 152452 cri.go:89] found id: ""
I0819 13:52:47.020188 152452 logs.go:276] 2 containers: [2c334d0b02f94acf867081f56ef726d597384f48a9f72e1851695738231ec36d 8344283822b374d886d00d290f18631a7790271c48c1d318d5b00a1cf12609a5]
I0819 13:52:47.020279 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.024967 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.034264 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0819 13:52:47.034360 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0819 13:52:47.096009 152452 cri.go:89] found id: "db9a1d56a8be5f2c08c944dc19babddbd855957ea6d3d8e032408575130a610c"
I0819 13:52:47.096031 152452 cri.go:89] found id: "c2b76e34da1effdab4751291934d76bf6fae4d64b9a57c2e308028866ca67cc7"
I0819 13:52:47.096036 152452 cri.go:89] found id: ""
I0819 13:52:47.096043 152452 logs.go:276] 2 containers: [db9a1d56a8be5f2c08c944dc19babddbd855957ea6d3d8e032408575130a610c c2b76e34da1effdab4751291934d76bf6fae4d64b9a57c2e308028866ca67cc7]
I0819 13:52:47.096111 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.102562 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.109207 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0819 13:52:47.109283 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0819 13:52:47.184806 152452 cri.go:89] found id: "024882e3d4a5aa678ba55df81b6f10533d9f05f6977090d57dc692926959b303"
I0819 13:52:47.184828 152452 cri.go:89] found id: "d8e9102405c0bfd7286b17e5f2348226ea534b03ab646ed8bc5c514f697bdd28"
I0819 13:52:47.184833 152452 cri.go:89] found id: ""
I0819 13:52:47.184842 152452 logs.go:276] 2 containers: [024882e3d4a5aa678ba55df81b6f10533d9f05f6977090d57dc692926959b303 d8e9102405c0bfd7286b17e5f2348226ea534b03ab646ed8bc5c514f697bdd28]
I0819 13:52:47.184903 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.189384 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.194364 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0819 13:52:47.194448 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0819 13:52:47.265188 152452 cri.go:89] found id: "fa88625298f23e335aba94d646c993344de4ef6b8da759e9d9f176ae78f9a1fe"
I0819 13:52:47.265218 152452 cri.go:89] found id: "ff300c34901ca29544018036fcfb1d22bafcc0bace0dcf64fe0bd253b66ef58e"
I0819 13:52:47.265224 152452 cri.go:89] found id: ""
I0819 13:52:47.265231 152452 logs.go:276] 2 containers: [fa88625298f23e335aba94d646c993344de4ef6b8da759e9d9f176ae78f9a1fe ff300c34901ca29544018036fcfb1d22bafcc0bace0dcf64fe0bd253b66ef58e]
I0819 13:52:47.265303 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.269862 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.273980 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0819 13:52:47.274061 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0819 13:52:47.338484 152452 cri.go:89] found id: "c846487e7ff859548debeb2531a1f0b42651196f23aa0606336373cbd8cc2cb4"
I0819 13:52:47.338509 152452 cri.go:89] found id: "765975197bf640c76b530d4282ed5d13d03238e0ae93cd4aca67241e2f5152e9"
I0819 13:52:47.338515 152452 cri.go:89] found id: ""
I0819 13:52:47.338522 152452 logs.go:276] 2 containers: [c846487e7ff859548debeb2531a1f0b42651196f23aa0606336373cbd8cc2cb4 765975197bf640c76b530d4282ed5d13d03238e0ae93cd4aca67241e2f5152e9]
I0819 13:52:47.338580 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.343202 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.370668 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0819 13:52:47.370745 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0819 13:52:47.432108 152452 cri.go:89] found id: "65c22339ea6f7f88b4be1592c18662038b27eacd8db0d2a2f924fadc09a4238b"
I0819 13:52:47.432132 152452 cri.go:89] found id: "13a46bd05c3c5fdc6450ed883a254f38627921b9e47309563f0258e3056dc8fa"
I0819 13:52:47.432137 152452 cri.go:89] found id: ""
I0819 13:52:47.432160 152452 logs.go:276] 2 containers: [65c22339ea6f7f88b4be1592c18662038b27eacd8db0d2a2f924fadc09a4238b 13a46bd05c3c5fdc6450ed883a254f38627921b9e47309563f0258e3056dc8fa]
I0819 13:52:47.432231 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.438213 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.446636 152452 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0819 13:52:47.446722 152452 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0819 13:52:47.510037 152452 cri.go:89] found id: "15bd5cc6d84b0d0c4efce828950c59f373f1bc865ae66f1949d2eef2c9a95b75"
I0819 13:52:47.510060 152452 cri.go:89] found id: ""
I0819 13:52:47.510069 152452 logs.go:276] 1 containers: [15bd5cc6d84b0d0c4efce828950c59f373f1bc865ae66f1949d2eef2c9a95b75]
I0819 13:52:47.510144 152452 ssh_runner.go:195] Run: which crictl
I0819 13:52:47.515774 152452 logs.go:123] Gathering logs for etcd [a93e658c9c6602282efd1636668d5404651e1df0eaba230af4e0430877ea618d] ...
I0819 13:52:47.515814 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a93e658c9c6602282efd1636668d5404651e1df0eaba230af4e0430877ea618d"
I0819 13:52:47.636906 152452 logs.go:123] Gathering logs for storage-provisioner [65c22339ea6f7f88b4be1592c18662038b27eacd8db0d2a2f924fadc09a4238b] ...
I0819 13:52:47.636943 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 65c22339ea6f7f88b4be1592c18662038b27eacd8db0d2a2f924fadc09a4238b"
I0819 13:52:47.704121 152452 logs.go:123] Gathering logs for kubernetes-dashboard [15bd5cc6d84b0d0c4efce828950c59f373f1bc865ae66f1949d2eef2c9a95b75] ...
I0819 13:52:47.704152 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 15bd5cc6d84b0d0c4efce828950c59f373f1bc865ae66f1949d2eef2c9a95b75"
I0819 13:52:47.805660 152452 logs.go:123] Gathering logs for container status ...
I0819 13:52:47.805689 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0819 13:52:47.889024 152452 logs.go:123] Gathering logs for kubelet ...
I0819 13:52:47.889055 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0819 13:52:47.950679 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505154 660 reflector.go:138] object-"kube-system"/"coredns-token-mgkqs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-mgkqs" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:47.950954 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505275 660 reflector.go:138] object-"kube-system"/"storage-provisioner-token-vrkdd": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-vrkdd" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:47.951176 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505337 660 reflector.go:138] object-"kube-system"/"metrics-server-token-gngrg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-gngrg" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:47.951381 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505397 660 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:47.951596 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505458 660 reflector.go:138] object-"kube-system"/"kube-proxy-token-gvnrc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-gvnrc" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:47.951821 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505515 660 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:47.952031 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505568 660 reflector.go:138] object-"kube-system"/"kindnet-token-db6v8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-db6v8" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:47.952238 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:08 old-k8s-version-914579 kubelet[660]: E0819 13:47:08.505619 660 reflector.go:138] object-"default"/"default-token-ldqq4": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-ldqq4" is forbidden: User "system:node:old-k8s-version-914579" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-914579' and this object
W0819 13:52:47.959838 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:11 old-k8s-version-914579 kubelet[660]: E0819 13:47:11.700916 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0819 13:52:47.960028 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:11 old-k8s-version-914579 kubelet[660]: E0819 13:47:11.923497 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.962801 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:23 old-k8s-version-914579 kubelet[660]: E0819 13:47:23.556884 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0819 13:52:47.964806 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:38 old-k8s-version-914579 kubelet[660]: E0819 13:47:38.547027 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.965259 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:41 old-k8s-version-914579 kubelet[660]: E0819 13:47:41.081116 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.965718 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:42 old-k8s-version-914579 kubelet[660]: E0819 13:47:42.088354 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.966157 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:43 old-k8s-version-914579 kubelet[660]: E0819 13:47:43.093385 660 pod_workers.go:191] Error syncing pod e088dd49-745a-4473-b25c-b8b1bdef35d2 ("storage-provisioner_kube-system(e088dd49-745a-4473-b25c-b8b1bdef35d2)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(e088dd49-745a-4473-b25c-b8b1bdef35d2)"
W0819 13:52:47.966810 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:50 old-k8s-version-914579 kubelet[660]: E0819 13:47:50.143364 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.969243 152452 logs.go:138] Found kubelet problem: Aug 19 13:47:50 old-k8s-version-914579 kubelet[660]: E0819 13:47:50.539102 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0819 13:52:47.969559 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:04 old-k8s-version-914579 kubelet[660]: E0819 13:48:04.530531 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.970145 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:06 old-k8s-version-914579 kubelet[660]: E0819 13:48:06.204897 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.970473 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:10 old-k8s-version-914579 kubelet[660]: E0819 13:48:10.144306 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.970654 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:17 old-k8s-version-914579 kubelet[660]: E0819 13:48:17.533996 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.970983 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:22 old-k8s-version-914579 kubelet[660]: E0819 13:48:22.534681 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.971164 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:28 old-k8s-version-914579 kubelet[660]: E0819 13:48:28.530752 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.971618 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:35 old-k8s-version-914579 kubelet[660]: E0819 13:48:35.289738 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.972083 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:40 old-k8s-version-914579 kubelet[660]: E0819 13:48:40.144100 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.974502 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:40 old-k8s-version-914579 kubelet[660]: E0819 13:48:40.550260 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0819 13:52:47.974827 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:53 old-k8s-version-914579 kubelet[660]: E0819 13:48:53.530760 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.975011 152452 logs.go:138] Found kubelet problem: Aug 19 13:48:54 old-k8s-version-914579 kubelet[660]: E0819 13:48:54.530590 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.975335 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:05 old-k8s-version-914579 kubelet[660]: E0819 13:49:05.530108 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.975517 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:06 old-k8s-version-914579 kubelet[660]: E0819 13:49:06.531043 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.975699 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:19 old-k8s-version-914579 kubelet[660]: E0819 13:49:19.533642 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.976287 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:21 old-k8s-version-914579 kubelet[660]: E0819 13:49:21.435392 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.976615 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:30 old-k8s-version-914579 kubelet[660]: E0819 13:49:30.144187 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.976800 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:32 old-k8s-version-914579 kubelet[660]: E0819 13:49:32.530403 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.977129 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:41 old-k8s-version-914579 kubelet[660]: E0819 13:49:41.530796 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.977314 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:44 old-k8s-version-914579 kubelet[660]: E0819 13:49:44.530365 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.977643 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:55 old-k8s-version-914579 kubelet[660]: E0819 13:49:55.530750 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.977826 152452 logs.go:138] Found kubelet problem: Aug 19 13:49:57 old-k8s-version-914579 kubelet[660]: E0819 13:49:57.534986 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.978150 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:07 old-k8s-version-914579 kubelet[660]: E0819 13:50:07.530719 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.980581 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:11 old-k8s-version-914579 kubelet[660]: E0819 13:50:11.538819 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0819 13:52:47.980908 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:22 old-k8s-version-914579 kubelet[660]: E0819 13:50:22.530086 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.981091 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:25 old-k8s-version-914579 kubelet[660]: E0819 13:50:25.531673 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.981423 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:35 old-k8s-version-914579 kubelet[660]: E0819 13:50:35.530288 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.981610 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:38 old-k8s-version-914579 kubelet[660]: E0819 13:50:38.536408 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.981975 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:50 old-k8s-version-914579 kubelet[660]: E0819 13:50:50.531928 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.982431 152452 logs.go:138] Found kubelet problem: Aug 19 13:50:50 old-k8s-version-914579 kubelet[660]: E0819 13:50:50.676624 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.982758 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:00 old-k8s-version-914579 kubelet[660]: E0819 13:51:00.175960 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.982940 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:05 old-k8s-version-914579 kubelet[660]: E0819 13:51:05.532058 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.983266 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:13 old-k8s-version-914579 kubelet[660]: E0819 13:51:13.534019 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.983448 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:18 old-k8s-version-914579 kubelet[660]: E0819 13:51:18.530498 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.983773 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:25 old-k8s-version-914579 kubelet[660]: E0819 13:51:25.530598 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.983961 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:31 old-k8s-version-914579 kubelet[660]: E0819 13:51:31.530699 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.984287 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:36 old-k8s-version-914579 kubelet[660]: E0819 13:51:36.530142 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.984471 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:42 old-k8s-version-914579 kubelet[660]: E0819 13:51:42.530485 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.984797 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:48 old-k8s-version-914579 kubelet[660]: E0819 13:51:48.530149 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.984991 152452 logs.go:138] Found kubelet problem: Aug 19 13:51:54 old-k8s-version-914579 kubelet[660]: E0819 13:51:54.530585 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.985325 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:02 old-k8s-version-914579 kubelet[660]: E0819 13:52:02.531227 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.985511 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:07 old-k8s-version-914579 kubelet[660]: E0819 13:52:07.531110 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.985850 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:16 old-k8s-version-914579 kubelet[660]: E0819 13:52:16.530020 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.986033 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:22 old-k8s-version-914579 kubelet[660]: E0819 13:52:22.530508 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.986358 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:31 old-k8s-version-914579 kubelet[660]: E0819 13:52:31.532198 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.986541 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:33 old-k8s-version-914579 kubelet[660]: E0819 13:52:33.531083 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:47.986866 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:45 old-k8s-version-914579 kubelet[660]: E0819 13:52:45.532025 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:47.987049 152452 logs.go:138] Found kubelet problem: Aug 19 13:52:45 old-k8s-version-914579 kubelet[660]: E0819 13:52:45.532731 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0819 13:52:47.987058 152452 logs.go:123] Gathering logs for kube-apiserver [b779c421112b8e180714c33a49f2622b00391462fc2a2bfb51100d7824fdb234] ...
I0819 13:52:47.987074 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b779c421112b8e180714c33a49f2622b00391462fc2a2bfb51100d7824fdb234"
I0819 13:52:48.072238 152452 logs.go:123] Gathering logs for kube-apiserver [fcd65a8439964dae437d73a25791d2c38189fd5f9e340dc4e33ca0cc390524ef] ...
I0819 13:52:48.072277 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fcd65a8439964dae437d73a25791d2c38189fd5f9e340dc4e33ca0cc390524ef"
I0819 13:52:48.144742 152452 logs.go:123] Gathering logs for coredns [8344283822b374d886d00d290f18631a7790271c48c1d318d5b00a1cf12609a5] ...
I0819 13:52:48.144795 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8344283822b374d886d00d290f18631a7790271c48c1d318d5b00a1cf12609a5"
I0819 13:52:48.193011 152452 logs.go:123] Gathering logs for dmesg ...
I0819 13:52:48.193038 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0819 13:52:48.210157 152452 logs.go:123] Gathering logs for describe nodes ...
I0819 13:52:48.210198 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0819 13:52:48.374447 152452 logs.go:123] Gathering logs for kube-controller-manager [ff300c34901ca29544018036fcfb1d22bafcc0bace0dcf64fe0bd253b66ef58e] ...
I0819 13:52:48.374478 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ff300c34901ca29544018036fcfb1d22bafcc0bace0dcf64fe0bd253b66ef58e"
I0819 13:52:48.431668 152452 logs.go:123] Gathering logs for kindnet [765975197bf640c76b530d4282ed5d13d03238e0ae93cd4aca67241e2f5152e9] ...
I0819 13:52:48.431701 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 765975197bf640c76b530d4282ed5d13d03238e0ae93cd4aca67241e2f5152e9"
I0819 13:52:48.487205 152452 logs.go:123] Gathering logs for storage-provisioner [13a46bd05c3c5fdc6450ed883a254f38627921b9e47309563f0258e3056dc8fa] ...
I0819 13:52:48.487242 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 13a46bd05c3c5fdc6450ed883a254f38627921b9e47309563f0258e3056dc8fa"
I0819 13:52:48.547481 152452 logs.go:123] Gathering logs for containerd ...
I0819 13:52:48.547514 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0819 13:52:48.610774 152452 logs.go:123] Gathering logs for etcd [6c7959865023d5c1d31e7b8c33d4dca318c0b748bfd18163a76a3658248a339d] ...
I0819 13:52:48.610815 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6c7959865023d5c1d31e7b8c33d4dca318c0b748bfd18163a76a3658248a339d"
I0819 13:52:48.676770 152452 logs.go:123] Gathering logs for coredns [2c334d0b02f94acf867081f56ef726d597384f48a9f72e1851695738231ec36d] ...
I0819 13:52:48.676811 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2c334d0b02f94acf867081f56ef726d597384f48a9f72e1851695738231ec36d"
I0819 13:52:48.719917 152452 logs.go:123] Gathering logs for kube-scheduler [db9a1d56a8be5f2c08c944dc19babddbd855957ea6d3d8e032408575130a610c] ...
I0819 13:52:48.719995 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 db9a1d56a8be5f2c08c944dc19babddbd855957ea6d3d8e032408575130a610c"
I0819 13:52:48.764294 152452 logs.go:123] Gathering logs for kube-scheduler [c2b76e34da1effdab4751291934d76bf6fae4d64b9a57c2e308028866ca67cc7] ...
I0819 13:52:48.764367 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c2b76e34da1effdab4751291934d76bf6fae4d64b9a57c2e308028866ca67cc7"
I0819 13:52:48.807362 152452 logs.go:123] Gathering logs for kube-proxy [024882e3d4a5aa678ba55df81b6f10533d9f05f6977090d57dc692926959b303] ...
I0819 13:52:48.807437 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 024882e3d4a5aa678ba55df81b6f10533d9f05f6977090d57dc692926959b303"
I0819 13:52:48.846905 152452 logs.go:123] Gathering logs for kube-proxy [d8e9102405c0bfd7286b17e5f2348226ea534b03ab646ed8bc5c514f697bdd28] ...
I0819 13:52:48.846935 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d8e9102405c0bfd7286b17e5f2348226ea534b03ab646ed8bc5c514f697bdd28"
I0819 13:52:48.887930 152452 logs.go:123] Gathering logs for kube-controller-manager [fa88625298f23e335aba94d646c993344de4ef6b8da759e9d9f176ae78f9a1fe] ...
I0819 13:52:48.887962 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fa88625298f23e335aba94d646c993344de4ef6b8da759e9d9f176ae78f9a1fe"
I0819 13:52:48.948162 152452 logs.go:123] Gathering logs for kindnet [c846487e7ff859548debeb2531a1f0b42651196f23aa0606336373cbd8cc2cb4] ...
I0819 13:52:48.948198 152452 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c846487e7ff859548debeb2531a1f0b42651196f23aa0606336373cbd8cc2cb4"
I0819 13:52:49.017994 152452 out.go:358] Setting ErrFile to fd 2...
I0819 13:52:49.018028 152452 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0819 13:52:49.018115 152452 out.go:270] X Problems detected in kubelet:
W0819 13:52:49.018145 152452 out.go:270] Aug 19 13:52:22 old-k8s-version-914579 kubelet[660]: E0819 13:52:22.530508 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:49.018161 152452 out.go:270] Aug 19 13:52:31 old-k8s-version-914579 kubelet[660]: E0819 13:52:31.532198 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:49.018169 152452 out.go:270] Aug 19 13:52:33 old-k8s-version-914579 kubelet[660]: E0819 13:52:33.531083 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0819 13:52:49.018195 152452 out.go:270] Aug 19 13:52:45 old-k8s-version-914579 kubelet[660]: E0819 13:52:45.532025 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
W0819 13:52:49.018204 152452 out.go:270] Aug 19 13:52:45 old-k8s-version-914579 kubelet[660]: E0819 13:52:45.532731 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0819 13:52:49.018210 152452 out.go:358] Setting ErrFile to fd 2...
I0819 13:52:49.018223 152452 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0819 13:52:59.019588 152452 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0819 13:52:59.031741 152452 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0819 13:52:59.034833 152452 out.go:201]
W0819 13:52:59.037405 152452 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0819 13:52:59.037441 152452 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0819 13:52:59.037463 152452 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0819 13:52:59.037469 152452 out.go:270] *
W0819 13:52:59.038452 152452 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0819 13:52:59.042159 152452 out.go:201]
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
1d8cf51e8e1df 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 5ad7dde35b05d dashboard-metrics-scraper-8d5bb5db8-dtszp
65c22339ea6f7 ba04bb24b9575 5 minutes ago Running storage-provisioner 2 c8328693f153b storage-provisioner
15bd5cc6d84b0 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 4a3b75c207302 kubernetes-dashboard-cd95d586-xrfgh
2c334d0b02f94 db91994f4ee8f 5 minutes ago Running coredns 1 919af30cf66b2 coredns-74ff55c5b-8qwdj
c846487e7ff85 6a23fa8fd2b78 5 minutes ago Running kindnet-cni 1 47c8269345439 kindnet-mn7s7
13a46bd05c3c5 ba04bb24b9575 5 minutes ago Exited storage-provisioner 1 c8328693f153b storage-provisioner
9698d20ebef3f 1611cd07b61d5 5 minutes ago Running busybox 1 2ea2f885124f4 busybox
024882e3d4a5a 25a5233254979 5 minutes ago Running kube-proxy 1 91d93e5e2dfbf kube-proxy-h74p7
b779c421112b8 2c08bbbc02d3a 6 minutes ago Running kube-apiserver 1 1b67a3c8df769 kube-apiserver-old-k8s-version-914579
fa88625298f23 1df8a2b116bd1 6 minutes ago Running kube-controller-manager 1 f16ab2917075f kube-controller-manager-old-k8s-version-914579
db9a1d56a8be5 e7605f88f17d6 6 minutes ago Running kube-scheduler 1 d1dee2933b6b7 kube-scheduler-old-k8s-version-914579
a93e658c9c660 05b738aa1bc63 6 minutes ago Running etcd 1 bb9e727391a00 etcd-old-k8s-version-914579
066eb4ca58d7e 1611cd07b61d5 6 minutes ago Exited busybox 0 69941cbc11c9c busybox
8344283822b37 db91994f4ee8f 7 minutes ago Exited coredns 0 c58a4db5df99a coredns-74ff55c5b-8qwdj
765975197bf64 6a23fa8fd2b78 7 minutes ago Exited kindnet-cni 0 93ba08cc02ad3 kindnet-mn7s7
d8e9102405c0b 25a5233254979 7 minutes ago Exited kube-proxy 0 57d7700aac764 kube-proxy-h74p7
ff300c34901ca 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 0623cab670eb0 kube-controller-manager-old-k8s-version-914579
c2b76e34da1ef e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 b3c04887c5148 kube-scheduler-old-k8s-version-914579
fcd65a8439964 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 4fd5702632bcc kube-apiserver-old-k8s-version-914579
6c7959865023d 05b738aa1bc63 8 minutes ago Exited etcd 0 40a23eb18031e etcd-old-k8s-version-914579
==> containerd <==
Aug 19 13:49:20 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:49:20.548436642Z" level=info msg="CreateContainer within sandbox \"5ad7dde35b05da35a13022cb687dfead4e9184b0f3518184c3995bdd43123c1c\" for name:\"dashboard-metrics-scraper\" attempt:4 returns container id \"7ce7e0efc1480572df38ef0aa3ca83e2b51a46d1f8ef3c38c6f518096996dfb4\""
Aug 19 13:49:20 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:49:20.549028866Z" level=info msg="StartContainer for \"7ce7e0efc1480572df38ef0aa3ca83e2b51a46d1f8ef3c38c6f518096996dfb4\""
Aug 19 13:49:20 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:49:20.621699842Z" level=info msg="StartContainer for \"7ce7e0efc1480572df38ef0aa3ca83e2b51a46d1f8ef3c38c6f518096996dfb4\" returns successfully"
Aug 19 13:49:20 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:49:20.646752411Z" level=info msg="shim disconnected" id=7ce7e0efc1480572df38ef0aa3ca83e2b51a46d1f8ef3c38c6f518096996dfb4 namespace=k8s.io
Aug 19 13:49:20 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:49:20.646823402Z" level=warning msg="cleaning up after shim disconnected" id=7ce7e0efc1480572df38ef0aa3ca83e2b51a46d1f8ef3c38c6f518096996dfb4 namespace=k8s.io
Aug 19 13:49:20 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:49:20.646834454Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 19 13:49:21 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:49:21.439875089Z" level=info msg="RemoveContainer for \"bb63992e0eeade6822d8519238350fc6c435043d69613dc6c4e76de1967ec718\""
Aug 19 13:49:21 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:49:21.444768535Z" level=info msg="RemoveContainer for \"bb63992e0eeade6822d8519238350fc6c435043d69613dc6c4e76de1967ec718\" returns successfully"
Aug 19 13:50:11 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:50:11.531272557Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 19 13:50:11 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:50:11.536745206Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Aug 19 13:50:11 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:50:11.538294723Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Aug 19 13:50:11 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:50:11.538388269Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Aug 19 13:50:49 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:50:49.532349389Z" level=info msg="CreateContainer within sandbox \"5ad7dde35b05da35a13022cb687dfead4e9184b0f3518184c3995bdd43123c1c\" for container name:\"dashboard-metrics-scraper\" attempt:5"
Aug 19 13:50:49 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:50:49.550389913Z" level=info msg="CreateContainer within sandbox \"5ad7dde35b05da35a13022cb687dfead4e9184b0f3518184c3995bdd43123c1c\" for name:\"dashboard-metrics-scraper\" attempt:5 returns container id \"1d8cf51e8e1df44c1906f7991aaa3f767cff269e3c24ff41313cd922abeec2fd\""
Aug 19 13:50:49 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:50:49.551048172Z" level=info msg="StartContainer for \"1d8cf51e8e1df44c1906f7991aaa3f767cff269e3c24ff41313cd922abeec2fd\""
Aug 19 13:50:49 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:50:49.628798508Z" level=info msg="StartContainer for \"1d8cf51e8e1df44c1906f7991aaa3f767cff269e3c24ff41313cd922abeec2fd\" returns successfully"
Aug 19 13:50:49 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:50:49.654496261Z" level=info msg="shim disconnected" id=1d8cf51e8e1df44c1906f7991aaa3f767cff269e3c24ff41313cd922abeec2fd namespace=k8s.io
Aug 19 13:50:49 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:50:49.654561048Z" level=warning msg="cleaning up after shim disconnected" id=1d8cf51e8e1df44c1906f7991aaa3f767cff269e3c24ff41313cd922abeec2fd namespace=k8s.io
Aug 19 13:50:49 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:50:49.654572437Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 19 13:50:50 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:50:50.678224331Z" level=info msg="RemoveContainer for \"7ce7e0efc1480572df38ef0aa3ca83e2b51a46d1f8ef3c38c6f518096996dfb4\""
Aug 19 13:50:50 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:50:50.686578663Z" level=info msg="RemoveContainer for \"7ce7e0efc1480572df38ef0aa3ca83e2b51a46d1f8ef3c38c6f518096996dfb4\" returns successfully"
Aug 19 13:52:58 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:52:58.531081073Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 19 13:52:58 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:52:58.538301771Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Aug 19 13:52:58 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:52:58.540440690Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Aug 19 13:52:58 old-k8s-version-914579 containerd[569]: time="2024-08-19T13:52:58.540460899Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
==> coredns [2c334d0b02f94acf867081f56ef726d597384f48a9f72e1851695738231ec36d] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:43201 - 44516 "HINFO IN 7720021647339411727.4504186340590290532. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.011119709s
==> coredns [8344283822b374d886d00d290f18631a7790271c48c1d318d5b00a1cf12609a5] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:34525 - 54311 "HINFO IN 3562076921747927934.6242343775789087393. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.011868523s
==> describe nodes <==
Name: old-k8s-version-914579
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-914579
kubernetes.io/os=linux
minikube.k8s.io/commit=c539cede7c104fd836c3af55c4ca24a6409a3ce6
minikube.k8s.io/name=old-k8s-version-914579
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_08_19T13_44_46_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 19 Aug 2024 13:44:42 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-914579
AcquireTime: <unset>
RenewTime: Mon, 19 Aug 2024 13:52:51 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 19 Aug 2024 13:47:59 +0000 Mon, 19 Aug 2024 13:44:35 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 19 Aug 2024 13:47:59 +0000 Mon, 19 Aug 2024 13:44:35 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 19 Aug 2024 13:47:59 +0000 Mon, 19 Aug 2024 13:44:35 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 19 Aug 2024 13:47:59 +0000 Mon, 19 Aug 2024 13:45:01 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-914579
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022364Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022364Ki
pods: 110
System Info:
Machine ID: 92ae8e36aa874bb3b21c4b727e8f2a62
System UUID: c676933b-07bb-4b7a-af64-79fa59068f2b
Boot ID: 8c9f4b3e-6245-4429-b714-db63b5b637f4
Kernel Version: 5.15.0-1067-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.20
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m43s
kube-system coredns-74ff55c5b-8qwdj 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 8m
kube-system etcd-old-k8s-version-914579 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 8m7s
kube-system kindnet-mn7s7 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 8m
kube-system kube-apiserver-old-k8s-version-914579 250m (12%) 0 (0%) 0 (0%) 0 (0%) 8m7s
kube-system kube-controller-manager-old-k8s-version-914579 200m (10%) 0 (0%) 0 (0%) 0 (0%) 8m7s
kube-system kube-proxy-h74p7 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m
kube-system kube-scheduler-old-k8s-version-914579 100m (5%) 0 (0%) 0 (0%) 0 (0%) 8m7s
kube-system metrics-server-9975d5f86-ncd6r 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 6m33s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 7m58s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-dtszp 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m34s
kubernetes-dashboard kubernetes-dashboard-cd95d586-xrfgh 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m34s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%) 100m (5%)
memory 420Mi (5%) 220Mi (2%)
ephemeral-storage 100Mi (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m27s (x5 over 8m27s) kubelet Node old-k8s-version-914579 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m27s (x5 over 8m27s) kubelet Node old-k8s-version-914579 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m27s (x4 over 8m27s) kubelet Node old-k8s-version-914579 status is now: NodeHasSufficientPID
Normal Starting 8m8s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m8s kubelet Node old-k8s-version-914579 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m8s kubelet Node old-k8s-version-914579 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m8s kubelet Node old-k8s-version-914579 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m7s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m kubelet Node old-k8s-version-914579 status is now: NodeReady
Normal Starting 7m59s kube-proxy Starting kube-proxy.
Normal Starting 6m4s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 6m4s (x8 over 6m4s) kubelet Node old-k8s-version-914579 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m4s (x8 over 6m4s) kubelet Node old-k8s-version-914579 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m4s (x7 over 6m4s) kubelet Node old-k8s-version-914579 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 6m4s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m49s kube-proxy Starting kube-proxy.
==> dmesg <==
[Aug19 12:28] overlayfs: '/var/lib/containers/storage/overlay/l/Q2QJNMTVZL6GMULS36RA5ZJGSA' not a directory
==> etcd [6c7959865023d5c1d31e7b8c33d4dca318c0b748bfd18163a76a3658248a339d] <==
2024-08-19 13:44:35.197188 I | etcdserver/membership: added member ea7e25599daad906 [https://192.168.76.2:2380] to cluster 6f20f2c4b2fb5f8a
raft2024/08/19 13:44:35 INFO: ea7e25599daad906 is starting a new election at term 1
raft2024/08/19 13:44:35 INFO: ea7e25599daad906 became candidate at term 2
raft2024/08/19 13:44:35 INFO: ea7e25599daad906 received MsgVoteResp from ea7e25599daad906 at term 2
raft2024/08/19 13:44:35 INFO: ea7e25599daad906 became leader at term 2
raft2024/08/19 13:44:35 INFO: raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2
2024-08-19 13:44:35.364702 I | etcdserver: published {Name:old-k8s-version-914579 ClientURLs:[https://192.168.76.2:2379]} to cluster 6f20f2c4b2fb5f8a
2024-08-19 13:44:35.365047 I | embed: ready to serve client requests
2024-08-19 13:44:35.366783 I | embed: ready to serve client requests
2024-08-19 13:44:35.367488 I | etcdserver: setting up the initial cluster version to 3.4
2024-08-19 13:44:35.373447 I | embed: serving client requests on 127.0.0.1:2379
2024-08-19 13:44:35.374160 N | etcdserver/membership: set the initial cluster version to 3.4
2024-08-19 13:44:35.374811 I | etcdserver/api: enabled capabilities for version 3.4
2024-08-19 13:44:35.385921 I | embed: serving client requests on 192.168.76.2:2379
2024-08-19 13:44:57.051017 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:44:57.891470 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:45:07.889817 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:45:17.888797 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:45:27.888789 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:45:37.892534 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:45:47.889565 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:45:57.889109 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:46:07.889170 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:46:17.888799 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:46:27.895041 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [a93e658c9c6602282efd1636668d5404651e1df0eaba230af4e0430877ea618d] <==
2024-08-19 13:48:55.814061 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:49:05.814010 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:49:15.814183 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:49:25.814019 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:49:35.814161 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:49:45.814152 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:49:55.814015 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:50:05.814096 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:50:15.814140 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:50:25.813891 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:50:35.814421 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:50:45.813984 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:50:55.814105 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:51:05.814303 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:51:15.814191 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:51:25.814142 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:51:35.814064 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:51:45.814077 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:51:55.814168 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:52:05.814083 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:52:15.814087 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:52:25.814048 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:52:35.814157 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:52:45.814748 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-19 13:52:55.813967 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
13:53:01 up 1 day, 3:35, 0 users, load average: 0.51, 1.73, 2.57
Linux old-k8s-version-914579 5.15.0-1067-aws #73~20.04.1-Ubuntu SMP Wed Jul 24 17:31:05 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [765975197bf640c76b530d4282ed5d13d03238e0ae93cd4aca67241e2f5152e9] <==
I0819 13:45:24.993133 1 main.go:299] handling current node
W0819 13:45:26.421864 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0819 13:45:26.421897 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0819 13:45:34.993442 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0819 13:45:34.993479 1 main.go:299] handling current node
W0819 13:45:39.169771 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0819 13:45:39.169883 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
W0819 13:45:42.798915 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0819 13:45:42.799031 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0819 13:45:44.992792 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0819 13:45:44.992834 1 main.go:299] handling current node
W0819 13:45:47.438178 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0819 13:45:47.438211 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0819 13:45:54.992657 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0819 13:45:54.992696 1 main.go:299] handling current node
I0819 13:46:04.993093 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0819 13:46:04.993129 1 main.go:299] handling current node
I0819 13:46:14.993630 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0819 13:46:14.993663 1 main.go:299] handling current node
W0819 13:46:20.699111 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0819 13:46:20.699153 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0819 13:46:24.992803 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0819 13:46:24.992840 1 main.go:299] handling current node
W0819 13:46:26.160531 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0819 13:46:26.160574 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
==> kindnet [c846487e7ff859548debeb2531a1f0b42651196f23aa0606336373cbd8cc2cb4] <==
E0819 13:51:51.285318 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0819 13:51:52.617439 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0819 13:51:52.617478 1 main.go:299] handling current node
W0819 13:52:02.107232 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0819 13:52:02.107266 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0819 13:52:02.616828 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0819 13:52:02.616864 1 main.go:299] handling current node
I0819 13:52:12.616965 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0819 13:52:12.616999 1 main.go:299] handling current node
I0819 13:52:22.616733 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0819 13:52:22.616779 1 main.go:299] handling current node
W0819 13:52:23.547745 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0819 13:52:23.547869 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
W0819 13:52:29.287535 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0819 13:52:29.287574 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0819 13:52:32.617562 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0819 13:52:32.617605 1 main.go:299] handling current node
I0819 13:52:42.617281 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0819 13:52:42.617319 1 main.go:299] handling current node
W0819 13:52:42.733348 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0819 13:52:42.733385 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0819 13:52:52.617581 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0819 13:52:52.617624 1 main.go:299] handling current node
W0819 13:52:55.466333 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0819 13:52:55.466408 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
==> kube-apiserver [b779c421112b8e180714c33a49f2622b00391462fc2a2bfb51100d7824fdb234] <==
I0819 13:49:01.158263 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0819 13:49:01.158272 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0819 13:49:43.561969 1 client.go:360] parsed scheme: "passthrough"
I0819 13:49:43.562017 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0819 13:49:43.562049 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0819 13:50:12.186704 1 handler_proxy.go:102] no RequestInfo found in the context
E0819 13:50:12.186781 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0819 13:50:12.186796 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0819 13:50:25.366718 1 client.go:360] parsed scheme: "passthrough"
I0819 13:50:25.366770 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0819 13:50:25.366779 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0819 13:51:09.836026 1 client.go:360] parsed scheme: "passthrough"
I0819 13:51:09.836077 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0819 13:51:09.836086 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0819 13:51:54.822596 1 client.go:360] parsed scheme: "passthrough"
I0819 13:51:54.822644 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0819 13:51:54.822654 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0819 13:52:09.712967 1 handler_proxy.go:102] no RequestInfo found in the context
E0819 13:52:09.713040 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0819 13:52:09.713049 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0819 13:52:36.293207 1 client.go:360] parsed scheme: "passthrough"
I0819 13:52:36.293252 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0819 13:52:36.293261 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [fcd65a8439964dae437d73a25791d2c38189fd5f9e340dc4e33ca0cc390524ef] <==
I0819 13:44:42.730863 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I0819 13:44:42.743485 1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000
I0819 13:44:42.748890 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I0819 13:44:42.749075 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0819 13:44:43.281668 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0819 13:44:43.332483 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0819 13:44:43.458825 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
I0819 13:44:43.461295 1 controller.go:606] quota admission added evaluator for: endpoints
I0819 13:44:43.465764 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0819 13:44:44.460089 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0819 13:44:45.326071 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0819 13:44:45.387606 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0819 13:44:53.847398 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0819 13:45:01.508951 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0819 13:45:01.519895 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0819 13:45:14.668430 1 client.go:360] parsed scheme: "passthrough"
I0819 13:45:14.668488 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0819 13:45:14.668497 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0819 13:45:53.126727 1 client.go:360] parsed scheme: "passthrough"
I0819 13:45:53.126773 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0819 13:45:53.126782 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0819 13:46:27.841138 1 client.go:360] parsed scheme: "passthrough"
I0819 13:46:27.841387 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0819 13:46:27.841515 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
E0819 13:46:27.941990 1 available_controller.go:508] v1beta1.metrics.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1beta1.metrics.k8s.io": the object has been modified; please apply your changes to the latest version and try again
==> kube-controller-manager [fa88625298f23e335aba94d646c993344de4ef6b8da759e9d9f176ae78f9a1fe] <==
W0819 13:48:33.039401 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0819 13:48:59.147131 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0819 13:49:04.690048 1 request.go:655] Throttling request took 1.048397344s, request: GET:https://192.168.76.2:8443/apis/autoscaling/v2beta2?timeout=32s
W0819 13:49:05.554341 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0819 13:49:29.649517 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0819 13:49:37.205039 1 request.go:655] Throttling request took 1.048229101s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0819 13:49:38.057618 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0819 13:50:00.163669 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0819 13:50:09.708223 1 request.go:655] Throttling request took 1.048363375s, request: GET:https://192.168.76.2:8443/apis/batch/v1beta1?timeout=32s
W0819 13:50:10.559881 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0819 13:50:30.681859 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0819 13:50:42.210339 1 request.go:655] Throttling request took 1.048333518s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0819 13:50:43.061838 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0819 13:51:01.183830 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0819 13:51:14.712384 1 request.go:655] Throttling request took 1.048172222s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0819 13:51:15.564014 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0819 13:51:31.685828 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0819 13:51:47.214392 1 request.go:655] Throttling request took 1.047812754s, request: GET:https://192.168.76.2:8443/apis/networking.k8s.io/v1beta1?timeout=32s
W0819 13:51:48.066295 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0819 13:52:02.187655 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0819 13:52:19.716725 1 request.go:655] Throttling request took 1.048210526s, request: GET:https://192.168.76.2:8443/apis/admissionregistration.k8s.io/v1beta1?timeout=32s
W0819 13:52:20.568212 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0819 13:52:32.689542 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0819 13:52:52.218699 1 request.go:655] Throttling request took 1.048241801s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0819 13:52:53.070382 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-controller-manager [ff300c34901ca29544018036fcfb1d22bafcc0bace0dcf64fe0bd253b66ef58e] <==
I0819 13:45:01.476840 1 shared_informer.go:247] Caches are synced for ReplicationController
I0819 13:45:01.488600 1 shared_informer.go:247] Caches are synced for attach detach
I0819 13:45:01.496190 1 shared_informer.go:247] Caches are synced for taint
I0819 13:45:01.496202 1 shared_informer.go:247] Caches are synced for disruption
I0819 13:45:01.496219 1 disruption.go:339] Sending events to api server.
I0819 13:45:01.496269 1 shared_informer.go:247] Caches are synced for daemon sets
I0819 13:45:01.496271 1 node_lifecycle_controller.go:1429] Initializing eviction metric for zone:
W0819 13:45:01.496338 1 node_lifecycle_controller.go:1044] Missing timestamp for Node old-k8s-version-914579. Assuming now as a timestamp.
I0819 13:45:01.496380 1 node_lifecycle_controller.go:1245] Controller detected that zone is now in state Normal.
I0819 13:45:01.496424 1 event.go:291] "Event occurred" object="old-k8s-version-914579" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node old-k8s-version-914579 event: Registered Node old-k8s-version-914579 in Controller"
I0819 13:45:01.496436 1 shared_informer.go:247] Caches are synced for deployment
I0819 13:45:01.497153 1 taint_manager.go:187] Starting NoExecuteTaintManager
I0819 13:45:01.598194 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-74ff55c5b to 2"
I0819 13:45:01.598712 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-5zwrf"
I0819 13:45:01.598895 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-mn7s7"
I0819 13:45:01.657765 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0819 13:45:01.672836 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-8qwdj"
I0819 13:45:01.673958 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-h74p7"
I0819 13:45:01.857874 1 shared_informer.go:247] Caches are synced for garbage collector
I0819 13:45:01.946344 1 shared_informer.go:247] Caches are synced for garbage collector
I0819 13:45:01.946390 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0819 13:45:03.166727 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0819 13:45:03.213194 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-5zwrf"
I0819 13:46:27.685087 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
E0819 13:46:27.802315 1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
==> kube-proxy [024882e3d4a5aa678ba55df81b6f10533d9f05f6977090d57dc692926959b303] <==
I0819 13:47:12.169390 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0819 13:47:12.169479 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0819 13:47:12.191003 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0819 13:47:12.191100 1 server_others.go:185] Using iptables Proxier.
I0819 13:47:12.191306 1 server.go:650] Version: v1.20.0
I0819 13:47:12.191877 1 config.go:315] Starting service config controller
I0819 13:47:12.191886 1 shared_informer.go:240] Waiting for caches to sync for service config
I0819 13:47:12.207062 1 config.go:224] Starting endpoint slice config controller
I0819 13:47:12.207098 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0819 13:47:12.292058 1 shared_informer.go:247] Caches are synced for service config
I0819 13:47:12.307487 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-proxy [d8e9102405c0bfd7286b17e5f2348226ea534b03ab646ed8bc5c514f697bdd28] <==
I0819 13:45:02.617070 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0819 13:45:02.617352 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0819 13:45:02.639772 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0819 13:45:02.640299 1 server_others.go:185] Using iptables Proxier.
I0819 13:45:02.640652 1 server.go:650] Version: v1.20.0
I0819 13:45:02.641469 1 config.go:315] Starting service config controller
I0819 13:45:02.641615 1 shared_informer.go:240] Waiting for caches to sync for service config
I0819 13:45:02.641722 1 config.go:224] Starting endpoint slice config controller
I0819 13:45:02.641808 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0819 13:45:02.746716 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0819 13:45:02.746777 1 shared_informer.go:247] Caches are synced for service config
==> kube-scheduler [c2b76e34da1effdab4751291934d76bf6fae4d64b9a57c2e308028866ca67cc7] <==
W0819 13:44:41.864748 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0819 13:44:41.864753 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0819 13:44:41.956754 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0819 13:44:41.961984 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0819 13:44:41.962234 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0819 13:44:41.962380 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0819 13:44:41.975730 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0819 13:44:41.976179 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0819 13:44:41.976300 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0819 13:44:41.976382 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0819 13:44:41.976230 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0819 13:44:41.978626 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0819 13:44:41.979029 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0819 13:44:41.979354 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0819 13:44:41.979586 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0819 13:44:41.979932 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0819 13:44:41.982551 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0819 13:44:41.983944 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0819 13:44:42.840652 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0819 13:44:42.860000 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0819 13:44:43.019337 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0819 13:44:43.033636 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0819 13:44:43.034997 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0819 13:44:43.046743 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
I0819 13:44:43.562536 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [db9a1d56a8be5f2c08c944dc19babddbd855957ea6d3d8e032408575130a610c] <==
I0819 13:47:03.635518 1 serving.go:331] Generated self-signed cert in-memory
W0819 13:47:08.459292 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0819 13:47:08.459323 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0819 13:47:08.459342 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0819 13:47:08.459347 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0819 13:47:08.797468 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0819 13:47:08.809782 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0819 13:47:08.810024 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0819 13:47:08.814072 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0819 13:47:09.019028 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Aug 19 13:51:31 old-k8s-version-914579 kubelet[660]: E0819 13:51:31.530699 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 19 13:51:36 old-k8s-version-914579 kubelet[660]: I0819 13:51:36.529792 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 1d8cf51e8e1df44c1906f7991aaa3f767cff269e3c24ff41313cd922abeec2fd
Aug 19 13:51:36 old-k8s-version-914579 kubelet[660]: E0819 13:51:36.530142 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
Aug 19 13:51:42 old-k8s-version-914579 kubelet[660]: E0819 13:51:42.530485 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 19 13:51:48 old-k8s-version-914579 kubelet[660]: I0819 13:51:48.529793 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 1d8cf51e8e1df44c1906f7991aaa3f767cff269e3c24ff41313cd922abeec2fd
Aug 19 13:51:48 old-k8s-version-914579 kubelet[660]: E0819 13:51:48.530149 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
Aug 19 13:51:54 old-k8s-version-914579 kubelet[660]: E0819 13:51:54.530585 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 19 13:52:02 old-k8s-version-914579 kubelet[660]: I0819 13:52:02.529963 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 1d8cf51e8e1df44c1906f7991aaa3f767cff269e3c24ff41313cd922abeec2fd
Aug 19 13:52:02 old-k8s-version-914579 kubelet[660]: E0819 13:52:02.531227 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
Aug 19 13:52:07 old-k8s-version-914579 kubelet[660]: E0819 13:52:07.531110 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 19 13:52:16 old-k8s-version-914579 kubelet[660]: I0819 13:52:16.529668 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 1d8cf51e8e1df44c1906f7991aaa3f767cff269e3c24ff41313cd922abeec2fd
Aug 19 13:52:16 old-k8s-version-914579 kubelet[660]: E0819 13:52:16.530020 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
Aug 19 13:52:22 old-k8s-version-914579 kubelet[660]: E0819 13:52:22.530508 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 19 13:52:31 old-k8s-version-914579 kubelet[660]: I0819 13:52:31.529894 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 1d8cf51e8e1df44c1906f7991aaa3f767cff269e3c24ff41313cd922abeec2fd
Aug 19 13:52:31 old-k8s-version-914579 kubelet[660]: E0819 13:52:31.532198 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
Aug 19 13:52:33 old-k8s-version-914579 kubelet[660]: E0819 13:52:33.531083 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 19 13:52:45 old-k8s-version-914579 kubelet[660]: I0819 13:52:45.530907 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 1d8cf51e8e1df44c1906f7991aaa3f767cff269e3c24ff41313cd922abeec2fd
Aug 19 13:52:45 old-k8s-version-914579 kubelet[660]: E0819 13:52:45.532025 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
Aug 19 13:52:45 old-k8s-version-914579 kubelet[660]: E0819 13:52:45.532731 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 19 13:52:57 old-k8s-version-914579 kubelet[660]: I0819 13:52:57.530227 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 1d8cf51e8e1df44c1906f7991aaa3f767cff269e3c24ff41313cd922abeec2fd
Aug 19 13:52:57 old-k8s-version-914579 kubelet[660]: E0819 13:52:57.531096 660 pod_workers.go:191] Error syncing pod 092dcf56-3dcc-4679-ab9a-383cd577ebc3 ("dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-dtszp_kubernetes-dashboard(092dcf56-3dcc-4679-ab9a-383cd577ebc3)"
Aug 19 13:52:58 old-k8s-version-914579 kubelet[660]: E0819 13:52:58.540848 660 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Aug 19 13:52:58 old-k8s-version-914579 kubelet[660]: E0819 13:52:58.541264 660 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Aug 19 13:52:58 old-k8s-version-914579 kubelet[660]: E0819 13:52:58.541424 660 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-gngrg,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba
8-e312-4ded-a04c-d370bd6787a0): ErrImagePull: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Aug 19 13:52:58 old-k8s-version-914579 kubelet[660]: E0819 13:52:58.541477 660 pod_workers.go:191] Error syncing pod a1bd7ba8-e312-4ded-a04c-d370bd6787a0 ("metrics-server-9975d5f86-ncd6r_kube-system(a1bd7ba8-e312-4ded-a04c-d370bd6787a0)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
==> kubernetes-dashboard [15bd5cc6d84b0d0c4efce828950c59f373f1bc865ae66f1949d2eef2c9a95b75] <==
2024/08/19 13:47:33 Starting overwatch
2024/08/19 13:47:33 Using namespace: kubernetes-dashboard
2024/08/19 13:47:33 Using in-cluster config to connect to apiserver
2024/08/19 13:47:33 Using secret token for csrf signing
2024/08/19 13:47:33 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/08/19 13:47:33 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/08/19 13:47:33 Successful initial request to the apiserver, version: v1.20.0
2024/08/19 13:47:33 Generating JWE encryption key
2024/08/19 13:47:33 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/08/19 13:47:33 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/08/19 13:47:33 Initializing JWE encryption key from synchronized object
2024/08/19 13:47:33 Creating in-cluster Sidecar client
2024/08/19 13:47:33 Serving insecurely on HTTP port: 9090
2024/08/19 13:47:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/19 13:48:03 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/19 13:48:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/19 13:49:03 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/19 13:49:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/19 13:50:03 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/19 13:50:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/19 13:51:03 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/19 13:51:34 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/19 13:52:04 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/19 13:52:34 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
==> storage-provisioner [13a46bd05c3c5fdc6450ed883a254f38627921b9e47309563f0258e3056dc8fa] <==
I0819 13:47:12.124911 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0819 13:47:42.136592 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
==> storage-provisioner [65c22339ea6f7f88b4be1592c18662038b27eacd8db0d2a2f924fadc09a4238b] <==
I0819 13:47:55.648858 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0819 13:47:55.675565 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0819 13:47:55.675619 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0819 13:48:13.145190 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0819 13:48:13.145614 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-914579_c50876fa-3db7-4a6b-af10-d1714b7aebfa!
I0819 13:48:13.147540 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"31c5f26d-fefe-485e-8a85-8fde3a663c24", APIVersion:"v1", ResourceVersion:"830", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-914579_c50876fa-3db7-4a6b-af10-d1714b7aebfa became leader
I0819 13:48:13.246455 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-914579_c50876fa-3db7-4a6b-af10-d1714b7aebfa!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-914579 -n old-k8s-version-914579
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-914579 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-ncd6r
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-914579 describe pod metrics-server-9975d5f86-ncd6r
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-914579 describe pod metrics-server-9975d5f86-ncd6r: exit status 1 (190.65589ms)
** stderr **
E0819 13:53:03.179066 165494 memcache.go:287] "Unhandled Error" err="couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request"
E0819 13:53:03.197563 165494 memcache.go:121] "Unhandled Error" err="couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request"
E0819 13:53:03.202168 165494 memcache.go:121] "Unhandled Error" err="couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request"
E0819 13:53:03.207879 165494 memcache.go:121] "Unhandled Error" err="couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request"
E0819 13:53:03.217026 165494 memcache.go:121] "Unhandled Error" err="couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request"
E0819 13:53:03.223387 165494 memcache.go:121] "Unhandled Error" err="couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request"
Error from server (NotFound): pods "metrics-server-9975d5f86-ncd6r" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-914579 describe pod metrics-server-9975d5f86-ncd6r: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (382.41s)