=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-820414 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-820414 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m16.160443961s)
-- stdout --
* [old-k8s-version-820414] minikube v1.33.1 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=19364
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19364-1180294/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19364-1180294/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
* Using the docker driver based on existing profile
* Starting "old-k8s-version-820414" primary control-plane node in "old-k8s-version-820414" cluster
* Pulling base image v0.0.44-1721902582-19326 ...
* Restarting existing docker container for "old-k8s-version-820414" ...
* Preparing Kubernetes v1.20.0 on containerd 1.7.19 ...
* Verifying Kubernetes components...
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image fake.domain/registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-820414 addons enable metrics-server
* Enabled addons: metrics-server, storage-provisioner, default-storageclass, dashboard
-- /stdout --
** stderr **
I0803 23:39:14.147491 1389119 out.go:291] Setting OutFile to fd 1 ...
I0803 23:39:14.147636 1389119 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0803 23:39:14.147647 1389119 out.go:304] Setting ErrFile to fd 2...
I0803 23:39:14.147653 1389119 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0803 23:39:14.147998 1389119 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19364-1180294/.minikube/bin
I0803 23:39:14.148430 1389119 out.go:298] Setting JSON to false
I0803 23:39:14.149516 1389119 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":30100,"bootTime":1722698255,"procs":209,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0803 23:39:14.149616 1389119 start.go:139] virtualization:
I0803 23:39:14.152711 1389119 out.go:177] * [old-k8s-version-820414] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0803 23:39:14.155215 1389119 out.go:177] - MINIKUBE_LOCATION=19364
I0803 23:39:14.155516 1389119 notify.go:220] Checking for updates...
I0803 23:39:14.159562 1389119 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0803 23:39:14.161757 1389119 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19364-1180294/kubeconfig
I0803 23:39:14.163888 1389119 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19364-1180294/.minikube
I0803 23:39:14.165684 1389119 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0803 23:39:14.167888 1389119 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0803 23:39:14.170160 1389119 config.go:182] Loaded profile config "old-k8s-version-820414": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0803 23:39:14.173054 1389119 out.go:177] * Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
I0803 23:39:14.175100 1389119 driver.go:392] Setting default libvirt URI to qemu:///system
I0803 23:39:14.197810 1389119 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
I0803 23:39:14.197926 1389119 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0803 23:39:14.263429 1389119 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:51 SystemTime:2024-08-03 23:39:14.253633743 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0803 23:39:14.263543 1389119 docker.go:307] overlay module found
I0803 23:39:14.266105 1389119 out.go:177] * Using the docker driver based on existing profile
I0803 23:39:14.267922 1389119 start.go:297] selected driver: docker
I0803 23:39:14.267940 1389119 start.go:901] validating driver "docker" against &{Name:old-k8s-version-820414 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-820414 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0803 23:39:14.268045 1389119 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0803 23:39:14.268699 1389119 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0803 23:39:14.326873 1389119 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:51 SystemTime:2024-08-03 23:39:14.317409427 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0803 23:39:14.327278 1389119 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0803 23:39:14.327310 1389119 cni.go:84] Creating CNI manager for ""
I0803 23:39:14.327318 1389119 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0803 23:39:14.327371 1389119 start.go:340] cluster config:
{Name:old-k8s-version-820414 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-820414 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0803 23:39:14.329794 1389119 out.go:177] * Starting "old-k8s-version-820414" primary control-plane node in "old-k8s-version-820414" cluster
I0803 23:39:14.331520 1389119 cache.go:121] Beginning downloading kic base image for docker with containerd
I0803 23:39:14.333883 1389119 out.go:177] * Pulling base image v0.0.44-1721902582-19326 ...
I0803 23:39:14.335569 1389119 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0803 23:39:14.335624 1389119 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19364-1180294/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0803 23:39:14.335636 1389119 cache.go:56] Caching tarball of preloaded images
I0803 23:39:14.335644 1389119 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local docker daemon
I0803 23:39:14.335713 1389119 preload.go:172] Found /home/jenkins/minikube-integration/19364-1180294/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0803 23:39:14.335723 1389119 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0803 23:39:14.335865 1389119 profile.go:143] Saving config to /home/jenkins/minikube-integration/19364-1180294/.minikube/profiles/old-k8s-version-820414/config.json ...
W0803 23:39:14.354758 1389119 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 is of wrong architecture
I0803 23:39:14.354787 1389119 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 to local cache
I0803 23:39:14.354857 1389119 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory
I0803 23:39:14.354881 1389119 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory, skipping pull
I0803 23:39:14.354886 1389119 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 exists in cache, skipping pull
I0803 23:39:14.354895 1389119 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 as a tarball
I0803 23:39:14.354903 1389119 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from local cache
I0803 23:39:14.476368 1389119 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from cached tarball
I0803 23:39:14.476423 1389119 cache.go:194] Successfully downloaded all kic artifacts
I0803 23:39:14.476456 1389119 start.go:360] acquireMachinesLock for old-k8s-version-820414: {Name:mkcac03898fa5abd86892a51d5a90af3645fb5f5 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0803 23:39:14.476524 1389119 start.go:364] duration metric: took 38.761µs to acquireMachinesLock for "old-k8s-version-820414"
I0803 23:39:14.476548 1389119 start.go:96] Skipping create...Using existing machine configuration
I0803 23:39:14.476562 1389119 fix.go:54] fixHost starting:
I0803 23:39:14.476862 1389119 cli_runner.go:164] Run: docker container inspect old-k8s-version-820414 --format={{.State.Status}}
I0803 23:39:14.492893 1389119 fix.go:112] recreateIfNeeded on old-k8s-version-820414: state=Stopped err=<nil>
W0803 23:39:14.492925 1389119 fix.go:138] unexpected machine state, will restart: <nil>
I0803 23:39:14.496321 1389119 out.go:177] * Restarting existing docker container for "old-k8s-version-820414" ...
I0803 23:39:14.497913 1389119 cli_runner.go:164] Run: docker start old-k8s-version-820414
I0803 23:39:14.797610 1389119 cli_runner.go:164] Run: docker container inspect old-k8s-version-820414 --format={{.State.Status}}
I0803 23:39:14.818397 1389119 kic.go:430] container "old-k8s-version-820414" state is running.
I0803 23:39:14.821084 1389119 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-820414
I0803 23:39:14.845743 1389119 profile.go:143] Saving config to /home/jenkins/minikube-integration/19364-1180294/.minikube/profiles/old-k8s-version-820414/config.json ...
I0803 23:39:14.845962 1389119 machine.go:94] provisionDockerMachine start ...
I0803 23:39:14.846018 1389119 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-820414
I0803 23:39:14.867314 1389119 main.go:141] libmachine: Using SSH client type: native
I0803 23:39:14.867595 1389119 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34543 <nil> <nil>}
I0803 23:39:14.867604 1389119 main.go:141] libmachine: About to run SSH command:
hostname
I0803 23:39:14.868268 1389119 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:33922->127.0.0.1:34543: read: connection reset by peer
I0803 23:39:18.012238 1389119 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-820414
I0803 23:39:18.012335 1389119 ubuntu.go:169] provisioning hostname "old-k8s-version-820414"
I0803 23:39:18.012462 1389119 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-820414
I0803 23:39:18.037572 1389119 main.go:141] libmachine: Using SSH client type: native
I0803 23:39:18.037836 1389119 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34543 <nil> <nil>}
I0803 23:39:18.037855 1389119 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-820414 && echo "old-k8s-version-820414" | sudo tee /etc/hostname
I0803 23:39:18.186874 1389119 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-820414
I0803 23:39:18.187000 1389119 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-820414
I0803 23:39:18.204803 1389119 main.go:141] libmachine: Using SSH client type: native
I0803 23:39:18.205064 1389119 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34543 <nil> <nil>}
I0803 23:39:18.205089 1389119 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-820414' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-820414/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-820414' | sudo tee -a /etc/hosts;
fi
fi
I0803 23:39:18.337042 1389119 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0803 23:39:18.337081 1389119 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19364-1180294/.minikube CaCertPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19364-1180294/.minikube}
I0803 23:39:18.337111 1389119 ubuntu.go:177] setting up certificates
I0803 23:39:18.337120 1389119 provision.go:84] configureAuth start
I0803 23:39:18.337179 1389119 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-820414
I0803 23:39:18.355665 1389119 provision.go:143] copyHostCerts
I0803 23:39:18.355748 1389119 exec_runner.go:144] found /home/jenkins/minikube-integration/19364-1180294/.minikube/ca.pem, removing ...
I0803 23:39:18.355764 1389119 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19364-1180294/.minikube/ca.pem
I0803 23:39:18.355842 1389119 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19364-1180294/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19364-1180294/.minikube/ca.pem (1078 bytes)
I0803 23:39:18.355944 1389119 exec_runner.go:144] found /home/jenkins/minikube-integration/19364-1180294/.minikube/cert.pem, removing ...
I0803 23:39:18.355953 1389119 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19364-1180294/.minikube/cert.pem
I0803 23:39:18.355980 1389119 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19364-1180294/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19364-1180294/.minikube/cert.pem (1123 bytes)
I0803 23:39:18.356039 1389119 exec_runner.go:144] found /home/jenkins/minikube-integration/19364-1180294/.minikube/key.pem, removing ...
I0803 23:39:18.356049 1389119 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19364-1180294/.minikube/key.pem
I0803 23:39:18.356076 1389119 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19364-1180294/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19364-1180294/.minikube/key.pem (1675 bytes)
I0803 23:39:18.356129 1389119 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19364-1180294/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19364-1180294/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19364-1180294/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-820414 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-820414]
I0803 23:39:18.743745 1389119 provision.go:177] copyRemoteCerts
I0803 23:39:18.743816 1389119 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0803 23:39:18.743862 1389119 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-820414
I0803 23:39:18.764483 1389119 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34543 SSHKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/machines/old-k8s-version-820414/id_rsa Username:docker}
I0803 23:39:18.866454 1389119 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0803 23:39:18.893471 1389119 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0803 23:39:18.917934 1389119 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0803 23:39:18.942528 1389119 provision.go:87] duration metric: took 605.394262ms to configureAuth
I0803 23:39:18.942558 1389119 ubuntu.go:193] setting minikube options for container-runtime
I0803 23:39:18.942763 1389119 config.go:182] Loaded profile config "old-k8s-version-820414": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0803 23:39:18.942777 1389119 machine.go:97] duration metric: took 4.096804379s to provisionDockerMachine
I0803 23:39:18.942790 1389119 start.go:293] postStartSetup for "old-k8s-version-820414" (driver="docker")
I0803 23:39:18.942807 1389119 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0803 23:39:18.942856 1389119 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0803 23:39:18.942901 1389119 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-820414
I0803 23:39:18.959330 1389119 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34543 SSHKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/machines/old-k8s-version-820414/id_rsa Username:docker}
I0803 23:39:19.054051 1389119 ssh_runner.go:195] Run: cat /etc/os-release
I0803 23:39:19.057222 1389119 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0803 23:39:19.057255 1389119 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0803 23:39:19.057265 1389119 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0803 23:39:19.057272 1389119 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0803 23:39:19.057282 1389119 filesync.go:126] Scanning /home/jenkins/minikube-integration/19364-1180294/.minikube/addons for local assets ...
I0803 23:39:19.057334 1389119 filesync.go:126] Scanning /home/jenkins/minikube-integration/19364-1180294/.minikube/files for local assets ...
I0803 23:39:19.057424 1389119 filesync.go:149] local asset: /home/jenkins/minikube-integration/19364-1180294/.minikube/files/etc/ssl/certs/11857022.pem -> 11857022.pem in /etc/ssl/certs
I0803 23:39:19.057527 1389119 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0803 23:39:19.065930 1389119 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/files/etc/ssl/certs/11857022.pem --> /etc/ssl/certs/11857022.pem (1708 bytes)
I0803 23:39:19.090870 1389119 start.go:296] duration metric: took 148.057046ms for postStartSetup
I0803 23:39:19.090976 1389119 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0803 23:39:19.091030 1389119 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-820414
I0803 23:39:19.108276 1389119 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34543 SSHKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/machines/old-k8s-version-820414/id_rsa Username:docker}
I0803 23:39:19.202327 1389119 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0803 23:39:19.206916 1389119 fix.go:56] duration metric: took 4.730347593s for fixHost
I0803 23:39:19.206942 1389119 start.go:83] releasing machines lock for "old-k8s-version-820414", held for 4.73040607s
I0803 23:39:19.207010 1389119 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-820414
I0803 23:39:19.223322 1389119 ssh_runner.go:195] Run: cat /version.json
I0803 23:39:19.223376 1389119 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-820414
I0803 23:39:19.223404 1389119 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0803 23:39:19.223465 1389119 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-820414
I0803 23:39:19.241521 1389119 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34543 SSHKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/machines/old-k8s-version-820414/id_rsa Username:docker}
I0803 23:39:19.247370 1389119 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34543 SSHKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/machines/old-k8s-version-820414/id_rsa Username:docker}
I0803 23:39:19.481412 1389119 ssh_runner.go:195] Run: systemctl --version
I0803 23:39:19.485853 1389119 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0803 23:39:19.490137 1389119 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0803 23:39:19.509010 1389119 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0803 23:39:19.509131 1389119 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0803 23:39:19.518575 1389119 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0803 23:39:19.518644 1389119 start.go:495] detecting cgroup driver to use...
I0803 23:39:19.518695 1389119 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0803 23:39:19.518784 1389119 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0803 23:39:19.533162 1389119 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0803 23:39:19.545197 1389119 docker.go:217] disabling cri-docker service (if available) ...
I0803 23:39:19.545260 1389119 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0803 23:39:19.558038 1389119 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0803 23:39:19.569426 1389119 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0803 23:39:19.653764 1389119 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0803 23:39:19.746906 1389119 docker.go:233] disabling docker service ...
I0803 23:39:19.746985 1389119 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0803 23:39:19.759714 1389119 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0803 23:39:19.771417 1389119 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0803 23:39:19.865985 1389119 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0803 23:39:19.957979 1389119 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0803 23:39:19.969830 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0803 23:39:19.988065 1389119 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0803 23:39:19.997979 1389119 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0803 23:39:20.015273 1389119 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0803 23:39:20.015414 1389119 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0803 23:39:20.030335 1389119 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0803 23:39:20.042065 1389119 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0803 23:39:20.053440 1389119 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0803 23:39:20.063856 1389119 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0803 23:39:20.074630 1389119 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0803 23:39:20.085871 1389119 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0803 23:39:20.097319 1389119 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0803 23:39:20.107474 1389119 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0803 23:39:20.208166 1389119 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0803 23:39:20.391272 1389119 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0803 23:39:20.391426 1389119 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0803 23:39:20.395297 1389119 start.go:563] Will wait 60s for crictl version
I0803 23:39:20.395430 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:39:20.399280 1389119 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0803 23:39:20.439747 1389119 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.19
RuntimeApiVersion: v1
I0803 23:39:20.439866 1389119 ssh_runner.go:195] Run: containerd --version
I0803 23:39:20.474292 1389119 ssh_runner.go:195] Run: containerd --version
I0803 23:39:20.502706 1389119 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.7.19 ...
I0803 23:39:20.504614 1389119 cli_runner.go:164] Run: docker network inspect old-k8s-version-820414 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0803 23:39:20.520277 1389119 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0803 23:39:20.524265 1389119 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0803 23:39:20.535119 1389119 kubeadm.go:883] updating cluster {Name:old-k8s-version-820414 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-820414 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0803 23:39:20.535252 1389119 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0803 23:39:20.535314 1389119 ssh_runner.go:195] Run: sudo crictl images --output json
I0803 23:39:20.572850 1389119 containerd.go:627] all images are preloaded for containerd runtime.
I0803 23:39:20.572876 1389119 containerd.go:534] Images already preloaded, skipping extraction
I0803 23:39:20.572935 1389119 ssh_runner.go:195] Run: sudo crictl images --output json
I0803 23:39:20.611313 1389119 containerd.go:627] all images are preloaded for containerd runtime.
I0803 23:39:20.611338 1389119 cache_images.go:84] Images are preloaded, skipping loading
I0803 23:39:20.611346 1389119 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.20.0 containerd true true} ...
I0803 23:39:20.611468 1389119 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-820414 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-820414 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0803 23:39:20.611536 1389119 ssh_runner.go:195] Run: sudo crictl info
I0803 23:39:20.652302 1389119 cni.go:84] Creating CNI manager for ""
I0803 23:39:20.652324 1389119 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0803 23:39:20.652333 1389119 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0803 23:39:20.652374 1389119 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-820414 NodeName:old-k8s-version-820414 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0803 23:39:20.652580 1389119 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-820414"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0803 23:39:20.652662 1389119 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0803 23:39:20.661874 1389119 binaries.go:44] Found k8s binaries, skipping transfer
I0803 23:39:20.661952 1389119 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0803 23:39:20.670672 1389119 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0803 23:39:20.689127 1389119 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0803 23:39:20.708487 1389119 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0803 23:39:20.726944 1389119 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0803 23:39:20.730383 1389119 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0803 23:39:20.741587 1389119 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0803 23:39:20.834974 1389119 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0803 23:39:20.853387 1389119 certs.go:68] Setting up /home/jenkins/minikube-integration/19364-1180294/.minikube/profiles/old-k8s-version-820414 for IP: 192.168.76.2
I0803 23:39:20.853413 1389119 certs.go:194] generating shared ca certs ...
I0803 23:39:20.853430 1389119 certs.go:226] acquiring lock for ca certs: {Name:mk245d61d460943c9f9c4518cc1e3561b25bafd3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0803 23:39:20.853567 1389119 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19364-1180294/.minikube/ca.key
I0803 23:39:20.853625 1389119 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19364-1180294/.minikube/proxy-client-ca.key
I0803 23:39:20.853648 1389119 certs.go:256] generating profile certs ...
I0803 23:39:20.853739 1389119 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19364-1180294/.minikube/profiles/old-k8s-version-820414/client.key
I0803 23:39:20.853817 1389119 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19364-1180294/.minikube/profiles/old-k8s-version-820414/apiserver.key.f3883ae6
I0803 23:39:20.853860 1389119 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19364-1180294/.minikube/profiles/old-k8s-version-820414/proxy-client.key
I0803 23:39:20.853977 1389119 certs.go:484] found cert: /home/jenkins/minikube-integration/19364-1180294/.minikube/certs/1185702.pem (1338 bytes)
W0803 23:39:20.854016 1389119 certs.go:480] ignoring /home/jenkins/minikube-integration/19364-1180294/.minikube/certs/1185702_empty.pem, impossibly tiny 0 bytes
I0803 23:39:20.854031 1389119 certs.go:484] found cert: /home/jenkins/minikube-integration/19364-1180294/.minikube/certs/ca-key.pem (1679 bytes)
I0803 23:39:20.854055 1389119 certs.go:484] found cert: /home/jenkins/minikube-integration/19364-1180294/.minikube/certs/ca.pem (1078 bytes)
I0803 23:39:20.854081 1389119 certs.go:484] found cert: /home/jenkins/minikube-integration/19364-1180294/.minikube/certs/cert.pem (1123 bytes)
I0803 23:39:20.854111 1389119 certs.go:484] found cert: /home/jenkins/minikube-integration/19364-1180294/.minikube/certs/key.pem (1675 bytes)
I0803 23:39:20.854160 1389119 certs.go:484] found cert: /home/jenkins/minikube-integration/19364-1180294/.minikube/files/etc/ssl/certs/11857022.pem (1708 bytes)
I0803 23:39:20.854874 1389119 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0803 23:39:20.883958 1389119 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0803 23:39:20.911574 1389119 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0803 23:39:20.937587 1389119 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0803 23:39:20.964570 1389119 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/profiles/old-k8s-version-820414/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0803 23:39:21.003546 1389119 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/profiles/old-k8s-version-820414/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0803 23:39:21.035089 1389119 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/profiles/old-k8s-version-820414/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0803 23:39:21.065489 1389119 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/profiles/old-k8s-version-820414/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0803 23:39:21.093262 1389119 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/files/etc/ssl/certs/11857022.pem --> /usr/share/ca-certificates/11857022.pem (1708 bytes)
I0803 23:39:21.120534 1389119 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0803 23:39:21.148396 1389119 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/certs/1185702.pem --> /usr/share/ca-certificates/1185702.pem (1338 bytes)
I0803 23:39:21.174201 1389119 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0803 23:39:21.193998 1389119 ssh_runner.go:195] Run: openssl version
I0803 23:39:21.201041 1389119 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11857022.pem && ln -fs /usr/share/ca-certificates/11857022.pem /etc/ssl/certs/11857022.pem"
I0803 23:39:21.211471 1389119 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11857022.pem
I0803 23:39:21.215155 1389119 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 3 22:59 /usr/share/ca-certificates/11857022.pem
I0803 23:39:21.215223 1389119 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11857022.pem
I0803 23:39:21.222036 1389119 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/11857022.pem /etc/ssl/certs/3ec20f2e.0"
I0803 23:39:21.230857 1389119 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0803 23:39:21.240251 1389119 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0803 23:39:21.243901 1389119 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 3 22:49 /usr/share/ca-certificates/minikubeCA.pem
I0803 23:39:21.244016 1389119 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0803 23:39:21.251025 1389119 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0803 23:39:21.260023 1389119 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1185702.pem && ln -fs /usr/share/ca-certificates/1185702.pem /etc/ssl/certs/1185702.pem"
I0803 23:39:21.269879 1389119 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1185702.pem
I0803 23:39:21.273517 1389119 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 3 22:59 /usr/share/ca-certificates/1185702.pem
I0803 23:39:21.273621 1389119 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1185702.pem
I0803 23:39:21.281111 1389119 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1185702.pem /etc/ssl/certs/51391683.0"
I0803 23:39:21.290623 1389119 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0803 23:39:21.294674 1389119 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0803 23:39:21.301950 1389119 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0803 23:39:21.308952 1389119 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0803 23:39:21.315684 1389119 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0803 23:39:21.322720 1389119 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0803 23:39:21.329677 1389119 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0803 23:39:21.336543 1389119 kubeadm.go:392] StartCluster: {Name:old-k8s-version-820414 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-820414 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0803 23:39:21.336656 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0803 23:39:21.336805 1389119 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0803 23:39:21.373893 1389119 cri.go:89] found id: "0b050dde3721b6d4dd3b0797f920eef0da5c15babdef3596394c04b62e4cce35"
I0803 23:39:21.373917 1389119 cri.go:89] found id: "1fb74e635c11f9e357abcbe302bff95b9c25381dfe33de15354e0eedbc5564f4"
I0803 23:39:21.373922 1389119 cri.go:89] found id: "0d22eec037f1c7aab116e4aa78c05368658c4097a76b252c826555e1a25f0d34"
I0803 23:39:21.373926 1389119 cri.go:89] found id: "9d8357e9b98e5a01f551902057365a6f43c698ef3ffda88640f432be5ca342dc"
I0803 23:39:21.373929 1389119 cri.go:89] found id: "4f46c8a0a157fd605ed8713e34a2776ca3d9ebdc5840738a522ffaaae27933e7"
I0803 23:39:21.373933 1389119 cri.go:89] found id: "e15be75c9111b317b4e56baaf7f93bc458c9080032ce09cbdd0e3fa77a17cb5e"
I0803 23:39:21.373936 1389119 cri.go:89] found id: "fb5f0343694ff099d26f408ccb02c199901b58111f3e21cf3de3c23a210d7b6d"
I0803 23:39:21.373939 1389119 cri.go:89] found id: "17af5d5b36407e3b6155abcf2050b778e7fba88e3816192cc23567d11a94cc3e"
I0803 23:39:21.373942 1389119 cri.go:89] found id: "1cf5b72b69cb46a2f0ebd44d87f295610e0a42f9bfb29e2fb3e863c1645de1b9"
I0803 23:39:21.373951 1389119 cri.go:89] found id: ""
I0803 23:39:21.374004 1389119 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0803 23:39:21.394398 1389119 cri.go:116] JSON = null
W0803 23:39:21.394471 1389119 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 9
I0803 23:39:21.394559 1389119 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0803 23:39:21.403483 1389119 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0803 23:39:21.403502 1389119 kubeadm.go:593] restartPrimaryControlPlane start ...
I0803 23:39:21.403579 1389119 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0803 23:39:21.412490 1389119 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0803 23:39:21.413177 1389119 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-820414" does not appear in /home/jenkins/minikube-integration/19364-1180294/kubeconfig
I0803 23:39:21.413475 1389119 kubeconfig.go:62] /home/jenkins/minikube-integration/19364-1180294/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-820414" cluster setting kubeconfig missing "old-k8s-version-820414" context setting]
I0803 23:39:21.413921 1389119 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19364-1180294/kubeconfig: {Name:mk7ac442c13ee76103bb330a149278eea8a7c99f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0803 23:39:21.415337 1389119 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0803 23:39:21.425377 1389119 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.76.2
I0803 23:39:21.425465 1389119 kubeadm.go:597] duration metric: took 21.955708ms to restartPrimaryControlPlane
I0803 23:39:21.425481 1389119 kubeadm.go:394] duration metric: took 88.959354ms to StartCluster
I0803 23:39:21.425497 1389119 settings.go:142] acquiring lock: {Name:mk6781ca2b0427afb2b67408884ede06d33d8dbf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0803 23:39:21.425592 1389119 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19364-1180294/kubeconfig
I0803 23:39:21.426544 1389119 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19364-1180294/kubeconfig: {Name:mk7ac442c13ee76103bb330a149278eea8a7c99f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0803 23:39:21.426781 1389119 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0803 23:39:21.427110 1389119 config.go:182] Loaded profile config "old-k8s-version-820414": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0803 23:39:21.427192 1389119 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0803 23:39:21.427291 1389119 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-820414"
I0803 23:39:21.427313 1389119 addons.go:69] Setting dashboard=true in profile "old-k8s-version-820414"
I0803 23:39:21.427357 1389119 addons.go:234] Setting addon dashboard=true in "old-k8s-version-820414"
W0803 23:39:21.427369 1389119 addons.go:243] addon dashboard should already be in state true
I0803 23:39:21.427386 1389119 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-820414"
W0803 23:39:21.427408 1389119 addons.go:243] addon storage-provisioner should already be in state true
I0803 23:39:21.427484 1389119 host.go:66] Checking if "old-k8s-version-820414" exists ...
I0803 23:39:21.427395 1389119 host.go:66] Checking if "old-k8s-version-820414" exists ...
I0803 23:39:21.427927 1389119 cli_runner.go:164] Run: docker container inspect old-k8s-version-820414 --format={{.State.Status}}
I0803 23:39:21.427982 1389119 cli_runner.go:164] Run: docker container inspect old-k8s-version-820414 --format={{.State.Status}}
I0803 23:39:21.427305 1389119 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-820414"
I0803 23:39:21.428610 1389119 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-820414"
I0803 23:39:21.428892 1389119 cli_runner.go:164] Run: docker container inspect old-k8s-version-820414 --format={{.State.Status}}
I0803 23:39:21.427400 1389119 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-820414"
I0803 23:39:21.431139 1389119 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-820414"
W0803 23:39:21.431153 1389119 addons.go:243] addon metrics-server should already be in state true
I0803 23:39:21.431201 1389119 host.go:66] Checking if "old-k8s-version-820414" exists ...
I0803 23:39:21.431619 1389119 cli_runner.go:164] Run: docker container inspect old-k8s-version-820414 --format={{.State.Status}}
I0803 23:39:21.433415 1389119 out.go:177] * Verifying Kubernetes components...
I0803 23:39:21.435550 1389119 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0803 23:39:21.471158 1389119 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0803 23:39:21.473006 1389119 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0803 23:39:21.474906 1389119 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0803 23:39:21.474930 1389119 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0803 23:39:21.475011 1389119 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-820414
I0803 23:39:21.485592 1389119 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0803 23:39:21.488319 1389119 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-820414"
W0803 23:39:21.488339 1389119 addons.go:243] addon default-storageclass should already be in state true
I0803 23:39:21.488368 1389119 host.go:66] Checking if "old-k8s-version-820414" exists ...
I0803 23:39:21.488850 1389119 cli_runner.go:164] Run: docker container inspect old-k8s-version-820414 --format={{.State.Status}}
I0803 23:39:21.496020 1389119 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0803 23:39:21.496045 1389119 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0803 23:39:21.496114 1389119 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-820414
I0803 23:39:21.508038 1389119 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0803 23:39:21.510747 1389119 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0803 23:39:21.510773 1389119 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0803 23:39:21.510854 1389119 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-820414
I0803 23:39:21.542708 1389119 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34543 SSHKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/machines/old-k8s-version-820414/id_rsa Username:docker}
I0803 23:39:21.548948 1389119 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34543 SSHKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/machines/old-k8s-version-820414/id_rsa Username:docker}
I0803 23:39:21.571614 1389119 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0803 23:39:21.571636 1389119 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0803 23:39:21.571697 1389119 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-820414
I0803 23:39:21.580175 1389119 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34543 SSHKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/machines/old-k8s-version-820414/id_rsa Username:docker}
I0803 23:39:21.605102 1389119 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0803 23:39:21.626523 1389119 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34543 SSHKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/machines/old-k8s-version-820414/id_rsa Username:docker}
I0803 23:39:21.635796 1389119 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-820414" to be "Ready" ...
I0803 23:39:21.693996 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0803 23:39:21.698163 1389119 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0803 23:39:21.698232 1389119 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0803 23:39:21.737923 1389119 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0803 23:39:21.738006 1389119 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0803 23:39:21.744387 1389119 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0803 23:39:21.744452 1389119 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0803 23:39:21.768065 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0803 23:39:21.793998 1389119 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0803 23:39:21.794077 1389119 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0803 23:39:21.801989 1389119 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0803 23:39:21.802061 1389119 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
W0803 23:39:21.850040 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:21.850140 1389119 retry.go:31] will retry after 128.007349ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:21.859778 1389119 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0803 23:39:21.859843 1389119 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0803 23:39:21.863654 1389119 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0803 23:39:21.863725 1389119 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0803 23:39:21.896921 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0803 23:39:21.904113 1389119 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0803 23:39:21.904185 1389119 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
W0803 23:39:21.921449 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:21.921543 1389119 retry.go:31] will retry after 245.560396ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:21.927461 1389119 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0803 23:39:21.927537 1389119 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0803 23:39:21.948230 1389119 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0803 23:39:21.948306 1389119 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0803 23:39:21.968344 1389119 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0803 23:39:21.968417 1389119 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0803 23:39:21.978910 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0803 23:39:21.994171 1389119 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0803 23:39:21.994245 1389119 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0803 23:39:22.017685 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0803 23:39:22.032600 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:22.032703 1389119 retry.go:31] will retry after 197.571782ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0803 23:39:22.118873 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:22.118964 1389119 retry.go:31] will retry after 255.425122ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0803 23:39:22.123231 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:22.123261 1389119 retry.go:31] will retry after 176.596072ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:22.168232 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0803 23:39:22.230671 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0803 23:39:22.249149 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:22.249231 1389119 retry.go:31] will retry after 508.639867ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:22.300345 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0803 23:39:22.305870 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:22.305949 1389119 retry.go:31] will retry after 465.648026ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0803 23:39:22.373240 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:22.373274 1389119 retry.go:31] will retry after 415.489661ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:22.375408 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0803 23:39:22.446809 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:22.446852 1389119 retry.go:31] will retry after 636.411292ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:22.758724 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0803 23:39:22.772057 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0803 23:39:22.789559 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0803 23:39:22.896183 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:22.896285 1389119 retry.go:31] will retry after 508.783559ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0803 23:39:22.902878 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:22.902948 1389119 retry.go:31] will retry after 708.844803ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0803 23:39:22.937218 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:22.937253 1389119 retry.go:31] will retry after 792.461535ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:23.084397 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0803 23:39:23.163511 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:23.163581 1389119 retry.go:31] will retry after 570.502839ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:23.405875 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0803 23:39:23.477480 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:23.477512 1389119 retry.go:31] will retry after 844.473972ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:23.612787 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0803 23:39:23.636324 1389119 node_ready.go:53] error getting node "old-k8s-version-820414": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-820414": dial tcp 192.168.76.2:8443: connect: connection refused
W0803 23:39:23.683219 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:23.683250 1389119 retry.go:31] will retry after 1.078889224s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:23.730435 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0803 23:39:23.734689 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0803 23:39:23.820951 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:23.820985 1389119 retry.go:31] will retry after 775.450909ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0803 23:39:23.842324 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:23.842409 1389119 retry.go:31] will retry after 1.683951311s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:24.322844 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0803 23:39:24.399836 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:24.399870 1389119 retry.go:31] will retry after 687.701479ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:24.597320 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0803 23:39:24.671381 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:24.671411 1389119 retry.go:31] will retry after 1.287278186s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:24.762643 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0803 23:39:24.835658 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:24.835701 1389119 retry.go:31] will retry after 1.088263781s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:25.088399 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0803 23:39:25.166040 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:25.166072 1389119 retry.go:31] will retry after 1.596171138s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:25.526493 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0803 23:39:25.600067 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:25.600101 1389119 retry.go:31] will retry after 1.06164572s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:25.636588 1389119 node_ready.go:53] error getting node "old-k8s-version-820414": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-820414": dial tcp 192.168.76.2:8443: connect: connection refused
I0803 23:39:25.925080 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0803 23:39:25.959390 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0803 23:39:26.066157 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:26.066192 1389119 retry.go:31] will retry after 2.156384873s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0803 23:39:26.071798 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:26.071834 1389119 retry.go:31] will retry after 1.880769569s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:26.662216 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0803 23:39:26.738148 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:26.738180 1389119 retry.go:31] will retry after 1.515576265s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:26.763454 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0803 23:39:26.841402 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:26.841434 1389119 retry.go:31] will retry after 3.263692273s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:27.636989 1389119 node_ready.go:53] error getting node "old-k8s-version-820414": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-820414": dial tcp 192.168.76.2:8443: connect: connection refused
I0803 23:39:27.953533 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0803 23:39:28.030038 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:28.030069 1389119 retry.go:31] will retry after 2.201382318s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:28.222950 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0803 23:39:28.254293 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0803 23:39:28.316548 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:28.316574 1389119 retry.go:31] will retry after 2.51808289s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0803 23:39:28.354924 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:28.354955 1389119 retry.go:31] will retry after 4.650331283s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:30.106047 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0803 23:39:30.137302 1389119 node_ready.go:53] error getting node "old-k8s-version-820414": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-820414": dial tcp 192.168.76.2:8443: connect: connection refused
I0803 23:39:30.231647 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0803 23:39:30.343695 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:30.343736 1389119 retry.go:31] will retry after 5.478776976s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0803 23:39:30.572672 1389119 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:30.572703 1389119 retry.go:31] will retry after 6.028650682s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0803 23:39:30.835398 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0803 23:39:33.005953 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0803 23:39:35.822756 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0803 23:39:36.601551 1389119 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0803 23:39:40.555589 1389119 node_ready.go:49] node "old-k8s-version-820414" has status "Ready":"True"
I0803 23:39:40.555614 1389119 node_ready.go:38] duration metric: took 18.919779992s for node "old-k8s-version-820414" to be "Ready" ...
I0803 23:39:40.555624 1389119 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0803 23:39:40.741621 1389119 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-xng8r" in "kube-system" namespace to be "Ready" ...
I0803 23:39:41.025638 1389119 pod_ready.go:92] pod "coredns-74ff55c5b-xng8r" in "kube-system" namespace has status "Ready":"True"
I0803 23:39:41.025663 1389119 pod_ready.go:81] duration metric: took 283.956982ms for pod "coredns-74ff55c5b-xng8r" in "kube-system" namespace to be "Ready" ...
I0803 23:39:41.025678 1389119 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-820414" in "kube-system" namespace to be "Ready" ...
I0803 23:39:41.106757 1389119 pod_ready.go:92] pod "etcd-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"True"
I0803 23:39:41.106832 1389119 pod_ready.go:81] duration metric: took 81.145094ms for pod "etcd-old-k8s-version-820414" in "kube-system" namespace to be "Ready" ...
I0803 23:39:41.106868 1389119 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-820414" in "kube-system" namespace to be "Ready" ...
I0803 23:39:41.174787 1389119 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"True"
I0803 23:39:41.174809 1389119 pod_ready.go:81] duration metric: took 67.904355ms for pod "kube-apiserver-old-k8s-version-820414" in "kube-system" namespace to be "Ready" ...
I0803 23:39:41.174821 1389119 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace to be "Ready" ...
I0803 23:39:42.755243 1389119 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (11.919797637s)
I0803 23:39:42.755287 1389119 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-820414"
I0803 23:39:42.755338 1389119 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (9.749358578s)
I0803 23:39:42.755378 1389119 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (6.932600652s)
I0803 23:39:43.182452 1389119 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (6.580841286s)
I0803 23:39:43.185067 1389119 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-820414 addons enable metrics-server
I0803 23:39:43.187600 1389119 out.go:177] * Enabled addons: metrics-server, storage-provisioner, default-storageclass, dashboard
I0803 23:39:43.189814 1389119 addons.go:510] duration metric: took 21.762617209s for enable addons: enabled=[metrics-server storage-provisioner default-storageclass dashboard]
I0803 23:39:43.202941 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:39:45.266307 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:39:47.680859 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:39:50.182555 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:39:52.684009 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:39:55.181569 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:39:57.680545 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:39:59.687863 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:02.182155 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:04.193109 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:06.689725 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:09.182065 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:11.683059 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:14.184274 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:16.185511 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:18.681816 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:20.685637 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:23.181594 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:25.181967 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:27.683321 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:30.183332 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:32.680888 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:35.181934 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:37.183150 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:39.681416 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:42.183279 1389119 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:42.681307 1389119 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"True"
I0803 23:40:42.681337 1389119 pod_ready.go:81] duration metric: took 1m1.506507724s for pod "kube-controller-manager-old-k8s-version-820414" in "kube-system" namespace to be "Ready" ...
I0803 23:40:42.681349 1389119 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-rgk96" in "kube-system" namespace to be "Ready" ...
I0803 23:40:42.686130 1389119 pod_ready.go:92] pod "kube-proxy-rgk96" in "kube-system" namespace has status "Ready":"True"
I0803 23:40:42.686218 1389119 pod_ready.go:81] duration metric: took 4.860597ms for pod "kube-proxy-rgk96" in "kube-system" namespace to be "Ready" ...
I0803 23:40:42.686239 1389119 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-820414" in "kube-system" namespace to be "Ready" ...
I0803 23:40:44.692453 1389119 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:46.693314 1389119 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:49.192832 1389119 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:51.691969 1389119 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:53.693414 1389119 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:56.192363 1389119 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:40:58.193775 1389119 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:00.207335 1389119 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:02.691889 1389119 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:05.192573 1389119 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:06.692503 1389119 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-820414" in "kube-system" namespace has status "Ready":"True"
I0803 23:41:06.692533 1389119 pod_ready.go:81] duration metric: took 24.006284143s for pod "kube-scheduler-old-k8s-version-820414" in "kube-system" namespace to be "Ready" ...
I0803 23:41:06.692545 1389119 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace to be "Ready" ...
I0803 23:41:08.699230 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:10.699417 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:13.199392 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:15.200180 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:17.698768 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:20.199955 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:22.699326 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:25.198606 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:27.199057 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:29.199602 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:31.698396 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:33.700341 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:36.199366 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:38.201693 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:40.703129 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:43.199000 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:45.200504 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:47.699001 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:49.699340 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:51.699432 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:53.700360 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:55.700581 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:58.198268 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:00.224981 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:02.698424 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:04.699134 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:07.198826 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:09.698037 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:11.699478 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:14.199026 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:16.699028 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:18.699474 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:21.199796 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:23.701490 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:26.198342 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:28.199086 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:30.200328 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:32.699536 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:35.199476 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:37.698937 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:40.198984 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:42.204378 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:44.698855 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:46.699179 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:48.702669 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:51.199902 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:53.200521 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:55.698645 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:57.703669 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:00.218059 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:02.698937 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:05.198988 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:07.698134 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:09.700180 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:12.223904 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:14.698373 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:16.698784 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:18.699000 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:21.198740 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:23.199428 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:25.199512 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:27.698426 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:30.200553 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:32.699164 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:35.198680 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:37.199039 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:39.199410 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:41.698052 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:43.698689 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:46.203672 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:48.699366 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:51.198826 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:53.698907 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:56.199013 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:58.698537 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:00.699403 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:02.705402 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:05.198904 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:07.700261 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:10.198829 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:12.199083 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:14.199252 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:16.698753 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:19.199876 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:21.698499 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:23.698553 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:26.200542 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:28.698447 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:30.698685 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:32.698718 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:34.699092 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:37.198328 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:39.199068 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:41.698264 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:43.699121 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:46.199245 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:48.699142 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:51.198567 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:53.698856 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:56.199533 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:58.697721 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:45:00.699068 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:45:02.700391 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:45:05.198810 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:45:06.699353 1389119 pod_ready.go:81] duration metric: took 4m0.006793463s for pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace to be "Ready" ...
E0803 23:45:06.699379 1389119 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0803 23:45:06.699393 1389119 pod_ready.go:38] duration metric: took 5m26.143754509s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0803 23:45:06.699407 1389119 api_server.go:52] waiting for apiserver process to appear ...
I0803 23:45:06.699437 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0803 23:45:06.699508 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0803 23:45:06.762175 1389119 cri.go:89] found id: "2dfe55d1797db163cd9199214e216cbd925e66788ac3213f4189fd6d49eb137d"
I0803 23:45:06.762196 1389119 cri.go:89] found id: "fb5f0343694ff099d26f408ccb02c199901b58111f3e21cf3de3c23a210d7b6d"
I0803 23:45:06.762200 1389119 cri.go:89] found id: ""
I0803 23:45:06.762210 1389119 logs.go:276] 2 containers: [2dfe55d1797db163cd9199214e216cbd925e66788ac3213f4189fd6d49eb137d fb5f0343694ff099d26f408ccb02c199901b58111f3e21cf3de3c23a210d7b6d]
I0803 23:45:06.762267 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:06.765974 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:06.769653 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0803 23:45:06.769726 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0803 23:45:06.807389 1389119 cri.go:89] found id: "5cbe8058c6723a2d2086539e5d8807f73a64893442fe8bb140d579ee4aececc6"
I0803 23:45:06.807413 1389119 cri.go:89] found id: "17af5d5b36407e3b6155abcf2050b778e7fba88e3816192cc23567d11a94cc3e"
I0803 23:45:06.807418 1389119 cri.go:89] found id: ""
I0803 23:45:06.807426 1389119 logs.go:276] 2 containers: [5cbe8058c6723a2d2086539e5d8807f73a64893442fe8bb140d579ee4aececc6 17af5d5b36407e3b6155abcf2050b778e7fba88e3816192cc23567d11a94cc3e]
I0803 23:45:06.807482 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:06.811022 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:06.814520 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0803 23:45:06.814593 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0803 23:45:06.856056 1389119 cri.go:89] found id: "b8f07cb083173520f0df79356cae5f287397885843c428a87247794fa9b0ad02"
I0803 23:45:06.856130 1389119 cri.go:89] found id: "1fb74e635c11f9e357abcbe302bff95b9c25381dfe33de15354e0eedbc5564f4"
I0803 23:45:06.856150 1389119 cri.go:89] found id: ""
I0803 23:45:06.856174 1389119 logs.go:276] 2 containers: [b8f07cb083173520f0df79356cae5f287397885843c428a87247794fa9b0ad02 1fb74e635c11f9e357abcbe302bff95b9c25381dfe33de15354e0eedbc5564f4]
I0803 23:45:06.856257 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:06.860079 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:06.863499 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0803 23:45:06.863594 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0803 23:45:06.905512 1389119 cri.go:89] found id: "9bf21e77a35b82c0eff0d1588e963d3c44c43c2c26455b9d13e89d93c07f4a7a"
I0803 23:45:06.905534 1389119 cri.go:89] found id: "1cf5b72b69cb46a2f0ebd44d87f295610e0a42f9bfb29e2fb3e863c1645de1b9"
I0803 23:45:06.905539 1389119 cri.go:89] found id: ""
I0803 23:45:06.905545 1389119 logs.go:276] 2 containers: [9bf21e77a35b82c0eff0d1588e963d3c44c43c2c26455b9d13e89d93c07f4a7a 1cf5b72b69cb46a2f0ebd44d87f295610e0a42f9bfb29e2fb3e863c1645de1b9]
I0803 23:45:06.905622 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:06.909250 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:06.912616 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0803 23:45:06.912745 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0803 23:45:06.949355 1389119 cri.go:89] found id: "aceae907dc5dd357ef34d25fba3386bee6214298dda34f31bb744dd99aaf02c5"
I0803 23:45:06.949379 1389119 cri.go:89] found id: "9d8357e9b98e5a01f551902057365a6f43c698ef3ffda88640f432be5ca342dc"
I0803 23:45:06.949385 1389119 cri.go:89] found id: ""
I0803 23:45:06.949392 1389119 logs.go:276] 2 containers: [aceae907dc5dd357ef34d25fba3386bee6214298dda34f31bb744dd99aaf02c5 9d8357e9b98e5a01f551902057365a6f43c698ef3ffda88640f432be5ca342dc]
I0803 23:45:06.949477 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:06.953258 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:06.957005 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0803 23:45:06.957132 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0803 23:45:06.994111 1389119 cri.go:89] found id: "decd46f1eb153a03a912739b52c5220cab3bc0a68a41ce2f501a19b1547d030a"
I0803 23:45:06.994136 1389119 cri.go:89] found id: "e15be75c9111b317b4e56baaf7f93bc458c9080032ce09cbdd0e3fa77a17cb5e"
I0803 23:45:06.994141 1389119 cri.go:89] found id: ""
I0803 23:45:06.994148 1389119 logs.go:276] 2 containers: [decd46f1eb153a03a912739b52c5220cab3bc0a68a41ce2f501a19b1547d030a e15be75c9111b317b4e56baaf7f93bc458c9080032ce09cbdd0e3fa77a17cb5e]
I0803 23:45:06.994205 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:06.998167 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:07.003669 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0803 23:45:07.003788 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0803 23:45:07.050511 1389119 cri.go:89] found id: "e8b4079036ee954a62ef0fc54baf2b399cac2f40b9f5d82804b0a0b63287f659"
I0803 23:45:07.050571 1389119 cri.go:89] found id: "0d22eec037f1c7aab116e4aa78c05368658c4097a76b252c826555e1a25f0d34"
I0803 23:45:07.050591 1389119 cri.go:89] found id: ""
I0803 23:45:07.050605 1389119 logs.go:276] 2 containers: [e8b4079036ee954a62ef0fc54baf2b399cac2f40b9f5d82804b0a0b63287f659 0d22eec037f1c7aab116e4aa78c05368658c4097a76b252c826555e1a25f0d34]
I0803 23:45:07.050661 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:07.054359 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:07.058014 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0803 23:45:07.058119 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0803 23:45:07.096089 1389119 cri.go:89] found id: "32cdc2b56b59662ee956a5208730f2f361969d0adbd1439929e7e6c099a03838"
I0803 23:45:07.096114 1389119 cri.go:89] found id: ""
I0803 23:45:07.096122 1389119 logs.go:276] 1 containers: [32cdc2b56b59662ee956a5208730f2f361969d0adbd1439929e7e6c099a03838]
I0803 23:45:07.096176 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:07.099595 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0803 23:45:07.099711 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0803 23:45:07.162961 1389119 cri.go:89] found id: "fe656919428c126fa2c0d30d5ab782825c967bc723dfa769843ecf5bba788898"
I0803 23:45:07.163028 1389119 cri.go:89] found id: "9d49e481b2b6243d5e9de51f4fcc1d6d8cb677348b5fd9254200807f07c7297e"
I0803 23:45:07.163047 1389119 cri.go:89] found id: ""
I0803 23:45:07.163070 1389119 logs.go:276] 2 containers: [fe656919428c126fa2c0d30d5ab782825c967bc723dfa769843ecf5bba788898 9d49e481b2b6243d5e9de51f4fcc1d6d8cb677348b5fd9254200807f07c7297e]
I0803 23:45:07.163166 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:07.166813 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:07.170591 1389119 logs.go:123] Gathering logs for kubelet ...
I0803 23:45:07.170624 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0803 23:45:07.229954 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.459162 663 reflector.go:138] object-"kube-system"/"coredns-token-9d2xv": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-9d2xv" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:07.230178 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.459309 663 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:07.230387 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.459518 663 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:07.230605 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.459607 663 reflector.go:138] object-"kube-system"/"kube-proxy-token-mfhhp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-mfhhp" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:07.230820 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.459825 663 reflector.go:138] object-"kube-system"/"kindnet-token-ghz8l": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-ghz8l" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:07.231056 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.470624 663 reflector.go:138] object-"kube-system"/"storage-provisioner-token-xnstr": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-xnstr" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:07.231267 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.470708 663 reflector.go:138] object-"default"/"default-token-2m78r": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-2m78r" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:07.231489 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.470783 663 reflector.go:138] object-"kube-system"/"metrics-server-token-nxdwh": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-nxdwh" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:07.239211 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:42 old-k8s-version-820414 kubelet[663]: E0803 23:39:42.798080 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0803 23:45:07.239402 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:42 old-k8s-version-820414 kubelet[663]: E0803 23:39:42.847187 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.242987 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:55 old-k8s-version-820414 kubelet[663]: E0803 23:39:55.456344 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0803 23:45:07.244679 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:09 old-k8s-version-820414 kubelet[663]: E0803 23:40:09.485277 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.245677 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:12 old-k8s-version-820414 kubelet[663]: E0803 23:40:12.189775 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.246011 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:13 old-k8s-version-820414 kubelet[663]: E0803 23:40:13.184996 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.246477 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:15 old-k8s-version-820414 kubelet[663]: E0803 23:40:15.194567 663 pod_workers.go:191] Error syncing pod 760afa3c-130b-47d5-a942-ae27ff7ac5f5 ("storage-provisioner_kube-system(760afa3c-130b-47d5-a942-ae27ff7ac5f5)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(760afa3c-130b-47d5-a942-ae27ff7ac5f5)"
W0803 23:45:07.246820 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:16 old-k8s-version-820414 kubelet[663]: E0803 23:40:16.619029 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.249665 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:23 old-k8s-version-820414 kubelet[663]: E0803 23:40:23.484273 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0803 23:45:07.250393 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:30 old-k8s-version-820414 kubelet[663]: E0803 23:40:30.262767 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.250579 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:36 old-k8s-version-820414 kubelet[663]: E0803 23:40:36.524198 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.250908 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:36 old-k8s-version-820414 kubelet[663]: E0803 23:40:36.615532 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.251237 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:48 old-k8s-version-820414 kubelet[663]: E0803 23:40:48.444598 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.251425 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:49 old-k8s-version-820414 kubelet[663]: E0803 23:40:49.445255 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.251622 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:03 old-k8s-version-820414 kubelet[663]: E0803 23:41:03.444496 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.252220 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:04 old-k8s-version-820414 kubelet[663]: E0803 23:41:04.368191 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.252575 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:06 old-k8s-version-820414 kubelet[663]: E0803 23:41:06.609272 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.255047 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:15 old-k8s-version-820414 kubelet[663]: E0803 23:41:15.481112 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0803 23:45:07.255380 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:20 old-k8s-version-820414 kubelet[663]: E0803 23:41:20.444068 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.255574 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:26 old-k8s-version-820414 kubelet[663]: E0803 23:41:26.444477 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.255904 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:35 old-k8s-version-820414 kubelet[663]: E0803 23:41:35.444186 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.256112 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:38 old-k8s-version-820414 kubelet[663]: E0803 23:41:38.444525 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.256714 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:47 old-k8s-version-820414 kubelet[663]: E0803 23:41:47.552369 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.256913 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:52 old-k8s-version-820414 kubelet[663]: E0803 23:41:52.444351 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.257247 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:56 old-k8s-version-820414 kubelet[663]: E0803 23:41:56.604520 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.257437 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:07 old-k8s-version-820414 kubelet[663]: E0803 23:42:07.444300 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.257772 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:11 old-k8s-version-820414 kubelet[663]: E0803 23:42:11.444597 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.258088 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:22 old-k8s-version-820414 kubelet[663]: E0803 23:42:22.444598 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.258287 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:22 old-k8s-version-820414 kubelet[663]: E0803 23:42:22.444840 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.258626 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:34 old-k8s-version-820414 kubelet[663]: E0803 23:42:34.444102 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.261093 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:37 old-k8s-version-820414 kubelet[663]: E0803 23:42:37.453580 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0803 23:45:07.261430 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:49 old-k8s-version-820414 kubelet[663]: E0803 23:42:49.444596 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.261616 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:51 old-k8s-version-820414 kubelet[663]: E0803 23:42:51.445065 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.261945 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:02 old-k8s-version-820414 kubelet[663]: E0803 23:43:02.444071 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.262132 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:05 old-k8s-version-820414 kubelet[663]: E0803 23:43:05.444843 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.262727 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:16 old-k8s-version-820414 kubelet[663]: E0803 23:43:16.774818 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.262915 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:18 old-k8s-version-820414 kubelet[663]: E0803 23:43:18.444453 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.263246 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:26 old-k8s-version-820414 kubelet[663]: E0803 23:43:26.604545 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.263433 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:29 old-k8s-version-820414 kubelet[663]: E0803 23:43:29.445577 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.263764 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:41 old-k8s-version-820414 kubelet[663]: E0803 23:43:41.444779 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.263951 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:44 old-k8s-version-820414 kubelet[663]: E0803 23:43:44.444419 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.264281 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:56 old-k8s-version-820414 kubelet[663]: E0803 23:43:56.444259 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.264467 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:58 old-k8s-version-820414 kubelet[663]: E0803 23:43:58.444353 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.264806 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:08 old-k8s-version-820414 kubelet[663]: E0803 23:44:08.444136 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.264996 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:12 old-k8s-version-820414 kubelet[663]: E0803 23:44:12.444406 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.265328 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:22 old-k8s-version-820414 kubelet[663]: E0803 23:44:22.444030 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.265513 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:23 old-k8s-version-820414 kubelet[663]: E0803 23:44:23.449169 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.265698 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:35 old-k8s-version-820414 kubelet[663]: E0803 23:44:35.445923 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.266028 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:37 old-k8s-version-820414 kubelet[663]: E0803 23:44:37.444223 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.266363 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:50 old-k8s-version-820414 kubelet[663]: E0803 23:44:50.444155 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.266550 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:50 old-k8s-version-820414 kubelet[663]: E0803 23:44:50.445023 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.266737 1389119 logs.go:138] Found kubelet problem: Aug 03 23:45:02 old-k8s-version-820414 kubelet[663]: E0803 23:45:02.444334 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.267072 1389119 logs.go:138] Found kubelet problem: Aug 03 23:45:04 old-k8s-version-820414 kubelet[663]: E0803 23:45:04.444530 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
I0803 23:45:07.267087 1389119 logs.go:123] Gathering logs for dmesg ...
I0803 23:45:07.267104 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0803 23:45:07.288852 1389119 logs.go:123] Gathering logs for kube-apiserver [fb5f0343694ff099d26f408ccb02c199901b58111f3e21cf3de3c23a210d7b6d] ...
I0803 23:45:07.288927 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fb5f0343694ff099d26f408ccb02c199901b58111f3e21cf3de3c23a210d7b6d"
I0803 23:45:07.347909 1389119 logs.go:123] Gathering logs for etcd [5cbe8058c6723a2d2086539e5d8807f73a64893442fe8bb140d579ee4aececc6] ...
I0803 23:45:07.347941 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5cbe8058c6723a2d2086539e5d8807f73a64893442fe8bb140d579ee4aececc6"
I0803 23:45:07.391806 1389119 logs.go:123] Gathering logs for kube-proxy [9d8357e9b98e5a01f551902057365a6f43c698ef3ffda88640f432be5ca342dc] ...
I0803 23:45:07.391836 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9d8357e9b98e5a01f551902057365a6f43c698ef3ffda88640f432be5ca342dc"
I0803 23:45:07.437412 1389119 logs.go:123] Gathering logs for kube-controller-manager [decd46f1eb153a03a912739b52c5220cab3bc0a68a41ce2f501a19b1547d030a] ...
I0803 23:45:07.437441 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 decd46f1eb153a03a912739b52c5220cab3bc0a68a41ce2f501a19b1547d030a"
I0803 23:45:07.512477 1389119 logs.go:123] Gathering logs for kindnet [e8b4079036ee954a62ef0fc54baf2b399cac2f40b9f5d82804b0a0b63287f659] ...
I0803 23:45:07.512513 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e8b4079036ee954a62ef0fc54baf2b399cac2f40b9f5d82804b0a0b63287f659"
I0803 23:45:07.574142 1389119 logs.go:123] Gathering logs for kindnet [0d22eec037f1c7aab116e4aa78c05368658c4097a76b252c826555e1a25f0d34] ...
I0803 23:45:07.574177 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0d22eec037f1c7aab116e4aa78c05368658c4097a76b252c826555e1a25f0d34"
I0803 23:45:07.636991 1389119 logs.go:123] Gathering logs for kubernetes-dashboard [32cdc2b56b59662ee956a5208730f2f361969d0adbd1439929e7e6c099a03838] ...
I0803 23:45:07.637025 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 32cdc2b56b59662ee956a5208730f2f361969d0adbd1439929e7e6c099a03838"
I0803 23:45:07.679758 1389119 logs.go:123] Gathering logs for storage-provisioner [9d49e481b2b6243d5e9de51f4fcc1d6d8cb677348b5fd9254200807f07c7297e] ...
I0803 23:45:07.679829 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9d49e481b2b6243d5e9de51f4fcc1d6d8cb677348b5fd9254200807f07c7297e"
I0803 23:45:07.729314 1389119 logs.go:123] Gathering logs for containerd ...
I0803 23:45:07.729344 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0803 23:45:07.793803 1389119 logs.go:123] Gathering logs for describe nodes ...
I0803 23:45:07.793843 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0803 23:45:07.975479 1389119 logs.go:123] Gathering logs for coredns [1fb74e635c11f9e357abcbe302bff95b9c25381dfe33de15354e0eedbc5564f4] ...
I0803 23:45:07.975517 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1fb74e635c11f9e357abcbe302bff95b9c25381dfe33de15354e0eedbc5564f4"
I0803 23:45:08.018369 1389119 logs.go:123] Gathering logs for kube-scheduler [1cf5b72b69cb46a2f0ebd44d87f295610e0a42f9bfb29e2fb3e863c1645de1b9] ...
I0803 23:45:08.018398 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1cf5b72b69cb46a2f0ebd44d87f295610e0a42f9bfb29e2fb3e863c1645de1b9"
I0803 23:45:08.071822 1389119 logs.go:123] Gathering logs for kube-proxy [aceae907dc5dd357ef34d25fba3386bee6214298dda34f31bb744dd99aaf02c5] ...
I0803 23:45:08.071855 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 aceae907dc5dd357ef34d25fba3386bee6214298dda34f31bb744dd99aaf02c5"
I0803 23:45:08.120580 1389119 logs.go:123] Gathering logs for etcd [17af5d5b36407e3b6155abcf2050b778e7fba88e3816192cc23567d11a94cc3e] ...
I0803 23:45:08.120607 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 17af5d5b36407e3b6155abcf2050b778e7fba88e3816192cc23567d11a94cc3e"
I0803 23:45:08.165131 1389119 logs.go:123] Gathering logs for coredns [b8f07cb083173520f0df79356cae5f287397885843c428a87247794fa9b0ad02] ...
I0803 23:45:08.165163 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b8f07cb083173520f0df79356cae5f287397885843c428a87247794fa9b0ad02"
I0803 23:45:08.204082 1389119 logs.go:123] Gathering logs for kube-controller-manager [e15be75c9111b317b4e56baaf7f93bc458c9080032ce09cbdd0e3fa77a17cb5e] ...
I0803 23:45:08.204111 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e15be75c9111b317b4e56baaf7f93bc458c9080032ce09cbdd0e3fa77a17cb5e"
I0803 23:45:08.278449 1389119 logs.go:123] Gathering logs for kube-apiserver [2dfe55d1797db163cd9199214e216cbd925e66788ac3213f4189fd6d49eb137d] ...
I0803 23:45:08.278489 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2dfe55d1797db163cd9199214e216cbd925e66788ac3213f4189fd6d49eb137d"
I0803 23:45:08.346514 1389119 logs.go:123] Gathering logs for kube-scheduler [9bf21e77a35b82c0eff0d1588e963d3c44c43c2c26455b9d13e89d93c07f4a7a] ...
I0803 23:45:08.346551 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9bf21e77a35b82c0eff0d1588e963d3c44c43c2c26455b9d13e89d93c07f4a7a"
I0803 23:45:08.385202 1389119 logs.go:123] Gathering logs for storage-provisioner [fe656919428c126fa2c0d30d5ab782825c967bc723dfa769843ecf5bba788898] ...
I0803 23:45:08.385237 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fe656919428c126fa2c0d30d5ab782825c967bc723dfa769843ecf5bba788898"
I0803 23:45:08.436943 1389119 logs.go:123] Gathering logs for container status ...
I0803 23:45:08.436973 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0803 23:45:08.513063 1389119 out.go:304] Setting ErrFile to fd 2...
I0803 23:45:08.513090 1389119 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0803 23:45:08.513149 1389119 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0803 23:45:08.513166 1389119 out.go:239] Aug 03 23:44:37 old-k8s-version-820414 kubelet[663]: E0803 23:44:37.444223 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
Aug 03 23:44:37 old-k8s-version-820414 kubelet[663]: E0803 23:44:37.444223 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:08.513182 1389119 out.go:239] Aug 03 23:44:50 old-k8s-version-820414 kubelet[663]: E0803 23:44:50.444155 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
Aug 03 23:44:50 old-k8s-version-820414 kubelet[663]: E0803 23:44:50.444155 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:08.513328 1389119 out.go:239] Aug 03 23:44:50 old-k8s-version-820414 kubelet[663]: E0803 23:44:50.445023 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 03 23:44:50 old-k8s-version-820414 kubelet[663]: E0803 23:44:50.445023 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:08.513337 1389119 out.go:239] Aug 03 23:45:02 old-k8s-version-820414 kubelet[663]: E0803 23:45:02.444334 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 03 23:45:02 old-k8s-version-820414 kubelet[663]: E0803 23:45:02.444334 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:08.513343 1389119 out.go:239] Aug 03 23:45:04 old-k8s-version-820414 kubelet[663]: E0803 23:45:04.444530 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
Aug 03 23:45:04 old-k8s-version-820414 kubelet[663]: E0803 23:45:04.444530 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
I0803 23:45:08.513354 1389119 out.go:304] Setting ErrFile to fd 2...
I0803 23:45:08.513365 1389119 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0803 23:45:18.514287 1389119 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0803 23:45:18.526473 1389119 api_server.go:72] duration metric: took 5m57.099654038s to wait for apiserver process to appear ...
I0803 23:45:18.526500 1389119 api_server.go:88] waiting for apiserver healthz status ...
I0803 23:45:18.526535 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0803 23:45:18.526600 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0803 23:45:18.567715 1389119 cri.go:89] found id: "2dfe55d1797db163cd9199214e216cbd925e66788ac3213f4189fd6d49eb137d"
I0803 23:45:18.567739 1389119 cri.go:89] found id: "fb5f0343694ff099d26f408ccb02c199901b58111f3e21cf3de3c23a210d7b6d"
I0803 23:45:18.567744 1389119 cri.go:89] found id: ""
I0803 23:45:18.567751 1389119 logs.go:276] 2 containers: [2dfe55d1797db163cd9199214e216cbd925e66788ac3213f4189fd6d49eb137d fb5f0343694ff099d26f408ccb02c199901b58111f3e21cf3de3c23a210d7b6d]
I0803 23:45:18.567807 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.571380 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.574952 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0803 23:45:18.575024 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0803 23:45:18.615398 1389119 cri.go:89] found id: "5cbe8058c6723a2d2086539e5d8807f73a64893442fe8bb140d579ee4aececc6"
I0803 23:45:18.615423 1389119 cri.go:89] found id: "17af5d5b36407e3b6155abcf2050b778e7fba88e3816192cc23567d11a94cc3e"
I0803 23:45:18.615428 1389119 cri.go:89] found id: ""
I0803 23:45:18.615436 1389119 logs.go:276] 2 containers: [5cbe8058c6723a2d2086539e5d8807f73a64893442fe8bb140d579ee4aececc6 17af5d5b36407e3b6155abcf2050b778e7fba88e3816192cc23567d11a94cc3e]
I0803 23:45:18.615491 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.619044 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.623004 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0803 23:45:18.623101 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0803 23:45:18.666718 1389119 cri.go:89] found id: "b8f07cb083173520f0df79356cae5f287397885843c428a87247794fa9b0ad02"
I0803 23:45:18.666739 1389119 cri.go:89] found id: "1fb74e635c11f9e357abcbe302bff95b9c25381dfe33de15354e0eedbc5564f4"
I0803 23:45:18.666744 1389119 cri.go:89] found id: ""
I0803 23:45:18.666751 1389119 logs.go:276] 2 containers: [b8f07cb083173520f0df79356cae5f287397885843c428a87247794fa9b0ad02 1fb74e635c11f9e357abcbe302bff95b9c25381dfe33de15354e0eedbc5564f4]
I0803 23:45:18.666810 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.670661 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.674310 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0803 23:45:18.674385 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0803 23:45:18.715500 1389119 cri.go:89] found id: "9bf21e77a35b82c0eff0d1588e963d3c44c43c2c26455b9d13e89d93c07f4a7a"
I0803 23:45:18.715541 1389119 cri.go:89] found id: "1cf5b72b69cb46a2f0ebd44d87f295610e0a42f9bfb29e2fb3e863c1645de1b9"
I0803 23:45:18.715546 1389119 cri.go:89] found id: ""
I0803 23:45:18.715553 1389119 logs.go:276] 2 containers: [9bf21e77a35b82c0eff0d1588e963d3c44c43c2c26455b9d13e89d93c07f4a7a 1cf5b72b69cb46a2f0ebd44d87f295610e0a42f9bfb29e2fb3e863c1645de1b9]
I0803 23:45:18.715616 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.719414 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.723323 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0803 23:45:18.723424 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0803 23:45:18.767590 1389119 cri.go:89] found id: "aceae907dc5dd357ef34d25fba3386bee6214298dda34f31bb744dd99aaf02c5"
I0803 23:45:18.767614 1389119 cri.go:89] found id: "9d8357e9b98e5a01f551902057365a6f43c698ef3ffda88640f432be5ca342dc"
I0803 23:45:18.767620 1389119 cri.go:89] found id: ""
I0803 23:45:18.767627 1389119 logs.go:276] 2 containers: [aceae907dc5dd357ef34d25fba3386bee6214298dda34f31bb744dd99aaf02c5 9d8357e9b98e5a01f551902057365a6f43c698ef3ffda88640f432be5ca342dc]
I0803 23:45:18.767685 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.771782 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.775255 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0803 23:45:18.775365 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0803 23:45:18.812952 1389119 cri.go:89] found id: "decd46f1eb153a03a912739b52c5220cab3bc0a68a41ce2f501a19b1547d030a"
I0803 23:45:18.812978 1389119 cri.go:89] found id: "e15be75c9111b317b4e56baaf7f93bc458c9080032ce09cbdd0e3fa77a17cb5e"
I0803 23:45:18.812984 1389119 cri.go:89] found id: ""
I0803 23:45:18.812991 1389119 logs.go:276] 2 containers: [decd46f1eb153a03a912739b52c5220cab3bc0a68a41ce2f501a19b1547d030a e15be75c9111b317b4e56baaf7f93bc458c9080032ce09cbdd0e3fa77a17cb5e]
I0803 23:45:18.813050 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.817560 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.821261 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0803 23:45:18.821336 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0803 23:45:18.874734 1389119 cri.go:89] found id: "e8b4079036ee954a62ef0fc54baf2b399cac2f40b9f5d82804b0a0b63287f659"
I0803 23:45:18.874797 1389119 cri.go:89] found id: "0d22eec037f1c7aab116e4aa78c05368658c4097a76b252c826555e1a25f0d34"
I0803 23:45:18.874808 1389119 cri.go:89] found id: ""
I0803 23:45:18.874815 1389119 logs.go:276] 2 containers: [e8b4079036ee954a62ef0fc54baf2b399cac2f40b9f5d82804b0a0b63287f659 0d22eec037f1c7aab116e4aa78c05368658c4097a76b252c826555e1a25f0d34]
I0803 23:45:18.874878 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.878704 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.882687 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0803 23:45:18.882760 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0803 23:45:18.930472 1389119 cri.go:89] found id: "32cdc2b56b59662ee956a5208730f2f361969d0adbd1439929e7e6c099a03838"
I0803 23:45:18.930547 1389119 cri.go:89] found id: ""
I0803 23:45:18.930562 1389119 logs.go:276] 1 containers: [32cdc2b56b59662ee956a5208730f2f361969d0adbd1439929e7e6c099a03838]
I0803 23:45:18.930627 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.934504 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0803 23:45:18.934584 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0803 23:45:18.972093 1389119 cri.go:89] found id: "fe656919428c126fa2c0d30d5ab782825c967bc723dfa769843ecf5bba788898"
I0803 23:45:18.972114 1389119 cri.go:89] found id: "9d49e481b2b6243d5e9de51f4fcc1d6d8cb677348b5fd9254200807f07c7297e"
I0803 23:45:18.972118 1389119 cri.go:89] found id: ""
I0803 23:45:18.972126 1389119 logs.go:276] 2 containers: [fe656919428c126fa2c0d30d5ab782825c967bc723dfa769843ecf5bba788898 9d49e481b2b6243d5e9de51f4fcc1d6d8cb677348b5fd9254200807f07c7297e]
I0803 23:45:18.972181 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.975653 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.979224 1389119 logs.go:123] Gathering logs for etcd [5cbe8058c6723a2d2086539e5d8807f73a64893442fe8bb140d579ee4aececc6] ...
I0803 23:45:18.979249 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5cbe8058c6723a2d2086539e5d8807f73a64893442fe8bb140d579ee4aececc6"
I0803 23:45:19.024836 1389119 logs.go:123] Gathering logs for kube-controller-manager [decd46f1eb153a03a912739b52c5220cab3bc0a68a41ce2f501a19b1547d030a] ...
I0803 23:45:19.024865 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 decd46f1eb153a03a912739b52c5220cab3bc0a68a41ce2f501a19b1547d030a"
I0803 23:45:19.085464 1389119 logs.go:123] Gathering logs for kube-controller-manager [e15be75c9111b317b4e56baaf7f93bc458c9080032ce09cbdd0e3fa77a17cb5e] ...
I0803 23:45:19.085496 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e15be75c9111b317b4e56baaf7f93bc458c9080032ce09cbdd0e3fa77a17cb5e"
I0803 23:45:19.152566 1389119 logs.go:123] Gathering logs for storage-provisioner [9d49e481b2b6243d5e9de51f4fcc1d6d8cb677348b5fd9254200807f07c7297e] ...
I0803 23:45:19.152598 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9d49e481b2b6243d5e9de51f4fcc1d6d8cb677348b5fd9254200807f07c7297e"
I0803 23:45:19.196949 1389119 logs.go:123] Gathering logs for containerd ...
I0803 23:45:19.196976 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0803 23:45:19.256338 1389119 logs.go:123] Gathering logs for kubelet ...
I0803 23:45:19.256370 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0803 23:45:19.312575 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.459162 663 reflector.go:138] object-"kube-system"/"coredns-token-9d2xv": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-9d2xv" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:19.312808 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.459309 663 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:19.313021 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.459518 663 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:19.313244 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.459607 663 reflector.go:138] object-"kube-system"/"kube-proxy-token-mfhhp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-mfhhp" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:19.313461 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.459825 663 reflector.go:138] object-"kube-system"/"kindnet-token-ghz8l": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-ghz8l" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:19.313744 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.470624 663 reflector.go:138] object-"kube-system"/"storage-provisioner-token-xnstr": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-xnstr" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:19.313958 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.470708 663 reflector.go:138] object-"default"/"default-token-2m78r": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-2m78r" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:19.314180 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.470783 663 reflector.go:138] object-"kube-system"/"metrics-server-token-nxdwh": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-nxdwh" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:19.321969 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:42 old-k8s-version-820414 kubelet[663]: E0803 23:39:42.798080 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0803 23:45:19.322165 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:42 old-k8s-version-820414 kubelet[663]: E0803 23:39:42.847187 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.325787 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:55 old-k8s-version-820414 kubelet[663]: E0803 23:39:55.456344 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0803 23:45:19.327539 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:09 old-k8s-version-820414 kubelet[663]: E0803 23:40:09.485277 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.328844 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:12 old-k8s-version-820414 kubelet[663]: E0803 23:40:12.189775 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.329196 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:13 old-k8s-version-820414 kubelet[663]: E0803 23:40:13.184996 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.329642 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:15 old-k8s-version-820414 kubelet[663]: E0803 23:40:15.194567 663 pod_workers.go:191] Error syncing pod 760afa3c-130b-47d5-a942-ae27ff7ac5f5 ("storage-provisioner_kube-system(760afa3c-130b-47d5-a942-ae27ff7ac5f5)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(760afa3c-130b-47d5-a942-ae27ff7ac5f5)"
W0803 23:45:19.329978 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:16 old-k8s-version-820414 kubelet[663]: E0803 23:40:16.619029 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.332858 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:23 old-k8s-version-820414 kubelet[663]: E0803 23:40:23.484273 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0803 23:45:19.333589 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:30 old-k8s-version-820414 kubelet[663]: E0803 23:40:30.262767 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.333779 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:36 old-k8s-version-820414 kubelet[663]: E0803 23:40:36.524198 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.334110 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:36 old-k8s-version-820414 kubelet[663]: E0803 23:40:36.615532 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.334443 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:48 old-k8s-version-820414 kubelet[663]: E0803 23:40:48.444598 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.334633 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:49 old-k8s-version-820414 kubelet[663]: E0803 23:40:49.445255 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.334820 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:03 old-k8s-version-820414 kubelet[663]: E0803 23:41:03.444496 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.335421 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:04 old-k8s-version-820414 kubelet[663]: E0803 23:41:04.368191 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.335758 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:06 old-k8s-version-820414 kubelet[663]: E0803 23:41:06.609272 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.338272 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:15 old-k8s-version-820414 kubelet[663]: E0803 23:41:15.481112 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0803 23:45:19.338607 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:20 old-k8s-version-820414 kubelet[663]: E0803 23:41:20.444068 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.338795 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:26 old-k8s-version-820414 kubelet[663]: E0803 23:41:26.444477 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.339129 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:35 old-k8s-version-820414 kubelet[663]: E0803 23:41:35.444186 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.339317 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:38 old-k8s-version-820414 kubelet[663]: E0803 23:41:38.444525 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.339919 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:47 old-k8s-version-820414 kubelet[663]: E0803 23:41:47.552369 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.340105 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:52 old-k8s-version-820414 kubelet[663]: E0803 23:41:52.444351 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.340438 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:56 old-k8s-version-820414 kubelet[663]: E0803 23:41:56.604520 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.340631 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:07 old-k8s-version-820414 kubelet[663]: E0803 23:42:07.444300 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.340975 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:11 old-k8s-version-820414 kubelet[663]: E0803 23:42:11.444597 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.341293 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:22 old-k8s-version-820414 kubelet[663]: E0803 23:42:22.444598 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.341492 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:22 old-k8s-version-820414 kubelet[663]: E0803 23:42:22.444840 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.341821 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:34 old-k8s-version-820414 kubelet[663]: E0803 23:42:34.444102 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.344283 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:37 old-k8s-version-820414 kubelet[663]: E0803 23:42:37.453580 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0803 23:45:19.344612 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:49 old-k8s-version-820414 kubelet[663]: E0803 23:42:49.444596 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.344805 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:51 old-k8s-version-820414 kubelet[663]: E0803 23:42:51.445065 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.345144 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:02 old-k8s-version-820414 kubelet[663]: E0803 23:43:02.444071 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.345329 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:05 old-k8s-version-820414 kubelet[663]: E0803 23:43:05.444843 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.345923 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:16 old-k8s-version-820414 kubelet[663]: E0803 23:43:16.774818 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.346108 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:18 old-k8s-version-820414 kubelet[663]: E0803 23:43:18.444453 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.346439 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:26 old-k8s-version-820414 kubelet[663]: E0803 23:43:26.604545 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.346628 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:29 old-k8s-version-820414 kubelet[663]: E0803 23:43:29.445577 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.346959 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:41 old-k8s-version-820414 kubelet[663]: E0803 23:43:41.444779 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.347145 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:44 old-k8s-version-820414 kubelet[663]: E0803 23:43:44.444419 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.347476 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:56 old-k8s-version-820414 kubelet[663]: E0803 23:43:56.444259 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.347665 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:58 old-k8s-version-820414 kubelet[663]: E0803 23:43:58.444353 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.347998 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:08 old-k8s-version-820414 kubelet[663]: E0803 23:44:08.444136 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.348185 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:12 old-k8s-version-820414 kubelet[663]: E0803 23:44:12.444406 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.348518 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:22 old-k8s-version-820414 kubelet[663]: E0803 23:44:22.444030 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.348705 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:23 old-k8s-version-820414 kubelet[663]: E0803 23:44:23.449169 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.348906 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:35 old-k8s-version-820414 kubelet[663]: E0803 23:44:35.445923 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.349238 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:37 old-k8s-version-820414 kubelet[663]: E0803 23:44:37.444223 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.349570 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:50 old-k8s-version-820414 kubelet[663]: E0803 23:44:50.444155 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.349758 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:50 old-k8s-version-820414 kubelet[663]: E0803 23:44:50.445023 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.349944 1389119 logs.go:138] Found kubelet problem: Aug 03 23:45:02 old-k8s-version-820414 kubelet[663]: E0803 23:45:02.444334 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.350279 1389119 logs.go:138] Found kubelet problem: Aug 03 23:45:04 old-k8s-version-820414 kubelet[663]: E0803 23:45:04.444530 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.350466 1389119 logs.go:138] Found kubelet problem: Aug 03 23:45:15 old-k8s-version-820414 kubelet[663]: E0803 23:45:15.444459 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.350799 1389119 logs.go:138] Found kubelet problem: Aug 03 23:45:17 old-k8s-version-820414 kubelet[663]: E0803 23:45:17.444534 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
I0803 23:45:19.350809 1389119 logs.go:123] Gathering logs for kube-apiserver [2dfe55d1797db163cd9199214e216cbd925e66788ac3213f4189fd6d49eb137d] ...
I0803 23:45:19.350823 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2dfe55d1797db163cd9199214e216cbd925e66788ac3213f4189fd6d49eb137d"
I0803 23:45:19.404505 1389119 logs.go:123] Gathering logs for coredns [b8f07cb083173520f0df79356cae5f287397885843c428a87247794fa9b0ad02] ...
I0803 23:45:19.404535 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b8f07cb083173520f0df79356cae5f287397885843c428a87247794fa9b0ad02"
I0803 23:45:19.444242 1389119 logs.go:123] Gathering logs for coredns [1fb74e635c11f9e357abcbe302bff95b9c25381dfe33de15354e0eedbc5564f4] ...
I0803 23:45:19.444324 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1fb74e635c11f9e357abcbe302bff95b9c25381dfe33de15354e0eedbc5564f4"
I0803 23:45:19.497178 1389119 logs.go:123] Gathering logs for kube-proxy [aceae907dc5dd357ef34d25fba3386bee6214298dda34f31bb744dd99aaf02c5] ...
I0803 23:45:19.497207 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 aceae907dc5dd357ef34d25fba3386bee6214298dda34f31bb744dd99aaf02c5"
I0803 23:45:19.535467 1389119 logs.go:123] Gathering logs for kindnet [e8b4079036ee954a62ef0fc54baf2b399cac2f40b9f5d82804b0a0b63287f659] ...
I0803 23:45:19.535495 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e8b4079036ee954a62ef0fc54baf2b399cac2f40b9f5d82804b0a0b63287f659"
I0803 23:45:19.590796 1389119 logs.go:123] Gathering logs for container status ...
I0803 23:45:19.590831 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0803 23:45:19.664429 1389119 logs.go:123] Gathering logs for dmesg ...
I0803 23:45:19.664457 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0803 23:45:19.683161 1389119 logs.go:123] Gathering logs for kube-apiserver [fb5f0343694ff099d26f408ccb02c199901b58111f3e21cf3de3c23a210d7b6d] ...
I0803 23:45:19.683187 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fb5f0343694ff099d26f408ccb02c199901b58111f3e21cf3de3c23a210d7b6d"
I0803 23:45:19.762085 1389119 logs.go:123] Gathering logs for kube-proxy [9d8357e9b98e5a01f551902057365a6f43c698ef3ffda88640f432be5ca342dc] ...
I0803 23:45:19.762122 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9d8357e9b98e5a01f551902057365a6f43c698ef3ffda88640f432be5ca342dc"
I0803 23:45:19.801223 1389119 logs.go:123] Gathering logs for kubernetes-dashboard [32cdc2b56b59662ee956a5208730f2f361969d0adbd1439929e7e6c099a03838] ...
I0803 23:45:19.801250 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 32cdc2b56b59662ee956a5208730f2f361969d0adbd1439929e7e6c099a03838"
I0803 23:45:19.842438 1389119 logs.go:123] Gathering logs for storage-provisioner [fe656919428c126fa2c0d30d5ab782825c967bc723dfa769843ecf5bba788898] ...
I0803 23:45:19.842463 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fe656919428c126fa2c0d30d5ab782825c967bc723dfa769843ecf5bba788898"
I0803 23:45:19.881283 1389119 logs.go:123] Gathering logs for describe nodes ...
I0803 23:45:19.881309 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0803 23:45:20.030350 1389119 logs.go:123] Gathering logs for kube-scheduler [9bf21e77a35b82c0eff0d1588e963d3c44c43c2c26455b9d13e89d93c07f4a7a] ...
I0803 23:45:20.030384 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9bf21e77a35b82c0eff0d1588e963d3c44c43c2c26455b9d13e89d93c07f4a7a"
I0803 23:45:20.078615 1389119 logs.go:123] Gathering logs for kube-scheduler [1cf5b72b69cb46a2f0ebd44d87f295610e0a42f9bfb29e2fb3e863c1645de1b9] ...
I0803 23:45:20.078644 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1cf5b72b69cb46a2f0ebd44d87f295610e0a42f9bfb29e2fb3e863c1645de1b9"
I0803 23:45:20.133111 1389119 logs.go:123] Gathering logs for kindnet [0d22eec037f1c7aab116e4aa78c05368658c4097a76b252c826555e1a25f0d34] ...
I0803 23:45:20.133146 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0d22eec037f1c7aab116e4aa78c05368658c4097a76b252c826555e1a25f0d34"
I0803 23:45:20.187580 1389119 logs.go:123] Gathering logs for etcd [17af5d5b36407e3b6155abcf2050b778e7fba88e3816192cc23567d11a94cc3e] ...
I0803 23:45:20.187613 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 17af5d5b36407e3b6155abcf2050b778e7fba88e3816192cc23567d11a94cc3e"
I0803 23:45:20.231981 1389119 out.go:304] Setting ErrFile to fd 2...
I0803 23:45:20.232005 1389119 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0803 23:45:20.232080 1389119 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0803 23:45:20.232093 1389119 out.go:239] Aug 03 23:44:50 old-k8s-version-820414 kubelet[663]: E0803 23:44:50.445023 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 03 23:44:50 old-k8s-version-820414 kubelet[663]: E0803 23:44:50.445023 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:20.232101 1389119 out.go:239] Aug 03 23:45:02 old-k8s-version-820414 kubelet[663]: E0803 23:45:02.444334 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 03 23:45:02 old-k8s-version-820414 kubelet[663]: E0803 23:45:02.444334 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:20.232128 1389119 out.go:239] Aug 03 23:45:04 old-k8s-version-820414 kubelet[663]: E0803 23:45:04.444530 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
Aug 03 23:45:04 old-k8s-version-820414 kubelet[663]: E0803 23:45:04.444530 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:20.232153 1389119 out.go:239] Aug 03 23:45:15 old-k8s-version-820414 kubelet[663]: E0803 23:45:15.444459 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 03 23:45:15 old-k8s-version-820414 kubelet[663]: E0803 23:45:15.444459 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:20.232159 1389119 out.go:239] Aug 03 23:45:17 old-k8s-version-820414 kubelet[663]: E0803 23:45:17.444534 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
Aug 03 23:45:17 old-k8s-version-820414 kubelet[663]: E0803 23:45:17.444534 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
I0803 23:45:20.232166 1389119 out.go:304] Setting ErrFile to fd 2...
I0803 23:45:20.232171 1389119 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0803 23:45:30.232956 1389119 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0803 23:45:30.246240 1389119 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0803 23:45:30.248504 1389119 out.go:177]
W0803 23:45:30.250531 1389119 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0803 23:45:30.250566 1389119 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0803 23:45:30.250585 1389119 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0803 23:45:30.250591 1389119 out.go:239] *
*
W0803 23:45:30.251796 1389119 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0803 23:45:30.253672 1389119 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-820414 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-820414
helpers_test.go:235: (dbg) docker inspect old-k8s-version-820414:
-- stdout --
[
{
"Id": "6c6e751418278304679cfaa512a57f3ed20d57dc837f1d88d4e3d9c1d83f2e78",
"Created": "2024-08-03T23:37:02.438080251Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 1389326,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-08-03T23:39:14.618864833Z",
"FinishedAt": "2024-08-03T23:39:13.673216016Z"
},
"Image": "sha256:2cd84ab2172023a68162f38a55db46353562cea41552fd8e8bdec97b31b2c495",
"ResolvConfPath": "/var/lib/docker/containers/6c6e751418278304679cfaa512a57f3ed20d57dc837f1d88d4e3d9c1d83f2e78/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/6c6e751418278304679cfaa512a57f3ed20d57dc837f1d88d4e3d9c1d83f2e78/hostname",
"HostsPath": "/var/lib/docker/containers/6c6e751418278304679cfaa512a57f3ed20d57dc837f1d88d4e3d9c1d83f2e78/hosts",
"LogPath": "/var/lib/docker/containers/6c6e751418278304679cfaa512a57f3ed20d57dc837f1d88d4e3d9c1d83f2e78/6c6e751418278304679cfaa512a57f3ed20d57dc837f1d88d4e3d9c1d83f2e78-json.log",
"Name": "/old-k8s-version-820414",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-820414:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-820414",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/64d5c58ba6345085c5b0981fa9b38f39cfe947b6a5ebb3e108990e7097fc526f-init/diff:/var/lib/docker/overlay2/d0e9013ff93972be10de1ce499c76c412f16d87933b328b08c9d90d7f75831bd/diff",
"MergedDir": "/var/lib/docker/overlay2/64d5c58ba6345085c5b0981fa9b38f39cfe947b6a5ebb3e108990e7097fc526f/merged",
"UpperDir": "/var/lib/docker/overlay2/64d5c58ba6345085c5b0981fa9b38f39cfe947b6a5ebb3e108990e7097fc526f/diff",
"WorkDir": "/var/lib/docker/overlay2/64d5c58ba6345085c5b0981fa9b38f39cfe947b6a5ebb3e108990e7097fc526f/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-820414",
"Source": "/var/lib/docker/volumes/old-k8s-version-820414/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-820414",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-820414",
"name.minikube.sigs.k8s.io": "old-k8s-version-820414",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "5e88335dc791ad5b1c914d2745f7968c79755cff193195883ecb050df6f361ac",
"SandboxKey": "/var/run/docker/netns/5e88335dc791",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34543"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34544"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34547"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34545"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34546"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-820414": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null,
"NetworkID": "83efb4e5bf795e056e8f63fc11974546adc9aa8b28497a6b30bd5cb3c0bf7af0",
"EndpointID": "6fb89e03b515d7ab352905a7820822614397829671ee3f994a40283578e619b3",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-820414",
"6c6e75141827"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-820414 -n old-k8s-version-820414
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-820414 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-820414 logs -n 25: (1.962762514s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| ssh | -p cilium-374898 sudo find | cilium-374898 | jenkins | v1.33.1 | 03 Aug 24 23:35 UTC | |
| | /etc/crio -type f -exec sh -c | | | | | |
| | 'echo {}; cat {}' \; | | | | | |
| ssh | -p cilium-374898 sudo crio | cilium-374898 | jenkins | v1.33.1 | 03 Aug 24 23:35 UTC | |
| | config | | | | | |
| delete | -p cilium-374898 | cilium-374898 | jenkins | v1.33.1 | 03 Aug 24 23:35 UTC | 03 Aug 24 23:35 UTC |
| start | -p force-systemd-env-180357 | force-systemd-env-180357 | jenkins | v1.33.1 | 03 Aug 24 23:35 UTC | 03 Aug 24 23:36 UTC |
| | --memory=2048 | | | | | |
| | --alsologtostderr | | | | | |
| | -v=5 --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-flag-272336 | force-systemd-flag-272336 | jenkins | v1.33.1 | 03 Aug 24 23:35 UTC | 03 Aug 24 23:35 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-flag-272336 | force-systemd-flag-272336 | jenkins | v1.33.1 | 03 Aug 24 23:35 UTC | 03 Aug 24 23:35 UTC |
| start | -p cert-expiration-764783 | cert-expiration-764783 | jenkins | v1.33.1 | 03 Aug 24 23:35 UTC | 03 Aug 24 23:36 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-env-180357 | force-systemd-env-180357 | jenkins | v1.33.1 | 03 Aug 24 23:36 UTC | 03 Aug 24 23:36 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-env-180357 | force-systemd-env-180357 | jenkins | v1.33.1 | 03 Aug 24 23:36 UTC | 03 Aug 24 23:36 UTC |
| start | -p cert-options-142692 | cert-options-142692 | jenkins | v1.33.1 | 03 Aug 24 23:36 UTC | 03 Aug 24 23:36 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-142692 ssh | cert-options-142692 | jenkins | v1.33.1 | 03 Aug 24 23:36 UTC | 03 Aug 24 23:36 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-142692 -- sudo | cert-options-142692 | jenkins | v1.33.1 | 03 Aug 24 23:36 UTC | 03 Aug 24 23:36 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-142692 | cert-options-142692 | jenkins | v1.33.1 | 03 Aug 24 23:36 UTC | 03 Aug 24 23:36 UTC |
| start | -p old-k8s-version-820414 | old-k8s-version-820414 | jenkins | v1.33.1 | 03 Aug 24 23:36 UTC | 03 Aug 24 23:38 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p old-k8s-version-820414 | old-k8s-version-820414 | jenkins | v1.33.1 | 03 Aug 24 23:39 UTC | 03 Aug 24 23:39 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-820414 | old-k8s-version-820414 | jenkins | v1.33.1 | 03 Aug 24 23:39 UTC | 03 Aug 24 23:39 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-820414 | old-k8s-version-820414 | jenkins | v1.33.1 | 03 Aug 24 23:39 UTC | 03 Aug 24 23:39 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-820414 | old-k8s-version-820414 | jenkins | v1.33.1 | 03 Aug 24 23:39 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-764783 | cert-expiration-764783 | jenkins | v1.33.1 | 03 Aug 24 23:39 UTC | 03 Aug 24 23:39 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-764783 | cert-expiration-764783 | jenkins | v1.33.1 | 03 Aug 24 23:39 UTC | 03 Aug 24 23:39 UTC |
| start | -p no-preload-344284 | no-preload-344284 | jenkins | v1.33.1 | 03 Aug 24 23:39 UTC | 03 Aug 24 23:41 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0-rc.0 | | | | | |
| addons | enable metrics-server -p no-preload-344284 | no-preload-344284 | jenkins | v1.33.1 | 03 Aug 24 23:41 UTC | 03 Aug 24 23:41 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-344284 | no-preload-344284 | jenkins | v1.33.1 | 03 Aug 24 23:41 UTC | 03 Aug 24 23:41 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-344284 | no-preload-344284 | jenkins | v1.33.1 | 03 Aug 24 23:41 UTC | 03 Aug 24 23:41 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-344284 | no-preload-344284 | jenkins | v1.33.1 | 03 Aug 24 23:41 UTC | |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0-rc.0 | | | | | |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/08/03 23:41:29
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.22.5 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0803 23:41:29.218169 1397775 out.go:291] Setting OutFile to fd 1 ...
I0803 23:41:29.218317 1397775 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0803 23:41:29.218329 1397775 out.go:304] Setting ErrFile to fd 2...
I0803 23:41:29.218335 1397775 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0803 23:41:29.218587 1397775 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19364-1180294/.minikube/bin
I0803 23:41:29.218961 1397775 out.go:298] Setting JSON to false
I0803 23:41:29.220079 1397775 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":30235,"bootTime":1722698255,"procs":238,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0803 23:41:29.220159 1397775 start.go:139] virtualization:
I0803 23:41:29.224282 1397775 out.go:177] * [no-preload-344284] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0803 23:41:29.226307 1397775 out.go:177] - MINIKUBE_LOCATION=19364
I0803 23:41:29.226648 1397775 notify.go:220] Checking for updates...
I0803 23:41:29.230599 1397775 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0803 23:41:29.232433 1397775 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19364-1180294/kubeconfig
I0803 23:41:29.234465 1397775 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19364-1180294/.minikube
I0803 23:41:29.236144 1397775 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0803 23:41:29.238172 1397775 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0803 23:41:29.240437 1397775 config.go:182] Loaded profile config "no-preload-344284": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0-rc.0
I0803 23:41:29.241163 1397775 driver.go:392] Setting default libvirt URI to qemu:///system
I0803 23:41:29.274571 1397775 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
I0803 23:41:29.274679 1397775 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0803 23:41:29.350870 1397775 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:41 OomKillDisable:true NGoroutines:53 SystemTime:2024-08-03 23:41:29.340541295 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0803 23:41:29.350986 1397775 docker.go:307] overlay module found
I0803 23:41:29.353223 1397775 out.go:177] * Using the docker driver based on existing profile
I0803 23:41:29.354914 1397775 start.go:297] selected driver: docker
I0803 23:41:29.354934 1397775 start.go:901] validating driver "docker" against &{Name:no-preload-344284 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-rc.0 ClusterName:no-preload-344284 Namespace:default APIServerHAVIP: APISer
verName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.31.0-rc.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:f
alse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0803 23:41:29.355063 1397775 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0803 23:41:29.355715 1397775 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0803 23:41:29.421048 1397775 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:41 OomKillDisable:true NGoroutines:53 SystemTime:2024-08-03 23:41:29.405776002 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0803 23:41:29.421406 1397775 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0803 23:41:29.421428 1397775 cni.go:84] Creating CNI manager for ""
I0803 23:41:29.421436 1397775 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0803 23:41:29.421483 1397775 start.go:340] cluster config:
{Name:no-preload-344284 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-rc.0 ClusterName:no-preload-344284 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Con
tainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.31.0-rc.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:d
ocker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0803 23:41:29.424922 1397775 out.go:177] * Starting "no-preload-344284" primary control-plane node in "no-preload-344284" cluster
I0803 23:41:29.429374 1397775 cache.go:121] Beginning downloading kic base image for docker with containerd
I0803 23:41:29.431941 1397775 out.go:177] * Pulling base image v0.0.44-1721902582-19326 ...
I0803 23:41:29.433810 1397775 preload.go:131] Checking if preload exists for k8s version v1.31.0-rc.0 and runtime containerd
I0803 23:41:29.433891 1397775 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local docker daemon
I0803 23:41:29.433971 1397775 profile.go:143] Saving config to /home/jenkins/minikube-integration/19364-1180294/.minikube/profiles/no-preload-344284/config.json ...
I0803 23:41:29.434280 1397775 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm.sha256
W0803 23:41:29.455672 1397775 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 is of wrong architecture
I0803 23:41:29.455689 1397775 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 to local cache
I0803 23:41:29.455766 1397775 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory
I0803 23:41:29.455782 1397775 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory, skipping pull
I0803 23:41:29.455787 1397775 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 exists in cache, skipping pull
I0803 23:41:29.455795 1397775 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 as a tarball
I0803 23:41:29.455800 1397775 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from local cache
I0803 23:41:29.597295 1397775 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from cached tarball
I0803 23:41:29.597332 1397775 cache.go:194] Successfully downloaded all kic artifacts
I0803 23:41:29.597362 1397775 start.go:360] acquireMachinesLock for no-preload-344284: {Name:mk78512c904592d48687d7f0baa079ce0fa7c32c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0803 23:41:29.597442 1397775 start.go:364] duration metric: took 52.267µs to acquireMachinesLock for "no-preload-344284"
I0803 23:41:29.597466 1397775 start.go:96] Skipping create...Using existing machine configuration
I0803 23:41:29.597474 1397775 fix.go:54] fixHost starting:
I0803 23:41:29.597768 1397775 cli_runner.go:164] Run: docker container inspect no-preload-344284 --format={{.State.Status}}
I0803 23:41:29.623556 1397775 fix.go:112] recreateIfNeeded on no-preload-344284: state=Stopped err=<nil>
W0803 23:41:29.623583 1397775 fix.go:138] unexpected machine state, will restart: <nil>
I0803 23:41:29.624809 1397775 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm.sha256
I0803 23:41:29.625643 1397775 out.go:177] * Restarting existing docker container for "no-preload-344284" ...
I0803 23:41:29.199602 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:31.698396 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:33.700341 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:29.627400 1397775 cli_runner.go:164] Run: docker start no-preload-344284
I0803 23:41:29.852876 1397775 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm.sha256
I0803 23:41:29.971791 1397775 cli_runner.go:164] Run: docker container inspect no-preload-344284 --format={{.State.Status}}
I0803 23:41:29.994429 1397775 kic.go:430] container "no-preload-344284" state is running.
I0803 23:41:29.994841 1397775 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-344284
I0803 23:41:30.041163 1397775 cache.go:107] acquiring lock: {Name:mkdda788fe5b4c1329a18cab528bc492e47e5a01 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0803 23:41:30.041272 1397775 cache.go:115] /home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
I0803 23:41:30.041282 1397775 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 134.424µs
I0803 23:41:30.041291 1397775 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
I0803 23:41:30.041302 1397775 cache.go:107] acquiring lock: {Name:mkdcf804b7148660376bcf5829e4d8cd9cb607ec Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0803 23:41:30.041347 1397775 cache.go:115] /home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0-rc.0 exists
I0803 23:41:30.041353 1397775 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.31.0-rc.0" -> "/home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0-rc.0" took 52.981µs
I0803 23:41:30.041359 1397775 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.31.0-rc.0 -> /home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0-rc.0 succeeded
I0803 23:41:30.041376 1397775 cache.go:107] acquiring lock: {Name:mk98ec6f549540966c0e37778fd3b1e07d473a1f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0803 23:41:30.041418 1397775 cache.go:115] /home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0-rc.0 exists
I0803 23:41:30.041423 1397775 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.31.0-rc.0" -> "/home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0-rc.0" took 54.351µs
I0803 23:41:30.041430 1397775 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.31.0-rc.0 -> /home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0-rc.0 succeeded
I0803 23:41:30.041444 1397775 cache.go:107] acquiring lock: {Name:mk679a04e82f202846e26c1a65983b4cb9718afd Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0803 23:41:30.041471 1397775 cache.go:115] /home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0-rc.0 exists
I0803 23:41:30.041481 1397775 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.31.0-rc.0" -> "/home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0-rc.0" took 38.655µs
I0803 23:41:30.041488 1397775 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.31.0-rc.0 -> /home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0-rc.0 succeeded
I0803 23:41:30.041497 1397775 cache.go:107] acquiring lock: {Name:mk6f4cd55b127e07c3fc5dfac24312217486517a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0803 23:41:30.041525 1397775 cache.go:115] /home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0-rc.0 exists
I0803 23:41:30.041530 1397775 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.31.0-rc.0" -> "/home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0-rc.0" took 34.01µs
I0803 23:41:30.041536 1397775 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.31.0-rc.0 -> /home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0-rc.0 succeeded
I0803 23:41:30.041547 1397775 cache.go:107] acquiring lock: {Name:mk6217b1aea93e04aece3289712b91de4074ba34 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0803 23:41:30.041574 1397775 cache.go:115] /home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 exists
I0803 23:41:30.041580 1397775 cache.go:96] cache image "registry.k8s.io/pause:3.10" -> "/home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10" took 34.035µs
I0803 23:41:30.041585 1397775 cache.go:80] save to tar file registry.k8s.io/pause:3.10 -> /home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 succeeded
I0803 23:41:30.041595 1397775 cache.go:107] acquiring lock: {Name:mk0099cd3ac17052d2ad64f7e0ee1cb16ad350f8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0803 23:41:30.041620 1397775 cache.go:115] /home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 exists
I0803 23:41:30.041626 1397775 cache.go:96] cache image "registry.k8s.io/etcd:3.5.15-0" -> "/home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0" took 32.566µs
I0803 23:41:30.041632 1397775 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.15-0 -> /home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 succeeded
I0803 23:41:30.041646 1397775 cache.go:107] acquiring lock: {Name:mk7835c40770d4044f387910d0b388b17002de99 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0803 23:41:30.041755 1397775 cache.go:115] /home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 exists
I0803 23:41:30.041761 1397775 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1" took 121.599µs
I0803 23:41:30.041768 1397775 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /home/jenkins/minikube-integration/19364-1180294/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
I0803 23:41:30.041774 1397775 cache.go:87] Successfully saved all images to host disk.
I0803 23:41:30.048960 1397775 profile.go:143] Saving config to /home/jenkins/minikube-integration/19364-1180294/.minikube/profiles/no-preload-344284/config.json ...
I0803 23:41:30.049359 1397775 machine.go:94] provisionDockerMachine start ...
I0803 23:41:30.049470 1397775 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-344284
I0803 23:41:30.076402 1397775 main.go:141] libmachine: Using SSH client type: native
I0803 23:41:30.076966 1397775 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34553 <nil> <nil>}
I0803 23:41:30.076987 1397775 main.go:141] libmachine: About to run SSH command:
hostname
I0803 23:41:30.077641 1397775 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:58736->127.0.0.1:34553: read: connection reset by peer
I0803 23:41:33.212265 1397775 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-344284
I0803 23:41:33.212292 1397775 ubuntu.go:169] provisioning hostname "no-preload-344284"
I0803 23:41:33.212361 1397775 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-344284
I0803 23:41:33.229640 1397775 main.go:141] libmachine: Using SSH client type: native
I0803 23:41:33.229893 1397775 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34553 <nil> <nil>}
I0803 23:41:33.229913 1397775 main.go:141] libmachine: About to run SSH command:
sudo hostname no-preload-344284 && echo "no-preload-344284" | sudo tee /etc/hostname
I0803 23:41:33.373142 1397775 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-344284
I0803 23:41:33.373263 1397775 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-344284
I0803 23:41:33.392033 1397775 main.go:141] libmachine: Using SSH client type: native
I0803 23:41:33.392271 1397775 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34553 <nil> <nil>}
I0803 23:41:33.392287 1397775 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-344284' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-344284/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-344284' | sudo tee -a /etc/hosts;
fi
fi
I0803 23:41:33.532959 1397775 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0803 23:41:33.533001 1397775 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19364-1180294/.minikube CaCertPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19364-1180294/.minikube}
I0803 23:41:33.533032 1397775 ubuntu.go:177] setting up certificates
I0803 23:41:33.533056 1397775 provision.go:84] configureAuth start
I0803 23:41:33.533129 1397775 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-344284
I0803 23:41:33.549986 1397775 provision.go:143] copyHostCerts
I0803 23:41:33.550071 1397775 exec_runner.go:144] found /home/jenkins/minikube-integration/19364-1180294/.minikube/ca.pem, removing ...
I0803 23:41:33.550085 1397775 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19364-1180294/.minikube/ca.pem
I0803 23:41:33.550160 1397775 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19364-1180294/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19364-1180294/.minikube/ca.pem (1078 bytes)
I0803 23:41:33.550273 1397775 exec_runner.go:144] found /home/jenkins/minikube-integration/19364-1180294/.minikube/cert.pem, removing ...
I0803 23:41:33.550290 1397775 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19364-1180294/.minikube/cert.pem
I0803 23:41:33.550318 1397775 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19364-1180294/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19364-1180294/.minikube/cert.pem (1123 bytes)
I0803 23:41:33.550387 1397775 exec_runner.go:144] found /home/jenkins/minikube-integration/19364-1180294/.minikube/key.pem, removing ...
I0803 23:41:33.550396 1397775 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19364-1180294/.minikube/key.pem
I0803 23:41:33.550423 1397775 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19364-1180294/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19364-1180294/.minikube/key.pem (1675 bytes)
I0803 23:41:33.550487 1397775 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19364-1180294/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19364-1180294/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19364-1180294/.minikube/certs/ca-key.pem org=jenkins.no-preload-344284 san=[127.0.0.1 192.168.94.2 localhost minikube no-preload-344284]
I0803 23:41:33.987993 1397775 provision.go:177] copyRemoteCerts
I0803 23:41:33.988089 1397775 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0803 23:41:33.988135 1397775 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-344284
I0803 23:41:34.007168 1397775 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34553 SSHKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/machines/no-preload-344284/id_rsa Username:docker}
I0803 23:41:34.106475 1397775 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0803 23:41:34.132861 1397775 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0803 23:41:34.158432 1397775 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0803 23:41:34.184285 1397775 provision.go:87] duration metric: took 651.210583ms to configureAuth
I0803 23:41:34.184311 1397775 ubuntu.go:193] setting minikube options for container-runtime
I0803 23:41:34.184508 1397775 config.go:182] Loaded profile config "no-preload-344284": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0-rc.0
I0803 23:41:34.184515 1397775 machine.go:97] duration metric: took 4.135145175s to provisionDockerMachine
I0803 23:41:34.184522 1397775 start.go:293] postStartSetup for "no-preload-344284" (driver="docker")
I0803 23:41:34.184534 1397775 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0803 23:41:34.184581 1397775 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0803 23:41:34.184618 1397775 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-344284
I0803 23:41:34.206915 1397775 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34553 SSHKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/machines/no-preload-344284/id_rsa Username:docker}
I0803 23:41:34.303076 1397775 ssh_runner.go:195] Run: cat /etc/os-release
I0803 23:41:34.306766 1397775 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0803 23:41:34.306804 1397775 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0803 23:41:34.306815 1397775 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0803 23:41:34.306823 1397775 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0803 23:41:34.306833 1397775 filesync.go:126] Scanning /home/jenkins/minikube-integration/19364-1180294/.minikube/addons for local assets ...
I0803 23:41:34.306889 1397775 filesync.go:126] Scanning /home/jenkins/minikube-integration/19364-1180294/.minikube/files for local assets ...
I0803 23:41:34.306976 1397775 filesync.go:149] local asset: /home/jenkins/minikube-integration/19364-1180294/.minikube/files/etc/ssl/certs/11857022.pem -> 11857022.pem in /etc/ssl/certs
I0803 23:41:34.307145 1397775 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0803 23:41:34.316343 1397775 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/files/etc/ssl/certs/11857022.pem --> /etc/ssl/certs/11857022.pem (1708 bytes)
I0803 23:41:34.341390 1397775 start.go:296] duration metric: took 156.84653ms for postStartSetup
I0803 23:41:34.341475 1397775 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0803 23:41:34.341531 1397775 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-344284
I0803 23:41:34.357768 1397775 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34553 SSHKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/machines/no-preload-344284/id_rsa Username:docker}
I0803 23:41:34.454025 1397775 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0803 23:41:34.459418 1397775 fix.go:56] duration metric: took 4.861935607s for fixHost
I0803 23:41:34.459445 1397775 start.go:83] releasing machines lock for "no-preload-344284", held for 4.861990376s
I0803 23:41:34.459521 1397775 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-344284
I0803 23:41:34.481333 1397775 ssh_runner.go:195] Run: cat /version.json
I0803 23:41:34.481390 1397775 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-344284
I0803 23:41:34.482013 1397775 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0803 23:41:34.482084 1397775 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-344284
I0803 23:41:34.505674 1397775 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34553 SSHKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/machines/no-preload-344284/id_rsa Username:docker}
I0803 23:41:34.506177 1397775 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34553 SSHKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/machines/no-preload-344284/id_rsa Username:docker}
I0803 23:41:34.732859 1397775 ssh_runner.go:195] Run: systemctl --version
I0803 23:41:34.737682 1397775 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0803 23:41:34.742176 1397775 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0803 23:41:34.759824 1397775 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0803 23:41:34.759914 1397775 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0803 23:41:34.769383 1397775 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0803 23:41:34.769460 1397775 start.go:495] detecting cgroup driver to use...
I0803 23:41:34.769508 1397775 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0803 23:41:34.769598 1397775 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0803 23:41:34.785176 1397775 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0803 23:41:34.799439 1397775 docker.go:217] disabling cri-docker service (if available) ...
I0803 23:41:34.799539 1397775 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0803 23:41:34.813678 1397775 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0803 23:41:34.825963 1397775 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0803 23:41:34.914977 1397775 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0803 23:41:35.000450 1397775 docker.go:233] disabling docker service ...
I0803 23:41:35.000560 1397775 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0803 23:41:35.020749 1397775 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0803 23:41:35.034351 1397775 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0803 23:41:35.133209 1397775 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0803 23:41:35.218568 1397775 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0803 23:41:35.232080 1397775 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0803 23:41:35.248913 1397775 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm.sha256
I0803 23:41:35.413862 1397775 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0803 23:41:35.424812 1397775 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0803 23:41:35.434808 1397775 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0803 23:41:35.434878 1397775 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0803 23:41:35.457642 1397775 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0803 23:41:35.475472 1397775 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0803 23:41:35.485408 1397775 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0803 23:41:35.495109 1397775 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0803 23:41:35.504684 1397775 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0803 23:41:35.515149 1397775 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0803 23:41:35.525965 1397775 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0803 23:41:35.536479 1397775 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0803 23:41:35.545119 1397775 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0803 23:41:35.553810 1397775 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0803 23:41:35.643625 1397775 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0803 23:41:35.798765 1397775 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0803 23:41:35.798855 1397775 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0803 23:41:35.803138 1397775 start.go:563] Will wait 60s for crictl version
I0803 23:41:35.803208 1397775 ssh_runner.go:195] Run: which crictl
I0803 23:41:35.807856 1397775 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0803 23:41:35.849701 1397775 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.19
RuntimeApiVersion: v1
I0803 23:41:35.849781 1397775 ssh_runner.go:195] Run: containerd --version
I0803 23:41:35.876282 1397775 ssh_runner.go:195] Run: containerd --version
I0803 23:41:35.904444 1397775 out.go:177] * Preparing Kubernetes v1.31.0-rc.0 on containerd 1.7.19 ...
I0803 23:41:35.906686 1397775 cli_runner.go:164] Run: docker network inspect no-preload-344284 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0803 23:41:35.921726 1397775 ssh_runner.go:195] Run: grep 192.168.94.1 host.minikube.internal$ /etc/hosts
I0803 23:41:35.925280 1397775 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0803 23:41:35.935980 1397775 kubeadm.go:883] updating cluster {Name:no-preload-344284 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-rc.0 ClusterName:no-preload-344284 Namespace:default APIServerHAVIP: APIServerName:minikubeC
A APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.31.0-rc.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:
/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0803 23:41:35.936192 1397775 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm.sha256
I0803 23:41:36.104907 1397775 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm.sha256
I0803 23:41:36.263928 1397775 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.0-rc.0/bin/linux/arm64/kubeadm.sha256
I0803 23:41:36.425391 1397775 preload.go:131] Checking if preload exists for k8s version v1.31.0-rc.0 and runtime containerd
I0803 23:41:36.425474 1397775 ssh_runner.go:195] Run: sudo crictl images --output json
I0803 23:41:36.474617 1397775 containerd.go:627] all images are preloaded for containerd runtime.
I0803 23:41:36.474645 1397775 cache_images.go:84] Images are preloaded, skipping loading
I0803 23:41:36.474653 1397775 kubeadm.go:934] updating node { 192.168.94.2 8443 v1.31.0-rc.0 containerd true true} ...
I0803 23:41:36.474756 1397775 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.0-rc.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=no-preload-344284 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2
[Install]
config:
{KubernetesVersion:v1.31.0-rc.0 ClusterName:no-preload-344284 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0803 23:41:36.474825 1397775 ssh_runner.go:195] Run: sudo crictl info
I0803 23:41:36.517013 1397775 cni.go:84] Creating CNI manager for ""
I0803 23:41:36.517041 1397775 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0803 23:41:36.517053 1397775 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0803 23:41:36.517077 1397775 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.31.0-rc.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-344284 NodeName:no-preload-344284 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.94.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0803 23:41:36.517222 1397775 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.94.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "no-preload-344284"
kubeletExtraArgs:
node-ip: 192.168.94.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.0-rc.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0803 23:41:36.517299 1397775 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.0-rc.0
I0803 23:41:36.526881 1397775 binaries.go:44] Found k8s binaries, skipping transfer
I0803 23:41:36.526951 1397775 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0803 23:41:36.536011 1397775 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (326 bytes)
I0803 23:41:36.554369 1397775 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)
I0803 23:41:36.574335 1397775 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2176 bytes)
I0803 23:41:36.599096 1397775 ssh_runner.go:195] Run: grep 192.168.94.2 control-plane.minikube.internal$ /etc/hosts
I0803 23:41:36.603321 1397775 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0803 23:41:36.614355 1397775 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0803 23:41:36.725530 1397775 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0803 23:41:36.742825 1397775 certs.go:68] Setting up /home/jenkins/minikube-integration/19364-1180294/.minikube/profiles/no-preload-344284 for IP: 192.168.94.2
I0803 23:41:36.742849 1397775 certs.go:194] generating shared ca certs ...
I0803 23:41:36.742865 1397775 certs.go:226] acquiring lock for ca certs: {Name:mk245d61d460943c9f9c4518cc1e3561b25bafd3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0803 23:41:36.743003 1397775 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19364-1180294/.minikube/ca.key
I0803 23:41:36.743054 1397775 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19364-1180294/.minikube/proxy-client-ca.key
I0803 23:41:36.743066 1397775 certs.go:256] generating profile certs ...
I0803 23:41:36.743149 1397775 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19364-1180294/.minikube/profiles/no-preload-344284/client.key
I0803 23:41:36.743219 1397775 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19364-1180294/.minikube/profiles/no-preload-344284/apiserver.key.00bdfced
I0803 23:41:36.743265 1397775 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19364-1180294/.minikube/profiles/no-preload-344284/proxy-client.key
I0803 23:41:36.743395 1397775 certs.go:484] found cert: /home/jenkins/minikube-integration/19364-1180294/.minikube/certs/1185702.pem (1338 bytes)
W0803 23:41:36.743429 1397775 certs.go:480] ignoring /home/jenkins/minikube-integration/19364-1180294/.minikube/certs/1185702_empty.pem, impossibly tiny 0 bytes
I0803 23:41:36.743440 1397775 certs.go:484] found cert: /home/jenkins/minikube-integration/19364-1180294/.minikube/certs/ca-key.pem (1679 bytes)
I0803 23:41:36.743463 1397775 certs.go:484] found cert: /home/jenkins/minikube-integration/19364-1180294/.minikube/certs/ca.pem (1078 bytes)
I0803 23:41:36.743496 1397775 certs.go:484] found cert: /home/jenkins/minikube-integration/19364-1180294/.minikube/certs/cert.pem (1123 bytes)
I0803 23:41:36.743527 1397775 certs.go:484] found cert: /home/jenkins/minikube-integration/19364-1180294/.minikube/certs/key.pem (1675 bytes)
I0803 23:41:36.743580 1397775 certs.go:484] found cert: /home/jenkins/minikube-integration/19364-1180294/.minikube/files/etc/ssl/certs/11857022.pem (1708 bytes)
I0803 23:41:36.749564 1397775 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0803 23:41:36.779854 1397775 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0803 23:41:36.803649 1397775 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0803 23:41:36.835574 1397775 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0803 23:41:36.873060 1397775 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/profiles/no-preload-344284/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0803 23:41:36.900102 1397775 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/profiles/no-preload-344284/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0803 23:41:36.932553 1397775 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/profiles/no-preload-344284/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0803 23:41:36.961305 1397775 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/profiles/no-preload-344284/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0803 23:41:36.989616 1397775 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0803 23:41:37.019318 1397775 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/certs/1185702.pem --> /usr/share/ca-certificates/1185702.pem (1338 bytes)
I0803 23:41:37.052136 1397775 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-1180294/.minikube/files/etc/ssl/certs/11857022.pem --> /usr/share/ca-certificates/11857022.pem (1708 bytes)
I0803 23:41:37.082907 1397775 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0803 23:41:37.104306 1397775 ssh_runner.go:195] Run: openssl version
I0803 23:41:37.110287 1397775 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0803 23:41:37.119683 1397775 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0803 23:41:37.123163 1397775 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 3 22:49 /usr/share/ca-certificates/minikubeCA.pem
I0803 23:41:37.123318 1397775 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0803 23:41:37.130440 1397775 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0803 23:41:37.139932 1397775 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1185702.pem && ln -fs /usr/share/ca-certificates/1185702.pem /etc/ssl/certs/1185702.pem"
I0803 23:41:37.149644 1397775 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1185702.pem
I0803 23:41:37.153380 1397775 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 3 22:59 /usr/share/ca-certificates/1185702.pem
I0803 23:41:37.153442 1397775 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1185702.pem
I0803 23:41:37.161881 1397775 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1185702.pem /etc/ssl/certs/51391683.0"
I0803 23:41:37.171234 1397775 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11857022.pem && ln -fs /usr/share/ca-certificates/11857022.pem /etc/ssl/certs/11857022.pem"
I0803 23:41:37.181046 1397775 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11857022.pem
I0803 23:41:37.184567 1397775 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 3 22:59 /usr/share/ca-certificates/11857022.pem
I0803 23:41:37.184641 1397775 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11857022.pem
I0803 23:41:37.191789 1397775 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/11857022.pem /etc/ssl/certs/3ec20f2e.0"
I0803 23:41:37.203174 1397775 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0803 23:41:37.206765 1397775 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0803 23:41:37.213449 1397775 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0803 23:41:37.220287 1397775 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0803 23:41:37.227439 1397775 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0803 23:41:37.235578 1397775 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0803 23:41:37.242764 1397775 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0803 23:41:37.249704 1397775 kubeadm.go:392] StartCluster: {Name:no-preload-344284 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-rc.0 ClusterName:no-preload-344284 Namespace:default APIServerHAVIP: APIServerName:minikubeCA A
PIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.31.0-rc.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/ho
me/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0803 23:41:37.249821 1397775 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0803 23:41:37.249893 1397775 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0803 23:41:37.290248 1397775 cri.go:89] found id: "c8ab608f0f0b3cef83473fed4cadeaf2fa75d29147d9588d111c3dd05c6420fb"
I0803 23:41:37.290271 1397775 cri.go:89] found id: "c651dcb9b888abf82205310dfcd2fac85d25c2d8bd5fb629e8abc81ab4e9b88b"
I0803 23:41:37.290276 1397775 cri.go:89] found id: "f97b034bafbab284fcf04c080c4dca6faaf4433fd8fb8f9591434901b2dfa4b1"
I0803 23:41:37.290280 1397775 cri.go:89] found id: "ba5bff2652a59b9315416523f574d7241a2c066402399fe571c43792e6659da1"
I0803 23:41:37.290284 1397775 cri.go:89] found id: "58bf3fcfd955362372b9dc3bda5a40eb2c1bff6e1899d340167c03fcd69d02be"
I0803 23:41:37.290288 1397775 cri.go:89] found id: "6ea351915fbb82c6946939d983bc2bfc19bef7234a801c8be1481d601b766ded"
I0803 23:41:37.290291 1397775 cri.go:89] found id: "32717f7f03ce4464c728ed3920d8a0b51699fa39103d3291b7da29ab551de5b6"
I0803 23:41:37.290294 1397775 cri.go:89] found id: "e18ab35ca669b7f9117c547e9dc835e66589b9a4f0710977544f486538867a8f"
I0803 23:41:37.290300 1397775 cri.go:89] found id: ""
I0803 23:41:37.290355 1397775 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0803 23:41:37.319812 1397775 cri.go:116] JSON = null
W0803 23:41:37.319865 1397775 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0803 23:41:37.319946 1397775 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0803 23:41:37.331313 1397775 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0803 23:41:37.331333 1397775 kubeadm.go:593] restartPrimaryControlPlane start ...
I0803 23:41:37.331386 1397775 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0803 23:41:37.348014 1397775 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0803 23:41:37.348656 1397775 kubeconfig.go:47] verify endpoint returned: get endpoint: "no-preload-344284" does not appear in /home/jenkins/minikube-integration/19364-1180294/kubeconfig
I0803 23:41:37.348947 1397775 kubeconfig.go:62] /home/jenkins/minikube-integration/19364-1180294/kubeconfig needs updating (will repair): [kubeconfig missing "no-preload-344284" cluster setting kubeconfig missing "no-preload-344284" context setting]
I0803 23:41:37.349491 1397775 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19364-1180294/kubeconfig: {Name:mk7ac442c13ee76103bb330a149278eea8a7c99f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0803 23:41:37.350874 1397775 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0803 23:41:37.363994 1397775 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.94.2
I0803 23:41:37.364025 1397775 kubeadm.go:597] duration metric: took 32.685419ms to restartPrimaryControlPlane
I0803 23:41:37.364035 1397775 kubeadm.go:394] duration metric: took 114.342702ms to StartCluster
I0803 23:41:37.364050 1397775 settings.go:142] acquiring lock: {Name:mk6781ca2b0427afb2b67408884ede06d33d8dbf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0803 23:41:37.364114 1397775 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19364-1180294/kubeconfig
I0803 23:41:37.365137 1397775 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19364-1180294/kubeconfig: {Name:mk7ac442c13ee76103bb330a149278eea8a7c99f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0803 23:41:37.365335 1397775 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.31.0-rc.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0803 23:41:37.365626 1397775 config.go:182] Loaded profile config "no-preload-344284": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0-rc.0
I0803 23:41:37.365668 1397775 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0803 23:41:37.365739 1397775 addons.go:69] Setting storage-provisioner=true in profile "no-preload-344284"
I0803 23:41:37.365765 1397775 addons.go:234] Setting addon storage-provisioner=true in "no-preload-344284"
W0803 23:41:37.365777 1397775 addons.go:243] addon storage-provisioner should already be in state true
I0803 23:41:37.365843 1397775 host.go:66] Checking if "no-preload-344284" exists ...
I0803 23:41:37.365795 1397775 addons.go:69] Setting default-storageclass=true in profile "no-preload-344284"
I0803 23:41:37.366108 1397775 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-344284"
I0803 23:41:37.366467 1397775 cli_runner.go:164] Run: docker container inspect no-preload-344284 --format={{.State.Status}}
I0803 23:41:37.366550 1397775 cli_runner.go:164] Run: docker container inspect no-preload-344284 --format={{.State.Status}}
I0803 23:41:37.365800 1397775 addons.go:69] Setting dashboard=true in profile "no-preload-344284"
I0803 23:41:37.366944 1397775 addons.go:234] Setting addon dashboard=true in "no-preload-344284"
W0803 23:41:37.366953 1397775 addons.go:243] addon dashboard should already be in state true
I0803 23:41:37.366976 1397775 host.go:66] Checking if "no-preload-344284" exists ...
I0803 23:41:37.367359 1397775 cli_runner.go:164] Run: docker container inspect no-preload-344284 --format={{.State.Status}}
I0803 23:41:37.365805 1397775 addons.go:69] Setting metrics-server=true in profile "no-preload-344284"
I0803 23:41:37.367689 1397775 addons.go:234] Setting addon metrics-server=true in "no-preload-344284"
W0803 23:41:37.367713 1397775 addons.go:243] addon metrics-server should already be in state true
I0803 23:41:37.367748 1397775 host.go:66] Checking if "no-preload-344284" exists ...
I0803 23:41:37.368146 1397775 cli_runner.go:164] Run: docker container inspect no-preload-344284 --format={{.State.Status}}
I0803 23:41:37.370308 1397775 out.go:177] * Verifying Kubernetes components...
I0803 23:41:37.374138 1397775 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0803 23:41:37.421761 1397775 addons.go:234] Setting addon default-storageclass=true in "no-preload-344284"
W0803 23:41:37.421783 1397775 addons.go:243] addon default-storageclass should already be in state true
I0803 23:41:37.421808 1397775 host.go:66] Checking if "no-preload-344284" exists ...
I0803 23:41:37.422200 1397775 cli_runner.go:164] Run: docker container inspect no-preload-344284 --format={{.State.Status}}
I0803 23:41:37.439431 1397775 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0803 23:41:37.439562 1397775 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0803 23:41:37.441364 1397775 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0803 23:41:37.441409 1397775 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0803 23:41:37.441424 1397775 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0803 23:41:37.441486 1397775 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-344284
I0803 23:41:37.443267 1397775 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0803 23:41:37.443294 1397775 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0803 23:41:37.443356 1397775 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-344284
I0803 23:41:37.445294 1397775 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0803 23:41:36.199366 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:38.201693 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:37.451202 1397775 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0803 23:41:37.451253 1397775 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0803 23:41:37.451338 1397775 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-344284
I0803 23:41:37.481564 1397775 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0803 23:41:37.481584 1397775 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0803 23:41:37.481651 1397775 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-344284
I0803 23:41:37.518425 1397775 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34553 SSHKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/machines/no-preload-344284/id_rsa Username:docker}
I0803 23:41:37.524186 1397775 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34553 SSHKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/machines/no-preload-344284/id_rsa Username:docker}
I0803 23:41:37.536012 1397775 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34553 SSHKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/machines/no-preload-344284/id_rsa Username:docker}
I0803 23:41:37.546318 1397775 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34553 SSHKeyPath:/home/jenkins/minikube-integration/19364-1180294/.minikube/machines/no-preload-344284/id_rsa Username:docker}
I0803 23:41:37.619925 1397775 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0803 23:41:37.717297 1397775 node_ready.go:35] waiting up to 6m0s for node "no-preload-344284" to be "Ready" ...
I0803 23:41:37.816578 1397775 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-rc.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0803 23:41:37.817891 1397775 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0803 23:41:37.817910 1397775 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0803 23:41:37.848278 1397775 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-rc.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0803 23:41:37.891979 1397775 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0803 23:41:37.892056 1397775 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0803 23:41:37.952003 1397775 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0803 23:41:37.952077 1397775 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0803 23:41:38.051939 1397775 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0803 23:41:38.052016 1397775 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0803 23:41:38.147384 1397775 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0803 23:41:38.147455 1397775 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0803 23:41:38.166376 1397775 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0803 23:41:38.166456 1397775 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0803 23:41:38.294750 1397775 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-rc.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0803 23:41:38.368325 1397775 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-rc.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0803 23:41:38.368423 1397775 retry.go:31] will retry after 180.77962ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-rc.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W0803 23:41:38.411327 1397775 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-rc.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0803 23:41:38.411405 1397775 retry.go:31] will retry after 239.796183ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-rc.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0803 23:41:38.499051 1397775 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0803 23:41:38.499115 1397775 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0803 23:41:38.531952 1397775 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0803 23:41:38.532028 1397775 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0803 23:41:38.549563 1397775 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-rc.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0803 23:41:38.555317 1397775 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0803 23:41:38.555391 1397775 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0803 23:41:38.633560 1397775 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0803 23:41:38.633635 1397775 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0803 23:41:38.651586 1397775 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-rc.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0803 23:41:38.689944 1397775 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0803 23:41:38.690014 1397775 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0803 23:41:38.886687 1397775 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0803 23:41:38.886760 1397775 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0803 23:41:38.982540 1397775 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-rc.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0803 23:41:40.703129 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:43.199000 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:42.483736 1397775 node_ready.go:49] node "no-preload-344284" has status "Ready":"True"
I0803 23:41:42.483760 1397775 node_ready.go:38] duration metric: took 4.766389062s for node "no-preload-344284" to be "Ready" ...
I0803 23:41:42.483769 1397775 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0803 23:41:42.531725 1397775 pod_ready.go:78] waiting up to 6m0s for pod "coredns-6f6b679f8f-2cdcf" in "kube-system" namespace to be "Ready" ...
I0803 23:41:42.563986 1397775 pod_ready.go:92] pod "coredns-6f6b679f8f-2cdcf" in "kube-system" namespace has status "Ready":"True"
I0803 23:41:42.564060 1397775 pod_ready.go:81] duration metric: took 32.23121ms for pod "coredns-6f6b679f8f-2cdcf" in "kube-system" namespace to be "Ready" ...
I0803 23:41:42.564096 1397775 pod_ready.go:78] waiting up to 6m0s for pod "etcd-no-preload-344284" in "kube-system" namespace to be "Ready" ...
I0803 23:41:42.574922 1397775 pod_ready.go:92] pod "etcd-no-preload-344284" in "kube-system" namespace has status "Ready":"True"
I0803 23:41:42.574994 1397775 pod_ready.go:81] duration metric: took 10.86657ms for pod "etcd-no-preload-344284" in "kube-system" namespace to be "Ready" ...
I0803 23:41:42.575022 1397775 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-no-preload-344284" in "kube-system" namespace to be "Ready" ...
I0803 23:41:42.580390 1397775 pod_ready.go:92] pod "kube-apiserver-no-preload-344284" in "kube-system" namespace has status "Ready":"True"
I0803 23:41:42.580461 1397775 pod_ready.go:81] duration metric: took 5.417002ms for pod "kube-apiserver-no-preload-344284" in "kube-system" namespace to be "Ready" ...
I0803 23:41:42.580489 1397775 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-no-preload-344284" in "kube-system" namespace to be "Ready" ...
I0803 23:41:42.586101 1397775 pod_ready.go:92] pod "kube-controller-manager-no-preload-344284" in "kube-system" namespace has status "Ready":"True"
I0803 23:41:42.586164 1397775 pod_ready.go:81] duration metric: took 5.653047ms for pod "kube-controller-manager-no-preload-344284" in "kube-system" namespace to be "Ready" ...
I0803 23:41:42.586201 1397775 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-sr8w2" in "kube-system" namespace to be "Ready" ...
I0803 23:41:42.688020 1397775 pod_ready.go:92] pod "kube-proxy-sr8w2" in "kube-system" namespace has status "Ready":"True"
I0803 23:41:42.688088 1397775 pod_ready.go:81] duration metric: took 101.866283ms for pod "kube-proxy-sr8w2" in "kube-system" namespace to be "Ready" ...
I0803 23:41:42.688126 1397775 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-no-preload-344284" in "kube-system" namespace to be "Ready" ...
I0803 23:41:43.097525 1397775 pod_ready.go:92] pod "kube-scheduler-no-preload-344284" in "kube-system" namespace has status "Ready":"True"
I0803 23:41:43.097625 1397775 pod_ready.go:81] duration metric: took 409.470902ms for pod "kube-scheduler-no-preload-344284" in "kube-system" namespace to be "Ready" ...
I0803 23:41:43.097653 1397775 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace to be "Ready" ...
I0803 23:41:45.134875 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:45.454807 1397775 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-rc.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (6.803083704s)
I0803 23:41:45.455112 1397775 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-rc.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (6.904973298s)
I0803 23:41:45.455363 1397775 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-rc.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.160531519s)
I0803 23:41:45.455494 1397775 addons.go:475] Verifying addon metrics-server=true in "no-preload-344284"
I0803 23:41:45.600639 1397775 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-rc.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (6.618007079s)
I0803 23:41:45.603990 1397775 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p no-preload-344284 addons enable metrics-server
I0803 23:41:45.606861 1397775 out.go:177] * Enabled addons: storage-provisioner, metrics-server, default-storageclass, dashboard
I0803 23:41:45.200504 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:47.699001 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:45.608713 1397775 addons.go:510] duration metric: took 8.243040413s for enable addons: enabled=[storage-provisioner metrics-server default-storageclass dashboard]
I0803 23:41:47.603017 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:49.699340 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:51.699432 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:53.700360 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:49.604301 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:52.108215 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:55.700581 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:58.198268 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:54.604128 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:57.104831 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:00.224981 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:02.698424 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:41:59.603620 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:01.605955 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:04.104574 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:04.699134 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:07.198826 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:06.105068 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:08.604638 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:09.698037 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:11.699478 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:11.103749 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:13.603435 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:14.199026 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:16.699028 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:18.699474 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:16.103610 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:18.104144 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:21.199796 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:23.701490 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:20.105168 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:22.603837 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:26.198342 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:28.199086 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:24.604189 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:27.104353 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:30.200328 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:32.699536 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:29.603272 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:31.604275 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:33.605016 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:35.199476 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:37.698937 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:36.104151 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:38.104409 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:40.198984 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:42.204378 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:40.105794 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:42.604390 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:44.698855 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:46.699179 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:48.702669 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:44.604562 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:47.104824 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:51.199902 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:53.200521 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:49.604470 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:52.104645 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:55.698645 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:57.703669 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:54.604511 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:57.103410 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:42:59.103783 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:00.218059 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:02.698937 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:01.603604 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:04.104366 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:05.198988 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:07.698134 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:06.104525 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:08.603484 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:09.700180 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:12.223904 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:11.103902 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:13.105972 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:14.698373 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:16.698784 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:18.699000 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:15.603982 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:18.104240 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:21.198740 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:23.199428 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:20.104961 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:22.603655 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:25.199512 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:27.698426 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:24.604112 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:27.103652 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:29.103713 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:30.200553 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:32.699164 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:31.604372 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:34.104257 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:35.198680 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:37.199039 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:36.604328 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:39.104116 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:39.199410 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:41.698052 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:43.698689 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:41.603157 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:44.103310 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:46.203672 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:48.699366 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:46.603628 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:48.604072 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:51.198826 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:53.698907 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:51.104358 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:53.603682 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:56.199013 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:58.698537 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:56.103672 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:43:58.104429 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:00.699403 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:02.705402 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:00.106805 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:02.605546 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:05.198904 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:07.700261 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:05.105155 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:07.603509 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:10.198829 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:12.199083 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:09.603941 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:11.604100 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:14.104316 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:14.199252 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:16.698753 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:16.603988 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:18.604133 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:19.199876 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:21.698499 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:23.698553 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:21.104632 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:23.604008 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:26.200542 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:28.698447 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:25.604303 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:28.103412 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:30.698685 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:32.698718 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:30.106884 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:32.603005 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:34.699092 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:37.198328 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:34.603365 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:36.603973 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:39.104236 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:39.199068 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:41.698264 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:43.699121 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:41.603461 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:43.604016 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:46.199245 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:48.699142 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:46.104141 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:48.105078 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:51.198567 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:53.698856 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:50.604019 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:53.105487 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:56.199533 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:58.697721 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:55.603521 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:44:58.104352 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:45:00.699068 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:45:02.700391 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:45:00.176775 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:45:02.603779 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:45:05.198810 1389119 pod_ready.go:102] pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace has status "Ready":"False"
I0803 23:45:06.699353 1389119 pod_ready.go:81] duration metric: took 4m0.006793463s for pod "metrics-server-9975d5f86-wm57q" in "kube-system" namespace to be "Ready" ...
E0803 23:45:06.699379 1389119 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0803 23:45:06.699393 1389119 pod_ready.go:38] duration metric: took 5m26.143754509s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0803 23:45:06.699407 1389119 api_server.go:52] waiting for apiserver process to appear ...
I0803 23:45:06.699437 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0803 23:45:06.699508 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0803 23:45:06.762175 1389119 cri.go:89] found id: "2dfe55d1797db163cd9199214e216cbd925e66788ac3213f4189fd6d49eb137d"
I0803 23:45:06.762196 1389119 cri.go:89] found id: "fb5f0343694ff099d26f408ccb02c199901b58111f3e21cf3de3c23a210d7b6d"
I0803 23:45:06.762200 1389119 cri.go:89] found id: ""
I0803 23:45:06.762210 1389119 logs.go:276] 2 containers: [2dfe55d1797db163cd9199214e216cbd925e66788ac3213f4189fd6d49eb137d fb5f0343694ff099d26f408ccb02c199901b58111f3e21cf3de3c23a210d7b6d]
I0803 23:45:06.762267 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:06.765974 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:06.769653 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0803 23:45:06.769726 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0803 23:45:06.807389 1389119 cri.go:89] found id: "5cbe8058c6723a2d2086539e5d8807f73a64893442fe8bb140d579ee4aececc6"
I0803 23:45:06.807413 1389119 cri.go:89] found id: "17af5d5b36407e3b6155abcf2050b778e7fba88e3816192cc23567d11a94cc3e"
I0803 23:45:06.807418 1389119 cri.go:89] found id: ""
I0803 23:45:06.807426 1389119 logs.go:276] 2 containers: [5cbe8058c6723a2d2086539e5d8807f73a64893442fe8bb140d579ee4aececc6 17af5d5b36407e3b6155abcf2050b778e7fba88e3816192cc23567d11a94cc3e]
I0803 23:45:06.807482 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:06.811022 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:06.814520 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0803 23:45:06.814593 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0803 23:45:06.856056 1389119 cri.go:89] found id: "b8f07cb083173520f0df79356cae5f287397885843c428a87247794fa9b0ad02"
I0803 23:45:06.856130 1389119 cri.go:89] found id: "1fb74e635c11f9e357abcbe302bff95b9c25381dfe33de15354e0eedbc5564f4"
I0803 23:45:06.856150 1389119 cri.go:89] found id: ""
I0803 23:45:06.856174 1389119 logs.go:276] 2 containers: [b8f07cb083173520f0df79356cae5f287397885843c428a87247794fa9b0ad02 1fb74e635c11f9e357abcbe302bff95b9c25381dfe33de15354e0eedbc5564f4]
I0803 23:45:06.856257 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:06.860079 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:06.863499 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0803 23:45:06.863594 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0803 23:45:06.905512 1389119 cri.go:89] found id: "9bf21e77a35b82c0eff0d1588e963d3c44c43c2c26455b9d13e89d93c07f4a7a"
I0803 23:45:06.905534 1389119 cri.go:89] found id: "1cf5b72b69cb46a2f0ebd44d87f295610e0a42f9bfb29e2fb3e863c1645de1b9"
I0803 23:45:06.905539 1389119 cri.go:89] found id: ""
I0803 23:45:06.905545 1389119 logs.go:276] 2 containers: [9bf21e77a35b82c0eff0d1588e963d3c44c43c2c26455b9d13e89d93c07f4a7a 1cf5b72b69cb46a2f0ebd44d87f295610e0a42f9bfb29e2fb3e863c1645de1b9]
I0803 23:45:06.905622 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:06.909250 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:06.912616 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0803 23:45:06.912745 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0803 23:45:06.949355 1389119 cri.go:89] found id: "aceae907dc5dd357ef34d25fba3386bee6214298dda34f31bb744dd99aaf02c5"
I0803 23:45:06.949379 1389119 cri.go:89] found id: "9d8357e9b98e5a01f551902057365a6f43c698ef3ffda88640f432be5ca342dc"
I0803 23:45:06.949385 1389119 cri.go:89] found id: ""
I0803 23:45:06.949392 1389119 logs.go:276] 2 containers: [aceae907dc5dd357ef34d25fba3386bee6214298dda34f31bb744dd99aaf02c5 9d8357e9b98e5a01f551902057365a6f43c698ef3ffda88640f432be5ca342dc]
I0803 23:45:06.949477 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:06.953258 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:06.957005 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0803 23:45:06.957132 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0803 23:45:06.994111 1389119 cri.go:89] found id: "decd46f1eb153a03a912739b52c5220cab3bc0a68a41ce2f501a19b1547d030a"
I0803 23:45:06.994136 1389119 cri.go:89] found id: "e15be75c9111b317b4e56baaf7f93bc458c9080032ce09cbdd0e3fa77a17cb5e"
I0803 23:45:06.994141 1389119 cri.go:89] found id: ""
I0803 23:45:06.994148 1389119 logs.go:276] 2 containers: [decd46f1eb153a03a912739b52c5220cab3bc0a68a41ce2f501a19b1547d030a e15be75c9111b317b4e56baaf7f93bc458c9080032ce09cbdd0e3fa77a17cb5e]
I0803 23:45:06.994205 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:06.998167 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:07.003669 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0803 23:45:07.003788 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0803 23:45:07.050511 1389119 cri.go:89] found id: "e8b4079036ee954a62ef0fc54baf2b399cac2f40b9f5d82804b0a0b63287f659"
I0803 23:45:07.050571 1389119 cri.go:89] found id: "0d22eec037f1c7aab116e4aa78c05368658c4097a76b252c826555e1a25f0d34"
I0803 23:45:07.050591 1389119 cri.go:89] found id: ""
I0803 23:45:07.050605 1389119 logs.go:276] 2 containers: [e8b4079036ee954a62ef0fc54baf2b399cac2f40b9f5d82804b0a0b63287f659 0d22eec037f1c7aab116e4aa78c05368658c4097a76b252c826555e1a25f0d34]
I0803 23:45:07.050661 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:07.054359 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:07.058014 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0803 23:45:07.058119 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0803 23:45:07.096089 1389119 cri.go:89] found id: "32cdc2b56b59662ee956a5208730f2f361969d0adbd1439929e7e6c099a03838"
I0803 23:45:07.096114 1389119 cri.go:89] found id: ""
I0803 23:45:07.096122 1389119 logs.go:276] 1 containers: [32cdc2b56b59662ee956a5208730f2f361969d0adbd1439929e7e6c099a03838]
I0803 23:45:07.096176 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:07.099595 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0803 23:45:07.099711 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0803 23:45:07.162961 1389119 cri.go:89] found id: "fe656919428c126fa2c0d30d5ab782825c967bc723dfa769843ecf5bba788898"
I0803 23:45:07.163028 1389119 cri.go:89] found id: "9d49e481b2b6243d5e9de51f4fcc1d6d8cb677348b5fd9254200807f07c7297e"
I0803 23:45:07.163047 1389119 cri.go:89] found id: ""
I0803 23:45:07.163070 1389119 logs.go:276] 2 containers: [fe656919428c126fa2c0d30d5ab782825c967bc723dfa769843ecf5bba788898 9d49e481b2b6243d5e9de51f4fcc1d6d8cb677348b5fd9254200807f07c7297e]
I0803 23:45:07.163166 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:07.166813 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:07.170591 1389119 logs.go:123] Gathering logs for kubelet ...
I0803 23:45:07.170624 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0803 23:45:07.229954 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.459162 663 reflector.go:138] object-"kube-system"/"coredns-token-9d2xv": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-9d2xv" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:07.230178 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.459309 663 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:07.230387 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.459518 663 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:07.230605 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.459607 663 reflector.go:138] object-"kube-system"/"kube-proxy-token-mfhhp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-mfhhp" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:07.230820 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.459825 663 reflector.go:138] object-"kube-system"/"kindnet-token-ghz8l": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-ghz8l" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:07.231056 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.470624 663 reflector.go:138] object-"kube-system"/"storage-provisioner-token-xnstr": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-xnstr" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:07.231267 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.470708 663 reflector.go:138] object-"default"/"default-token-2m78r": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-2m78r" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:07.231489 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.470783 663 reflector.go:138] object-"kube-system"/"metrics-server-token-nxdwh": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-nxdwh" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:07.239211 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:42 old-k8s-version-820414 kubelet[663]: E0803 23:39:42.798080 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0803 23:45:07.239402 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:42 old-k8s-version-820414 kubelet[663]: E0803 23:39:42.847187 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.242987 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:55 old-k8s-version-820414 kubelet[663]: E0803 23:39:55.456344 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0803 23:45:07.244679 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:09 old-k8s-version-820414 kubelet[663]: E0803 23:40:09.485277 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.245677 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:12 old-k8s-version-820414 kubelet[663]: E0803 23:40:12.189775 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.246011 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:13 old-k8s-version-820414 kubelet[663]: E0803 23:40:13.184996 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.246477 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:15 old-k8s-version-820414 kubelet[663]: E0803 23:40:15.194567 663 pod_workers.go:191] Error syncing pod 760afa3c-130b-47d5-a942-ae27ff7ac5f5 ("storage-provisioner_kube-system(760afa3c-130b-47d5-a942-ae27ff7ac5f5)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(760afa3c-130b-47d5-a942-ae27ff7ac5f5)"
W0803 23:45:07.246820 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:16 old-k8s-version-820414 kubelet[663]: E0803 23:40:16.619029 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.249665 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:23 old-k8s-version-820414 kubelet[663]: E0803 23:40:23.484273 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0803 23:45:07.250393 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:30 old-k8s-version-820414 kubelet[663]: E0803 23:40:30.262767 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.250579 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:36 old-k8s-version-820414 kubelet[663]: E0803 23:40:36.524198 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.250908 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:36 old-k8s-version-820414 kubelet[663]: E0803 23:40:36.615532 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.251237 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:48 old-k8s-version-820414 kubelet[663]: E0803 23:40:48.444598 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.251425 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:49 old-k8s-version-820414 kubelet[663]: E0803 23:40:49.445255 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.251622 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:03 old-k8s-version-820414 kubelet[663]: E0803 23:41:03.444496 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.252220 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:04 old-k8s-version-820414 kubelet[663]: E0803 23:41:04.368191 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.252575 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:06 old-k8s-version-820414 kubelet[663]: E0803 23:41:06.609272 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.255047 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:15 old-k8s-version-820414 kubelet[663]: E0803 23:41:15.481112 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0803 23:45:07.255380 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:20 old-k8s-version-820414 kubelet[663]: E0803 23:41:20.444068 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.255574 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:26 old-k8s-version-820414 kubelet[663]: E0803 23:41:26.444477 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.255904 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:35 old-k8s-version-820414 kubelet[663]: E0803 23:41:35.444186 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.256112 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:38 old-k8s-version-820414 kubelet[663]: E0803 23:41:38.444525 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.256714 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:47 old-k8s-version-820414 kubelet[663]: E0803 23:41:47.552369 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.256913 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:52 old-k8s-version-820414 kubelet[663]: E0803 23:41:52.444351 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.257247 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:56 old-k8s-version-820414 kubelet[663]: E0803 23:41:56.604520 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.257437 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:07 old-k8s-version-820414 kubelet[663]: E0803 23:42:07.444300 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.257772 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:11 old-k8s-version-820414 kubelet[663]: E0803 23:42:11.444597 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.258088 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:22 old-k8s-version-820414 kubelet[663]: E0803 23:42:22.444598 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.258287 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:22 old-k8s-version-820414 kubelet[663]: E0803 23:42:22.444840 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.258626 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:34 old-k8s-version-820414 kubelet[663]: E0803 23:42:34.444102 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.261093 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:37 old-k8s-version-820414 kubelet[663]: E0803 23:42:37.453580 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0803 23:45:07.261430 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:49 old-k8s-version-820414 kubelet[663]: E0803 23:42:49.444596 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.261616 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:51 old-k8s-version-820414 kubelet[663]: E0803 23:42:51.445065 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.261945 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:02 old-k8s-version-820414 kubelet[663]: E0803 23:43:02.444071 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.262132 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:05 old-k8s-version-820414 kubelet[663]: E0803 23:43:05.444843 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.262727 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:16 old-k8s-version-820414 kubelet[663]: E0803 23:43:16.774818 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.262915 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:18 old-k8s-version-820414 kubelet[663]: E0803 23:43:18.444453 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.263246 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:26 old-k8s-version-820414 kubelet[663]: E0803 23:43:26.604545 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.263433 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:29 old-k8s-version-820414 kubelet[663]: E0803 23:43:29.445577 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.263764 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:41 old-k8s-version-820414 kubelet[663]: E0803 23:43:41.444779 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.263951 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:44 old-k8s-version-820414 kubelet[663]: E0803 23:43:44.444419 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.264281 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:56 old-k8s-version-820414 kubelet[663]: E0803 23:43:56.444259 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.264467 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:58 old-k8s-version-820414 kubelet[663]: E0803 23:43:58.444353 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.264806 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:08 old-k8s-version-820414 kubelet[663]: E0803 23:44:08.444136 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.264996 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:12 old-k8s-version-820414 kubelet[663]: E0803 23:44:12.444406 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.265328 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:22 old-k8s-version-820414 kubelet[663]: E0803 23:44:22.444030 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.265513 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:23 old-k8s-version-820414 kubelet[663]: E0803 23:44:23.449169 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.265698 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:35 old-k8s-version-820414 kubelet[663]: E0803 23:44:35.445923 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.266028 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:37 old-k8s-version-820414 kubelet[663]: E0803 23:44:37.444223 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.266363 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:50 old-k8s-version-820414 kubelet[663]: E0803 23:44:50.444155 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:07.266550 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:50 old-k8s-version-820414 kubelet[663]: E0803 23:44:50.445023 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.266737 1389119 logs.go:138] Found kubelet problem: Aug 03 23:45:02 old-k8s-version-820414 kubelet[663]: E0803 23:45:02.444334 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:07.267072 1389119 logs.go:138] Found kubelet problem: Aug 03 23:45:04 old-k8s-version-820414 kubelet[663]: E0803 23:45:04.444530 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
I0803 23:45:07.267087 1389119 logs.go:123] Gathering logs for dmesg ...
I0803 23:45:07.267104 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0803 23:45:07.288852 1389119 logs.go:123] Gathering logs for kube-apiserver [fb5f0343694ff099d26f408ccb02c199901b58111f3e21cf3de3c23a210d7b6d] ...
I0803 23:45:07.288927 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fb5f0343694ff099d26f408ccb02c199901b58111f3e21cf3de3c23a210d7b6d"
I0803 23:45:07.347909 1389119 logs.go:123] Gathering logs for etcd [5cbe8058c6723a2d2086539e5d8807f73a64893442fe8bb140d579ee4aececc6] ...
I0803 23:45:07.347941 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5cbe8058c6723a2d2086539e5d8807f73a64893442fe8bb140d579ee4aececc6"
I0803 23:45:07.391806 1389119 logs.go:123] Gathering logs for kube-proxy [9d8357e9b98e5a01f551902057365a6f43c698ef3ffda88640f432be5ca342dc] ...
I0803 23:45:07.391836 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9d8357e9b98e5a01f551902057365a6f43c698ef3ffda88640f432be5ca342dc"
I0803 23:45:07.437412 1389119 logs.go:123] Gathering logs for kube-controller-manager [decd46f1eb153a03a912739b52c5220cab3bc0a68a41ce2f501a19b1547d030a] ...
I0803 23:45:07.437441 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 decd46f1eb153a03a912739b52c5220cab3bc0a68a41ce2f501a19b1547d030a"
I0803 23:45:07.512477 1389119 logs.go:123] Gathering logs for kindnet [e8b4079036ee954a62ef0fc54baf2b399cac2f40b9f5d82804b0a0b63287f659] ...
I0803 23:45:07.512513 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e8b4079036ee954a62ef0fc54baf2b399cac2f40b9f5d82804b0a0b63287f659"
I0803 23:45:07.574142 1389119 logs.go:123] Gathering logs for kindnet [0d22eec037f1c7aab116e4aa78c05368658c4097a76b252c826555e1a25f0d34] ...
I0803 23:45:07.574177 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0d22eec037f1c7aab116e4aa78c05368658c4097a76b252c826555e1a25f0d34"
I0803 23:45:07.636991 1389119 logs.go:123] Gathering logs for kubernetes-dashboard [32cdc2b56b59662ee956a5208730f2f361969d0adbd1439929e7e6c099a03838] ...
I0803 23:45:07.637025 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 32cdc2b56b59662ee956a5208730f2f361969d0adbd1439929e7e6c099a03838"
I0803 23:45:07.679758 1389119 logs.go:123] Gathering logs for storage-provisioner [9d49e481b2b6243d5e9de51f4fcc1d6d8cb677348b5fd9254200807f07c7297e] ...
I0803 23:45:07.679829 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9d49e481b2b6243d5e9de51f4fcc1d6d8cb677348b5fd9254200807f07c7297e"
I0803 23:45:07.729314 1389119 logs.go:123] Gathering logs for containerd ...
I0803 23:45:07.729344 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0803 23:45:07.793803 1389119 logs.go:123] Gathering logs for describe nodes ...
I0803 23:45:07.793843 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0803 23:45:07.975479 1389119 logs.go:123] Gathering logs for coredns [1fb74e635c11f9e357abcbe302bff95b9c25381dfe33de15354e0eedbc5564f4] ...
I0803 23:45:07.975517 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1fb74e635c11f9e357abcbe302bff95b9c25381dfe33de15354e0eedbc5564f4"
I0803 23:45:08.018369 1389119 logs.go:123] Gathering logs for kube-scheduler [1cf5b72b69cb46a2f0ebd44d87f295610e0a42f9bfb29e2fb3e863c1645de1b9] ...
I0803 23:45:08.018398 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1cf5b72b69cb46a2f0ebd44d87f295610e0a42f9bfb29e2fb3e863c1645de1b9"
I0803 23:45:08.071822 1389119 logs.go:123] Gathering logs for kube-proxy [aceae907dc5dd357ef34d25fba3386bee6214298dda34f31bb744dd99aaf02c5] ...
I0803 23:45:08.071855 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 aceae907dc5dd357ef34d25fba3386bee6214298dda34f31bb744dd99aaf02c5"
I0803 23:45:08.120580 1389119 logs.go:123] Gathering logs for etcd [17af5d5b36407e3b6155abcf2050b778e7fba88e3816192cc23567d11a94cc3e] ...
I0803 23:45:08.120607 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 17af5d5b36407e3b6155abcf2050b778e7fba88e3816192cc23567d11a94cc3e"
I0803 23:45:08.165131 1389119 logs.go:123] Gathering logs for coredns [b8f07cb083173520f0df79356cae5f287397885843c428a87247794fa9b0ad02] ...
I0803 23:45:08.165163 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b8f07cb083173520f0df79356cae5f287397885843c428a87247794fa9b0ad02"
I0803 23:45:08.204082 1389119 logs.go:123] Gathering logs for kube-controller-manager [e15be75c9111b317b4e56baaf7f93bc458c9080032ce09cbdd0e3fa77a17cb5e] ...
I0803 23:45:08.204111 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e15be75c9111b317b4e56baaf7f93bc458c9080032ce09cbdd0e3fa77a17cb5e"
I0803 23:45:08.278449 1389119 logs.go:123] Gathering logs for kube-apiserver [2dfe55d1797db163cd9199214e216cbd925e66788ac3213f4189fd6d49eb137d] ...
I0803 23:45:08.278489 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2dfe55d1797db163cd9199214e216cbd925e66788ac3213f4189fd6d49eb137d"
I0803 23:45:08.346514 1389119 logs.go:123] Gathering logs for kube-scheduler [9bf21e77a35b82c0eff0d1588e963d3c44c43c2c26455b9d13e89d93c07f4a7a] ...
I0803 23:45:08.346551 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9bf21e77a35b82c0eff0d1588e963d3c44c43c2c26455b9d13e89d93c07f4a7a"
I0803 23:45:08.385202 1389119 logs.go:123] Gathering logs for storage-provisioner [fe656919428c126fa2c0d30d5ab782825c967bc723dfa769843ecf5bba788898] ...
I0803 23:45:08.385237 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fe656919428c126fa2c0d30d5ab782825c967bc723dfa769843ecf5bba788898"
I0803 23:45:08.436943 1389119 logs.go:123] Gathering logs for container status ...
I0803 23:45:08.436973 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0803 23:45:08.513063 1389119 out.go:304] Setting ErrFile to fd 2...
I0803 23:45:08.513090 1389119 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0803 23:45:08.513149 1389119 out.go:239] X Problems detected in kubelet:
W0803 23:45:08.513166 1389119 out.go:239] Aug 03 23:44:37 old-k8s-version-820414 kubelet[663]: E0803 23:44:37.444223 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:08.513182 1389119 out.go:239] Aug 03 23:44:50 old-k8s-version-820414 kubelet[663]: E0803 23:44:50.444155 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:08.513328 1389119 out.go:239] Aug 03 23:44:50 old-k8s-version-820414 kubelet[663]: E0803 23:44:50.445023 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:08.513337 1389119 out.go:239] Aug 03 23:45:02 old-k8s-version-820414 kubelet[663]: E0803 23:45:02.444334 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:08.513343 1389119 out.go:239] Aug 03 23:45:04 old-k8s-version-820414 kubelet[663]: E0803 23:45:04.444530 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
I0803 23:45:08.513354 1389119 out.go:304] Setting ErrFile to fd 2...
I0803 23:45:08.513365 1389119 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0803 23:45:05.105487 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:45:07.105832 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:45:09.603969 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:45:11.604284 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:45:14.105061 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:45:18.514287 1389119 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0803 23:45:18.526473 1389119 api_server.go:72] duration metric: took 5m57.099654038s to wait for apiserver process to appear ...
I0803 23:45:18.526500 1389119 api_server.go:88] waiting for apiserver healthz status ...
I0803 23:45:18.526535 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0803 23:45:18.526600 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0803 23:45:18.567715 1389119 cri.go:89] found id: "2dfe55d1797db163cd9199214e216cbd925e66788ac3213f4189fd6d49eb137d"
I0803 23:45:18.567739 1389119 cri.go:89] found id: "fb5f0343694ff099d26f408ccb02c199901b58111f3e21cf3de3c23a210d7b6d"
I0803 23:45:18.567744 1389119 cri.go:89] found id: ""
I0803 23:45:18.567751 1389119 logs.go:276] 2 containers: [2dfe55d1797db163cd9199214e216cbd925e66788ac3213f4189fd6d49eb137d fb5f0343694ff099d26f408ccb02c199901b58111f3e21cf3de3c23a210d7b6d]
I0803 23:45:18.567807 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.571380 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.574952 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0803 23:45:18.575024 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0803 23:45:18.615398 1389119 cri.go:89] found id: "5cbe8058c6723a2d2086539e5d8807f73a64893442fe8bb140d579ee4aececc6"
I0803 23:45:18.615423 1389119 cri.go:89] found id: "17af5d5b36407e3b6155abcf2050b778e7fba88e3816192cc23567d11a94cc3e"
I0803 23:45:18.615428 1389119 cri.go:89] found id: ""
I0803 23:45:18.615436 1389119 logs.go:276] 2 containers: [5cbe8058c6723a2d2086539e5d8807f73a64893442fe8bb140d579ee4aececc6 17af5d5b36407e3b6155abcf2050b778e7fba88e3816192cc23567d11a94cc3e]
I0803 23:45:18.615491 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.619044 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.623004 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0803 23:45:18.623101 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0803 23:45:18.666718 1389119 cri.go:89] found id: "b8f07cb083173520f0df79356cae5f287397885843c428a87247794fa9b0ad02"
I0803 23:45:18.666739 1389119 cri.go:89] found id: "1fb74e635c11f9e357abcbe302bff95b9c25381dfe33de15354e0eedbc5564f4"
I0803 23:45:18.666744 1389119 cri.go:89] found id: ""
I0803 23:45:18.666751 1389119 logs.go:276] 2 containers: [b8f07cb083173520f0df79356cae5f287397885843c428a87247794fa9b0ad02 1fb74e635c11f9e357abcbe302bff95b9c25381dfe33de15354e0eedbc5564f4]
I0803 23:45:18.666810 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.670661 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.674310 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0803 23:45:18.674385 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0803 23:45:18.715500 1389119 cri.go:89] found id: "9bf21e77a35b82c0eff0d1588e963d3c44c43c2c26455b9d13e89d93c07f4a7a"
I0803 23:45:18.715541 1389119 cri.go:89] found id: "1cf5b72b69cb46a2f0ebd44d87f295610e0a42f9bfb29e2fb3e863c1645de1b9"
I0803 23:45:18.715546 1389119 cri.go:89] found id: ""
I0803 23:45:18.715553 1389119 logs.go:276] 2 containers: [9bf21e77a35b82c0eff0d1588e963d3c44c43c2c26455b9d13e89d93c07f4a7a 1cf5b72b69cb46a2f0ebd44d87f295610e0a42f9bfb29e2fb3e863c1645de1b9]
I0803 23:45:18.715616 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.719414 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.723323 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0803 23:45:18.723424 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0803 23:45:18.767590 1389119 cri.go:89] found id: "aceae907dc5dd357ef34d25fba3386bee6214298dda34f31bb744dd99aaf02c5"
I0803 23:45:18.767614 1389119 cri.go:89] found id: "9d8357e9b98e5a01f551902057365a6f43c698ef3ffda88640f432be5ca342dc"
I0803 23:45:18.767620 1389119 cri.go:89] found id: ""
I0803 23:45:18.767627 1389119 logs.go:276] 2 containers: [aceae907dc5dd357ef34d25fba3386bee6214298dda34f31bb744dd99aaf02c5 9d8357e9b98e5a01f551902057365a6f43c698ef3ffda88640f432be5ca342dc]
I0803 23:45:18.767685 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.771782 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.775255 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0803 23:45:18.775365 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0803 23:45:18.812952 1389119 cri.go:89] found id: "decd46f1eb153a03a912739b52c5220cab3bc0a68a41ce2f501a19b1547d030a"
I0803 23:45:18.812978 1389119 cri.go:89] found id: "e15be75c9111b317b4e56baaf7f93bc458c9080032ce09cbdd0e3fa77a17cb5e"
I0803 23:45:18.812984 1389119 cri.go:89] found id: ""
I0803 23:45:18.812991 1389119 logs.go:276] 2 containers: [decd46f1eb153a03a912739b52c5220cab3bc0a68a41ce2f501a19b1547d030a e15be75c9111b317b4e56baaf7f93bc458c9080032ce09cbdd0e3fa77a17cb5e]
I0803 23:45:18.813050 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.817560 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.821261 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0803 23:45:18.821336 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0803 23:45:18.874734 1389119 cri.go:89] found id: "e8b4079036ee954a62ef0fc54baf2b399cac2f40b9f5d82804b0a0b63287f659"
I0803 23:45:18.874797 1389119 cri.go:89] found id: "0d22eec037f1c7aab116e4aa78c05368658c4097a76b252c826555e1a25f0d34"
I0803 23:45:18.874808 1389119 cri.go:89] found id: ""
I0803 23:45:18.874815 1389119 logs.go:276] 2 containers: [e8b4079036ee954a62ef0fc54baf2b399cac2f40b9f5d82804b0a0b63287f659 0d22eec037f1c7aab116e4aa78c05368658c4097a76b252c826555e1a25f0d34]
I0803 23:45:18.874878 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.878704 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.882687 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0803 23:45:18.882760 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0803 23:45:18.930472 1389119 cri.go:89] found id: "32cdc2b56b59662ee956a5208730f2f361969d0adbd1439929e7e6c099a03838"
I0803 23:45:18.930547 1389119 cri.go:89] found id: ""
I0803 23:45:18.930562 1389119 logs.go:276] 1 containers: [32cdc2b56b59662ee956a5208730f2f361969d0adbd1439929e7e6c099a03838]
I0803 23:45:18.930627 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.934504 1389119 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0803 23:45:18.934584 1389119 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0803 23:45:18.972093 1389119 cri.go:89] found id: "fe656919428c126fa2c0d30d5ab782825c967bc723dfa769843ecf5bba788898"
I0803 23:45:18.972114 1389119 cri.go:89] found id: "9d49e481b2b6243d5e9de51f4fcc1d6d8cb677348b5fd9254200807f07c7297e"
I0803 23:45:18.972118 1389119 cri.go:89] found id: ""
I0803 23:45:18.972126 1389119 logs.go:276] 2 containers: [fe656919428c126fa2c0d30d5ab782825c967bc723dfa769843ecf5bba788898 9d49e481b2b6243d5e9de51f4fcc1d6d8cb677348b5fd9254200807f07c7297e]
I0803 23:45:18.972181 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.975653 1389119 ssh_runner.go:195] Run: which crictl
I0803 23:45:18.979224 1389119 logs.go:123] Gathering logs for etcd [5cbe8058c6723a2d2086539e5d8807f73a64893442fe8bb140d579ee4aececc6] ...
I0803 23:45:18.979249 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5cbe8058c6723a2d2086539e5d8807f73a64893442fe8bb140d579ee4aececc6"
I0803 23:45:19.024836 1389119 logs.go:123] Gathering logs for kube-controller-manager [decd46f1eb153a03a912739b52c5220cab3bc0a68a41ce2f501a19b1547d030a] ...
I0803 23:45:19.024865 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 decd46f1eb153a03a912739b52c5220cab3bc0a68a41ce2f501a19b1547d030a"
I0803 23:45:19.085464 1389119 logs.go:123] Gathering logs for kube-controller-manager [e15be75c9111b317b4e56baaf7f93bc458c9080032ce09cbdd0e3fa77a17cb5e] ...
I0803 23:45:19.085496 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e15be75c9111b317b4e56baaf7f93bc458c9080032ce09cbdd0e3fa77a17cb5e"
I0803 23:45:16.604659 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:45:19.103159 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:45:19.152566 1389119 logs.go:123] Gathering logs for storage-provisioner [9d49e481b2b6243d5e9de51f4fcc1d6d8cb677348b5fd9254200807f07c7297e] ...
I0803 23:45:19.152598 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9d49e481b2b6243d5e9de51f4fcc1d6d8cb677348b5fd9254200807f07c7297e"
I0803 23:45:19.196949 1389119 logs.go:123] Gathering logs for containerd ...
I0803 23:45:19.196976 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0803 23:45:19.256338 1389119 logs.go:123] Gathering logs for kubelet ...
I0803 23:45:19.256370 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0803 23:45:19.312575 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.459162 663 reflector.go:138] object-"kube-system"/"coredns-token-9d2xv": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-9d2xv" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:19.312808 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.459309 663 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:19.313021 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.459518 663 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:19.313244 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.459607 663 reflector.go:138] object-"kube-system"/"kube-proxy-token-mfhhp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-mfhhp" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:19.313461 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.459825 663 reflector.go:138] object-"kube-system"/"kindnet-token-ghz8l": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-ghz8l" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:19.313744 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.470624 663 reflector.go:138] object-"kube-system"/"storage-provisioner-token-xnstr": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-xnstr" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:19.313958 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.470708 663 reflector.go:138] object-"default"/"default-token-2m78r": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-2m78r" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:19.314180 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:40 old-k8s-version-820414 kubelet[663]: E0803 23:39:40.470783 663 reflector.go:138] object-"kube-system"/"metrics-server-token-nxdwh": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-nxdwh" is forbidden: User "system:node:old-k8s-version-820414" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-820414' and this object
W0803 23:45:19.321969 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:42 old-k8s-version-820414 kubelet[663]: E0803 23:39:42.798080 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0803 23:45:19.322165 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:42 old-k8s-version-820414 kubelet[663]: E0803 23:39:42.847187 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.325787 1389119 logs.go:138] Found kubelet problem: Aug 03 23:39:55 old-k8s-version-820414 kubelet[663]: E0803 23:39:55.456344 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0803 23:45:19.327539 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:09 old-k8s-version-820414 kubelet[663]: E0803 23:40:09.485277 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.328844 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:12 old-k8s-version-820414 kubelet[663]: E0803 23:40:12.189775 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.329196 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:13 old-k8s-version-820414 kubelet[663]: E0803 23:40:13.184996 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.329642 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:15 old-k8s-version-820414 kubelet[663]: E0803 23:40:15.194567 663 pod_workers.go:191] Error syncing pod 760afa3c-130b-47d5-a942-ae27ff7ac5f5 ("storage-provisioner_kube-system(760afa3c-130b-47d5-a942-ae27ff7ac5f5)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(760afa3c-130b-47d5-a942-ae27ff7ac5f5)"
W0803 23:45:19.329978 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:16 old-k8s-version-820414 kubelet[663]: E0803 23:40:16.619029 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.332858 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:23 old-k8s-version-820414 kubelet[663]: E0803 23:40:23.484273 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0803 23:45:19.333589 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:30 old-k8s-version-820414 kubelet[663]: E0803 23:40:30.262767 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.333779 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:36 old-k8s-version-820414 kubelet[663]: E0803 23:40:36.524198 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.334110 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:36 old-k8s-version-820414 kubelet[663]: E0803 23:40:36.615532 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.334443 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:48 old-k8s-version-820414 kubelet[663]: E0803 23:40:48.444598 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.334633 1389119 logs.go:138] Found kubelet problem: Aug 03 23:40:49 old-k8s-version-820414 kubelet[663]: E0803 23:40:49.445255 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.334820 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:03 old-k8s-version-820414 kubelet[663]: E0803 23:41:03.444496 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.335421 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:04 old-k8s-version-820414 kubelet[663]: E0803 23:41:04.368191 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.335758 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:06 old-k8s-version-820414 kubelet[663]: E0803 23:41:06.609272 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.338272 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:15 old-k8s-version-820414 kubelet[663]: E0803 23:41:15.481112 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0803 23:45:19.338607 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:20 old-k8s-version-820414 kubelet[663]: E0803 23:41:20.444068 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.338795 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:26 old-k8s-version-820414 kubelet[663]: E0803 23:41:26.444477 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.339129 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:35 old-k8s-version-820414 kubelet[663]: E0803 23:41:35.444186 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.339317 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:38 old-k8s-version-820414 kubelet[663]: E0803 23:41:38.444525 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.339919 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:47 old-k8s-version-820414 kubelet[663]: E0803 23:41:47.552369 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.340105 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:52 old-k8s-version-820414 kubelet[663]: E0803 23:41:52.444351 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.340438 1389119 logs.go:138] Found kubelet problem: Aug 03 23:41:56 old-k8s-version-820414 kubelet[663]: E0803 23:41:56.604520 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.340631 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:07 old-k8s-version-820414 kubelet[663]: E0803 23:42:07.444300 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.340975 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:11 old-k8s-version-820414 kubelet[663]: E0803 23:42:11.444597 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.341293 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:22 old-k8s-version-820414 kubelet[663]: E0803 23:42:22.444598 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.341492 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:22 old-k8s-version-820414 kubelet[663]: E0803 23:42:22.444840 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.341821 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:34 old-k8s-version-820414 kubelet[663]: E0803 23:42:34.444102 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.344283 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:37 old-k8s-version-820414 kubelet[663]: E0803 23:42:37.453580 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0803 23:45:19.344612 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:49 old-k8s-version-820414 kubelet[663]: E0803 23:42:49.444596 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.344805 1389119 logs.go:138] Found kubelet problem: Aug 03 23:42:51 old-k8s-version-820414 kubelet[663]: E0803 23:42:51.445065 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.345144 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:02 old-k8s-version-820414 kubelet[663]: E0803 23:43:02.444071 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.345329 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:05 old-k8s-version-820414 kubelet[663]: E0803 23:43:05.444843 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.345923 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:16 old-k8s-version-820414 kubelet[663]: E0803 23:43:16.774818 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.346108 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:18 old-k8s-version-820414 kubelet[663]: E0803 23:43:18.444453 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.346439 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:26 old-k8s-version-820414 kubelet[663]: E0803 23:43:26.604545 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.346628 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:29 old-k8s-version-820414 kubelet[663]: E0803 23:43:29.445577 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.346959 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:41 old-k8s-version-820414 kubelet[663]: E0803 23:43:41.444779 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.347145 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:44 old-k8s-version-820414 kubelet[663]: E0803 23:43:44.444419 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.347476 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:56 old-k8s-version-820414 kubelet[663]: E0803 23:43:56.444259 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.347665 1389119 logs.go:138] Found kubelet problem: Aug 03 23:43:58 old-k8s-version-820414 kubelet[663]: E0803 23:43:58.444353 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.347998 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:08 old-k8s-version-820414 kubelet[663]: E0803 23:44:08.444136 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.348185 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:12 old-k8s-version-820414 kubelet[663]: E0803 23:44:12.444406 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.348518 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:22 old-k8s-version-820414 kubelet[663]: E0803 23:44:22.444030 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.348705 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:23 old-k8s-version-820414 kubelet[663]: E0803 23:44:23.449169 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.348906 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:35 old-k8s-version-820414 kubelet[663]: E0803 23:44:35.445923 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.349238 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:37 old-k8s-version-820414 kubelet[663]: E0803 23:44:37.444223 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.349570 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:50 old-k8s-version-820414 kubelet[663]: E0803 23:44:50.444155 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.349758 1389119 logs.go:138] Found kubelet problem: Aug 03 23:44:50 old-k8s-version-820414 kubelet[663]: E0803 23:44:50.445023 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.349944 1389119 logs.go:138] Found kubelet problem: Aug 03 23:45:02 old-k8s-version-820414 kubelet[663]: E0803 23:45:02.444334 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.350279 1389119 logs.go:138] Found kubelet problem: Aug 03 23:45:04 old-k8s-version-820414 kubelet[663]: E0803 23:45:04.444530 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:19.350466 1389119 logs.go:138] Found kubelet problem: Aug 03 23:45:15 old-k8s-version-820414 kubelet[663]: E0803 23:45:15.444459 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:19.350799 1389119 logs.go:138] Found kubelet problem: Aug 03 23:45:17 old-k8s-version-820414 kubelet[663]: E0803 23:45:17.444534 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
I0803 23:45:19.350809 1389119 logs.go:123] Gathering logs for kube-apiserver [2dfe55d1797db163cd9199214e216cbd925e66788ac3213f4189fd6d49eb137d] ...
I0803 23:45:19.350823 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2dfe55d1797db163cd9199214e216cbd925e66788ac3213f4189fd6d49eb137d"
I0803 23:45:19.404505 1389119 logs.go:123] Gathering logs for coredns [b8f07cb083173520f0df79356cae5f287397885843c428a87247794fa9b0ad02] ...
I0803 23:45:19.404535 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b8f07cb083173520f0df79356cae5f287397885843c428a87247794fa9b0ad02"
I0803 23:45:19.444242 1389119 logs.go:123] Gathering logs for coredns [1fb74e635c11f9e357abcbe302bff95b9c25381dfe33de15354e0eedbc5564f4] ...
I0803 23:45:19.444324 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1fb74e635c11f9e357abcbe302bff95b9c25381dfe33de15354e0eedbc5564f4"
I0803 23:45:19.497178 1389119 logs.go:123] Gathering logs for kube-proxy [aceae907dc5dd357ef34d25fba3386bee6214298dda34f31bb744dd99aaf02c5] ...
I0803 23:45:19.497207 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 aceae907dc5dd357ef34d25fba3386bee6214298dda34f31bb744dd99aaf02c5"
I0803 23:45:19.535467 1389119 logs.go:123] Gathering logs for kindnet [e8b4079036ee954a62ef0fc54baf2b399cac2f40b9f5d82804b0a0b63287f659] ...
I0803 23:45:19.535495 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e8b4079036ee954a62ef0fc54baf2b399cac2f40b9f5d82804b0a0b63287f659"
I0803 23:45:19.590796 1389119 logs.go:123] Gathering logs for container status ...
I0803 23:45:19.590831 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0803 23:45:19.664429 1389119 logs.go:123] Gathering logs for dmesg ...
I0803 23:45:19.664457 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0803 23:45:19.683161 1389119 logs.go:123] Gathering logs for kube-apiserver [fb5f0343694ff099d26f408ccb02c199901b58111f3e21cf3de3c23a210d7b6d] ...
I0803 23:45:19.683187 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fb5f0343694ff099d26f408ccb02c199901b58111f3e21cf3de3c23a210d7b6d"
I0803 23:45:19.762085 1389119 logs.go:123] Gathering logs for kube-proxy [9d8357e9b98e5a01f551902057365a6f43c698ef3ffda88640f432be5ca342dc] ...
I0803 23:45:19.762122 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9d8357e9b98e5a01f551902057365a6f43c698ef3ffda88640f432be5ca342dc"
I0803 23:45:19.801223 1389119 logs.go:123] Gathering logs for kubernetes-dashboard [32cdc2b56b59662ee956a5208730f2f361969d0adbd1439929e7e6c099a03838] ...
I0803 23:45:19.801250 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 32cdc2b56b59662ee956a5208730f2f361969d0adbd1439929e7e6c099a03838"
I0803 23:45:19.842438 1389119 logs.go:123] Gathering logs for storage-provisioner [fe656919428c126fa2c0d30d5ab782825c967bc723dfa769843ecf5bba788898] ...
I0803 23:45:19.842463 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fe656919428c126fa2c0d30d5ab782825c967bc723dfa769843ecf5bba788898"
I0803 23:45:19.881283 1389119 logs.go:123] Gathering logs for describe nodes ...
I0803 23:45:19.881309 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0803 23:45:20.030350 1389119 logs.go:123] Gathering logs for kube-scheduler [9bf21e77a35b82c0eff0d1588e963d3c44c43c2c26455b9d13e89d93c07f4a7a] ...
I0803 23:45:20.030384 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9bf21e77a35b82c0eff0d1588e963d3c44c43c2c26455b9d13e89d93c07f4a7a"
I0803 23:45:20.078615 1389119 logs.go:123] Gathering logs for kube-scheduler [1cf5b72b69cb46a2f0ebd44d87f295610e0a42f9bfb29e2fb3e863c1645de1b9] ...
I0803 23:45:20.078644 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1cf5b72b69cb46a2f0ebd44d87f295610e0a42f9bfb29e2fb3e863c1645de1b9"
I0803 23:45:20.133111 1389119 logs.go:123] Gathering logs for kindnet [0d22eec037f1c7aab116e4aa78c05368658c4097a76b252c826555e1a25f0d34] ...
I0803 23:45:20.133146 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0d22eec037f1c7aab116e4aa78c05368658c4097a76b252c826555e1a25f0d34"
I0803 23:45:20.187580 1389119 logs.go:123] Gathering logs for etcd [17af5d5b36407e3b6155abcf2050b778e7fba88e3816192cc23567d11a94cc3e] ...
I0803 23:45:20.187613 1389119 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 17af5d5b36407e3b6155abcf2050b778e7fba88e3816192cc23567d11a94cc3e"
I0803 23:45:20.231981 1389119 out.go:304] Setting ErrFile to fd 2...
I0803 23:45:20.232005 1389119 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0803 23:45:20.232080 1389119 out.go:239] X Problems detected in kubelet:
W0803 23:45:20.232093 1389119 out.go:239] Aug 03 23:44:50 old-k8s-version-820414 kubelet[663]: E0803 23:44:50.445023 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:20.232101 1389119 out.go:239] Aug 03 23:45:02 old-k8s-version-820414 kubelet[663]: E0803 23:45:02.444334 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:20.232128 1389119 out.go:239] Aug 03 23:45:04 old-k8s-version-820414 kubelet[663]: E0803 23:45:04.444530 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
W0803 23:45:20.232153 1389119 out.go:239] Aug 03 23:45:15 old-k8s-version-820414 kubelet[663]: E0803 23:45:15.444459 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0803 23:45:20.232159 1389119 out.go:239] Aug 03 23:45:17 old-k8s-version-820414 kubelet[663]: E0803 23:45:17.444534 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
I0803 23:45:20.232166 1389119 out.go:304] Setting ErrFile to fd 2...
I0803 23:45:20.232171 1389119 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0803 23:45:21.103750 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:45:23.104465 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:45:25.603810 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:45:28.103519 1397775 pod_ready.go:102] pod "metrics-server-6867b74b74-zs9xw" in "kube-system" namespace has status "Ready":"False"
I0803 23:45:30.232956 1389119 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0803 23:45:30.246240 1389119 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0803 23:45:30.248504 1389119 out.go:177]
W0803 23:45:30.250531 1389119 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0803 23:45:30.250566 1389119 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0803 23:45:30.250585 1389119 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0803 23:45:30.250591 1389119 out.go:239] *
W0803 23:45:30.251796 1389119 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0803 23:45:30.253672 1389119 out.go:177]
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
e9f478937b2bf 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 0fd262d35dc5b dashboard-metrics-scraper-8d5bb5db8-lfzsx
fe656919428c1 ba04bb24b9575 5 minutes ago Running storage-provisioner 3 ab3e060f055a2 storage-provisioner
32cdc2b56b596 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 27c2dde627e72 kubernetes-dashboard-cd95d586-8cz7j
e8b4079036ee9 f42786f8afd22 5 minutes ago Running kindnet-cni 1 8069bf9a2778e kindnet-gwx4j
9d49e481b2b62 ba04bb24b9575 5 minutes ago Exited storage-provisioner 2 ab3e060f055a2 storage-provisioner
6b1488f10594b 1611cd07b61d5 5 minutes ago Running busybox 1 6f7facdd80e90 busybox
aceae907dc5dd 25a5233254979 5 minutes ago Running kube-proxy 1 381bd00d85d56 kube-proxy-rgk96
b8f07cb083173 db91994f4ee8f 5 minutes ago Running coredns 1 03c876d4d965f coredns-74ff55c5b-xng8r
9bf21e77a35b8 e7605f88f17d6 6 minutes ago Running kube-scheduler 1 5421129b9e37e kube-scheduler-old-k8s-version-820414
decd46f1eb153 1df8a2b116bd1 6 minutes ago Running kube-controller-manager 1 a7ba02e0f4906 kube-controller-manager-old-k8s-version-820414
2dfe55d1797db 2c08bbbc02d3a 6 minutes ago Running kube-apiserver 1 0b211151e17f0 kube-apiserver-old-k8s-version-820414
5cbe8058c6723 05b738aa1bc63 6 minutes ago Running etcd 1 17fb2b2d378db etcd-old-k8s-version-820414
9ce162788b5a1 1611cd07b61d5 6 minutes ago Exited busybox 0 36edbaf416419 busybox
1fb74e635c11f db91994f4ee8f 7 minutes ago Exited coredns 0 ee0574a1f2ec1 coredns-74ff55c5b-xng8r
0d22eec037f1c f42786f8afd22 7 minutes ago Exited kindnet-cni 0 df034e80af7e1 kindnet-gwx4j
9d8357e9b98e5 25a5233254979 7 minutes ago Exited kube-proxy 0 7f57945672dd2 kube-proxy-rgk96
e15be75c9111b 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 dd679d230f9b5 kube-controller-manager-old-k8s-version-820414
fb5f0343694ff 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 447b07e01ddfe kube-apiserver-old-k8s-version-820414
17af5d5b36407 05b738aa1bc63 8 minutes ago Exited etcd 0 90c4b66b4f9f6 etcd-old-k8s-version-820414
1cf5b72b69cb4 e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 ce3ebe3897896 kube-scheduler-old-k8s-version-820414
==> containerd <==
Aug 03 23:41:46 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:41:46.481527460Z" level=info msg="StartContainer for \"e72990a3698e7bfdd2bfad1d95387715f047cc682d15c971681a91e8c9d80456\""
Aug 03 23:41:46 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:41:46.592464461Z" level=info msg="StartContainer for \"e72990a3698e7bfdd2bfad1d95387715f047cc682d15c971681a91e8c9d80456\" returns successfully"
Aug 03 23:41:46 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:41:46.627576730Z" level=info msg="shim disconnected" id=e72990a3698e7bfdd2bfad1d95387715f047cc682d15c971681a91e8c9d80456 namespace=k8s.io
Aug 03 23:41:46 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:41:46.627641853Z" level=warning msg="cleaning up after shim disconnected" id=e72990a3698e7bfdd2bfad1d95387715f047cc682d15c971681a91e8c9d80456 namespace=k8s.io
Aug 03 23:41:46 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:41:46.627654333Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 03 23:41:46 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:41:46.642424129Z" level=warning msg="cleanup warnings time=\"2024-08-03T23:41:46Z\" level=warning msg=\"failed to remove runc container\" error=\"runc did not terminate successfully: exit status 255: \" runtime=io.containerd.runc.v2\n" namespace=k8s.io
Aug 03 23:41:47 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:41:47.553789293Z" level=info msg="RemoveContainer for \"dca53f66aa1aef008379d8c0adc393f207dd912d52baca794d3554ddcfa6ba8b\""
Aug 03 23:41:47 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:41:47.564987833Z" level=info msg="RemoveContainer for \"dca53f66aa1aef008379d8c0adc393f207dd912d52baca794d3554ddcfa6ba8b\" returns successfully"
Aug 03 23:42:37 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:42:37.445003928Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 03 23:42:37 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:42:37.450533323Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Aug 03 23:42:37 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:42:37.452198754Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Aug 03 23:42:37 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:42:37.452284202Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Aug 03 23:43:16 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:43:16.446028951Z" level=info msg="CreateContainer within sandbox \"0fd262d35dc5bf52833efcc3412d7e137518ca9bb5ffa1d68728b46b7f84fdd5\" for container name:\"dashboard-metrics-scraper\" attempt:5"
Aug 03 23:43:16 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:43:16.461734532Z" level=info msg="CreateContainer within sandbox \"0fd262d35dc5bf52833efcc3412d7e137518ca9bb5ffa1d68728b46b7f84fdd5\" for name:\"dashboard-metrics-scraper\" attempt:5 returns container id \"e9f478937b2bff489b7ea0b9e7c88f8afe428985a501ab678646efdde70637b1\""
Aug 03 23:43:16 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:43:16.462440277Z" level=info msg="StartContainer for \"e9f478937b2bff489b7ea0b9e7c88f8afe428985a501ab678646efdde70637b1\""
Aug 03 23:43:16 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:43:16.543565162Z" level=info msg="StartContainer for \"e9f478937b2bff489b7ea0b9e7c88f8afe428985a501ab678646efdde70637b1\" returns successfully"
Aug 03 23:43:16 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:43:16.569418406Z" level=info msg="shim disconnected" id=e9f478937b2bff489b7ea0b9e7c88f8afe428985a501ab678646efdde70637b1 namespace=k8s.io
Aug 03 23:43:16 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:43:16.569481520Z" level=warning msg="cleaning up after shim disconnected" id=e9f478937b2bff489b7ea0b9e7c88f8afe428985a501ab678646efdde70637b1 namespace=k8s.io
Aug 03 23:43:16 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:43:16.569493442Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 03 23:43:16 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:43:16.776159495Z" level=info msg="RemoveContainer for \"e72990a3698e7bfdd2bfad1d95387715f047cc682d15c971681a91e8c9d80456\""
Aug 03 23:43:16 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:43:16.781878766Z" level=info msg="RemoveContainer for \"e72990a3698e7bfdd2bfad1d95387715f047cc682d15c971681a91e8c9d80456\" returns successfully"
Aug 03 23:45:27 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:45:27.444903693Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 03 23:45:27 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:45:27.459574267Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Aug 03 23:45:27 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:45:27.460912651Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Aug 03 23:45:27 old-k8s-version-820414 containerd[571]: time="2024-08-03T23:45:27.460964482Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
==> coredns [1fb74e635c11f9e357abcbe302bff95b9c25381dfe33de15354e0eedbc5564f4] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:43427 - 9544 "HINFO IN 8098719087605249509.7662860429026608624. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.022468575s
==> coredns [b8f07cb083173520f0df79356cae5f287397885843c428a87247794fa9b0ad02] <==
I0803 23:40:13.700212 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-08-03 23:39:43.696444182 +0000 UTC m=+0.101892922) (total time: 30.003619019s):
Trace[2019727887]: [30.003619019s] [30.003619019s] END
E0803 23:40:13.701007 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0803 23:40:13.700892 1 trace.go:116] Trace[1427131847]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-08-03 23:39:43.700243211 +0000 UTC m=+0.105691951) (total time: 30.00063049s):
Trace[1427131847]: [30.00063049s] [30.00063049s] END
E0803 23:40:13.701307 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0803 23:40:13.700976 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-08-03 23:39:43.700541392 +0000 UTC m=+0.105990124) (total time: 30.000423943s):
Trace[939984059]: [30.000423943s] [30.000423943s] END
E0803 23:40:13.701536 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[INFO] plugin/ready: Still waiting on: "kubernetes"
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:55731 - 57194 "HINFO IN 4734433355628666549.3525272187591717241. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.021564694s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
==> describe nodes <==
Name: old-k8s-version-820414
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-820414
kubernetes.io/os=linux
minikube.k8s.io/commit=b1de62d5257af3586cb63b8c779e46d9f9bc0082
minikube.k8s.io/name=old-k8s-version-820414
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_08_03T23_37_38_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 03 Aug 2024 23:37:34 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-820414
AcquireTime: <unset>
RenewTime: Sat, 03 Aug 2024 23:45:23 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 03 Aug 2024 23:40:31 +0000 Sat, 03 Aug 2024 23:37:28 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 03 Aug 2024 23:40:31 +0000 Sat, 03 Aug 2024 23:37:28 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 03 Aug 2024 23:40:31 +0000 Sat, 03 Aug 2024 23:37:28 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sat, 03 Aug 2024 23:40:31 +0000 Sat, 03 Aug 2024 23:37:53 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-820414
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022360Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022360Ki
pods: 110
System Info:
Machine ID: bb8177524c944613a36db777e8a64971
System UUID: bec97393-fdd7-4da8-bf32-e04beecab7af
Boot ID: 7d37f827-388f-4261-892f-42defe929bba
Kernel Version: 5.15.0-1066-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.19
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m39s
kube-system coredns-74ff55c5b-xng8r 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 7m38s
kube-system etcd-old-k8s-version-820414 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 7m45s
kube-system kindnet-gwx4j 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 7m38s
kube-system kube-apiserver-old-k8s-version-820414 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m45s
kube-system kube-controller-manager-old-k8s-version-820414 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m45s
kube-system kube-proxy-rgk96 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m38s
kube-system kube-scheduler-old-k8s-version-820414 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m45s
kube-system metrics-server-9975d5f86-wm57q 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m29s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m36s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-lfzsx 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m32s
kubernetes-dashboard kubernetes-dashboard-cd95d586-8cz7j 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m32s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m5s (x5 over 8m5s) kubelet Node old-k8s-version-820414 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m5s (x4 over 8m5s) kubelet Node old-k8s-version-820414 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m5s (x4 over 8m5s) kubelet Node old-k8s-version-820414 status is now: NodeHasSufficientPID
Normal Starting 7m45s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 7m45s kubelet Node old-k8s-version-820414 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 7m45s kubelet Node old-k8s-version-820414 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 7m45s kubelet Node old-k8s-version-820414 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 7m45s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 7m38s kubelet Node old-k8s-version-820414 status is now: NodeReady
Normal Starting 7m35s kube-proxy Starting kube-proxy.
Normal Starting 6m2s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 6m2s (x7 over 6m2s) kubelet Node old-k8s-version-820414 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m2s (x8 over 6m2s) kubelet Node old-k8s-version-820414 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m2s (x8 over 6m2s) kubelet Node old-k8s-version-820414 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 6m2s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m47s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.000944] FS-Cache: O-key=[8] 'd0405c0100000000'
[ +0.000642] FS-Cache: N-cookie c=00000054 [p=0000004b fl=2 nc=0 na=1]
[ +0.000872] FS-Cache: N-cookie d=0000000061b9e6aa{9p.inode} n=0000000031d671ab
[ +0.000944] FS-Cache: N-key=[8] 'd0405c0100000000'
[ +0.002903] FS-Cache: Duplicate cookie detected
[ +0.000655] FS-Cache: O-cookie c=0000004e [p=0000004b fl=226 nc=0 na=1]
[ +0.000904] FS-Cache: O-cookie d=0000000061b9e6aa{9p.inode} n=00000000fdae399f
[ +0.000945] FS-Cache: O-key=[8] 'd0405c0100000000'
[ +0.000669] FS-Cache: N-cookie c=00000055 [p=0000004b fl=2 nc=0 na=1]
[ +0.000838] FS-Cache: N-cookie d=0000000061b9e6aa{9p.inode} n=00000000ba0a0cce
[ +0.000952] FS-Cache: N-key=[8] 'd0405c0100000000'
[ +3.720095] FS-Cache: Duplicate cookie detected
[ +0.000655] FS-Cache: O-cookie c=0000004c [p=0000004b fl=226 nc=0 na=1]
[ +0.000877] FS-Cache: O-cookie d=0000000061b9e6aa{9p.inode} n=000000001e359f0a
[ +0.000965] FS-Cache: O-key=[8] 'cf405c0100000000'
[ +0.000672] FS-Cache: N-cookie c=00000057 [p=0000004b fl=2 nc=0 na=1]
[ +0.000866] FS-Cache: N-cookie d=0000000061b9e6aa{9p.inode} n=00000000e7e3c347
[ +0.000947] FS-Cache: N-key=[8] 'cf405c0100000000'
[ +0.298964] FS-Cache: Duplicate cookie detected
[ +0.000648] FS-Cache: O-cookie c=00000051 [p=0000004b fl=226 nc=0 na=1]
[ +0.000878] FS-Cache: O-cookie d=0000000061b9e6aa{9p.inode} n=0000000035df286d
[ +0.001251] FS-Cache: O-key=[8] 'd7405c0100000000'
[ +0.000909] FS-Cache: N-cookie c=00000058 [p=0000004b fl=2 nc=0 na=1]
[ +0.000945] FS-Cache: N-cookie d=0000000061b9e6aa{9p.inode} n=00000000fed31e81
[ +0.001182] FS-Cache: N-key=[8] 'd7405c0100000000'
==> etcd [17af5d5b36407e3b6155abcf2050b778e7fba88e3816192cc23567d11a94cc3e] <==
2024-08-03 23:37:27.481122 I | embed: listening for peers on 192.168.76.2:2380
2024-08-03 23:37:27.481238 I | etcdserver: ea7e25599daad906 as single-node; fast-forwarding 9 ticks (election ticks 10)
raft2024/08/03 23:37:27 INFO: ea7e25599daad906 switched to configuration voters=(16896983918768216326)
2024-08-03 23:37:27.481717 I | etcdserver/membership: added member ea7e25599daad906 [https://192.168.76.2:2380] to cluster 6f20f2c4b2fb5f8a
raft2024/08/03 23:37:27 INFO: ea7e25599daad906 is starting a new election at term 1
raft2024/08/03 23:37:27 INFO: ea7e25599daad906 became candidate at term 2
raft2024/08/03 23:37:27 INFO: ea7e25599daad906 received MsgVoteResp from ea7e25599daad906 at term 2
raft2024/08/03 23:37:27 INFO: ea7e25599daad906 became leader at term 2
raft2024/08/03 23:37:27 INFO: raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2
2024-08-03 23:37:27.668628 I | etcdserver: setting up the initial cluster version to 3.4
2024-08-03 23:37:27.670155 N | etcdserver/membership: set the initial cluster version to 3.4
2024-08-03 23:37:27.670494 I | etcdserver/api: enabled capabilities for version 3.4
2024-08-03 23:37:27.670597 I | etcdserver: published {Name:old-k8s-version-820414 ClientURLs:[https://192.168.76.2:2379]} to cluster 6f20f2c4b2fb5f8a
2024-08-03 23:37:27.670695 I | embed: ready to serve client requests
2024-08-03 23:37:27.671048 I | embed: ready to serve client requests
2024-08-03 23:37:27.672485 I | embed: serving client requests on 127.0.0.1:2379
2024-08-03 23:37:27.716857 I | embed: serving client requests on 192.168.76.2:2379
2024-08-03 23:37:54.315969 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:37:55.365634 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:38:05.365664 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:38:15.365609 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:38:25.365598 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:38:35.365519 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:38:45.365671 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:38:55.365702 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [5cbe8058c6723a2d2086539e5d8807f73a64893442fe8bb140d579ee4aececc6] <==
2024-08-03 23:41:29.327909 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:41:39.327905 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:41:49.327728 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:41:59.328025 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:42:09.327804 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:42:19.327769 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:42:29.327736 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:42:39.328077 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:42:49.327945 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:42:59.327816 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:43:09.327861 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:43:19.327732 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:43:29.327803 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:43:39.327821 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:43:49.327761 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:43:59.327667 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:44:09.327780 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:44:19.327782 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:44:29.327827 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:44:39.327947 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:44:49.327726 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:44:59.327753 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:45:09.327978 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:45:19.327896 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-03 23:45:29.327830 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
23:45:31 up 8:27, 0 users, load average: 0.55, 1.86, 2.40
Linux old-k8s-version-820414 5.15.0-1066-aws #72~20.04.1-Ubuntu SMP Sat Jul 20 07:44:07 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [0d22eec037f1c7aab116e4aa78c05368658c4097a76b252c826555e1a25f0d34] <==
E0803 23:38:06.941161 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0803 23:38:07.545981 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0803 23:38:07.546042 1 main.go:299] handling current node
W0803 23:38:14.219654 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0803 23:38:14.219693 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
W0803 23:38:17.329677 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0803 23:38:17.329727 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0803 23:38:17.546240 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0803 23:38:17.546278 1 main.go:299] handling current node
W0803 23:38:17.744356 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0803 23:38:17.744392 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0803 23:38:27.546105 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0803 23:38:27.546142 1 main.go:299] handling current node
W0803 23:38:33.519981 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0803 23:38:33.520022 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
W0803 23:38:34.746722 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0803 23:38:34.746759 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0803 23:38:37.545666 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0803 23:38:37.545708 1 main.go:299] handling current node
W0803 23:38:38.095971 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0803 23:38:38.096203 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0803 23:38:47.545624 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0803 23:38:47.545664 1 main.go:299] handling current node
I0803 23:38:57.546239 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0803 23:38:57.546291 1 main.go:299] handling current node
==> kindnet [e8b4079036ee954a62ef0fc54baf2b399cac2f40b9f5d82804b0a0b63287f659] <==
I0803 23:44:15.846220 1 main.go:299] handling current node
I0803 23:44:25.845234 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0803 23:44:25.845460 1 main.go:299] handling current node
W0803 23:44:27.404812 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0803 23:44:27.404857 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0803 23:44:35.845472 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0803 23:44:35.845509 1 main.go:299] handling current node
I0803 23:44:45.845534 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0803 23:44:45.845570 1 main.go:299] handling current node
W0803 23:44:46.319262 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0803 23:44:46.319300 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
W0803 23:44:51.539721 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0803 23:44:51.539817 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0803 23:44:55.846013 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0803 23:44:55.846059 1 main.go:299] handling current node
I0803 23:45:05.846227 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0803 23:45:05.846265 1 main.go:299] handling current node
I0803 23:45:15.845233 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0803 23:45:15.845267 1 main.go:299] handling current node
W0803 23:45:24.656615 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0803 23:45:24.656664 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0803 23:45:25.845435 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0803 23:45:25.845474 1 main.go:299] handling current node
W0803 23:45:31.493549 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0803 23:45:31.493591 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
==> kube-apiserver [2dfe55d1797db163cd9199214e216cbd925e66788ac3213f4189fd6d49eb137d] <==
I0803 23:41:50.545217 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0803 23:41:50.545301 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0803 23:42:34.915732 1 client.go:360] parsed scheme: "passthrough"
I0803 23:42:34.915962 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0803 23:42:34.915975 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0803 23:42:44.485292 1 handler_proxy.go:102] no RequestInfo found in the context
E0803 23:42:44.485525 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0803 23:42:44.485545 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0803 23:43:14.156486 1 client.go:360] parsed scheme: "passthrough"
I0803 23:43:14.156693 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0803 23:43:14.156712 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0803 23:43:45.474431 1 client.go:360] parsed scheme: "passthrough"
I0803 23:43:45.474475 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0803 23:43:45.474512 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0803 23:44:24.729158 1 client.go:360] parsed scheme: "passthrough"
I0803 23:44:24.729206 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0803 23:44:24.729214 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0803 23:44:41.619054 1 handler_proxy.go:102] no RequestInfo found in the context
E0803 23:44:41.619129 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0803 23:44:41.619137 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0803 23:45:08.235681 1 client.go:360] parsed scheme: "passthrough"
I0803 23:45:08.235720 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0803 23:45:08.235728 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [fb5f0343694ff099d26f408ccb02c199901b58111f3e21cf3de3c23a210d7b6d] <==
I0803 23:37:34.770000 1 shared_informer.go:247] Caches are synced for crd-autoregister
I0803 23:37:34.853296 1 cache.go:39] Caches are synced for AvailableConditionController controller
I0803 23:37:34.860581 1 controller.go:606] quota admission added evaluator for: namespaces
I0803 23:37:35.529649 1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
I0803 23:37:35.529685 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I0803 23:37:35.534801 1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000
I0803 23:37:35.538555 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I0803 23:37:35.538577 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0803 23:37:36.057950 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0803 23:37:36.114755 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0803 23:37:36.234981 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
I0803 23:37:36.236259 1 controller.go:606] quota admission added evaluator for: endpoints
I0803 23:37:36.240525 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0803 23:37:37.161011 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0803 23:37:37.778645 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0803 23:37:37.867538 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0803 23:37:46.287194 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0803 23:37:53.770845 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0803 23:37:53.948596 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0803 23:38:01.779067 1 client.go:360] parsed scheme: "passthrough"
I0803 23:38:01.780362 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0803 23:38:01.780404 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0803 23:38:32.232105 1 client.go:360] parsed scheme: "passthrough"
I0803 23:38:32.232150 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0803 23:38:32.232159 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [decd46f1eb153a03a912739b52c5220cab3bc0a68a41ce2f501a19b1547d030a] <==
W0803 23:41:04.655760 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0803 23:41:30.722148 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0803 23:41:36.306143 1 request.go:655] Throttling request took 1.048265773s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0803 23:41:37.157664 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0803 23:42:01.224162 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0803 23:42:08.808308 1 request.go:655] Throttling request took 1.048373043s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0803 23:42:09.659713 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0803 23:42:31.726014 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0803 23:42:41.310161 1 request.go:655] Throttling request took 1.048208091s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0803 23:42:42.162129 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0803 23:43:02.227767 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0803 23:43:13.814395 1 request.go:655] Throttling request took 1.048309236s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0803 23:43:14.665794 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0803 23:43:32.729579 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0803 23:43:46.316357 1 request.go:655] Throttling request took 1.048289403s, request: GET:https://192.168.76.2:8443/apis/events.k8s.io/v1beta1?timeout=32s
W0803 23:43:47.167741 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0803 23:44:03.231469 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0803 23:44:18.818323 1 request.go:655] Throttling request took 1.048394895s, request: GET:https://192.168.76.2:8443/apis/certificates.k8s.io/v1?timeout=32s
W0803 23:44:19.669882 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0803 23:44:33.733300 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0803 23:44:51.320280 1 request.go:655] Throttling request took 1.048358691s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0803 23:44:52.171774 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0803 23:45:04.235202 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0803 23:45:23.822163 1 request.go:655] Throttling request took 1.048438866s, request: GET:https://192.168.76.2:8443/apis/autoscaling/v2beta2?timeout=32s
W0803 23:45:24.673416 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-controller-manager [e15be75c9111b317b4e56baaf7f93bc458c9080032ce09cbdd0e3fa77a17cb5e] <==
I0803 23:37:53.881487 1 range_allocator.go:373] Set node old-k8s-version-820414 PodCIDR to [10.244.0.0/24]
I0803 23:37:53.891398 1 shared_informer.go:247] Caches are synced for persistent volume
I0803 23:37:53.892840 1 shared_informer.go:247] Caches are synced for resource quota
I0803 23:37:53.894944 1 shared_informer.go:247] Caches are synced for ReplicaSet
I0803 23:37:53.900825 1 shared_informer.go:247] Caches are synced for disruption
I0803 23:37:53.900848 1 disruption.go:339] Sending events to api server.
E0803 23:37:53.905188 1 clusterroleaggregation_controller.go:181] view failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "view": the object has been modified; please apply your changes to the latest version and try again
I0803 23:37:53.905442 1 shared_informer.go:247] Caches are synced for resource quota
I0803 23:37:53.906992 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-gwx4j"
I0803 23:37:53.937540 1 shared_informer.go:247] Caches are synced for deployment
E0803 23:37:53.939292 1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
I0803 23:37:53.941724 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-rgk96"
I0803 23:37:53.989118 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-74ff55c5b to 2"
I0803 23:37:54.017496 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-xng8r"
I0803 23:37:54.055721 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-mq76w"
E0803 23:37:54.065071 1 daemon_controller.go:320] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"687efdd9-c112-4c99-a123-b957e89b6fcc", ResourceVersion:"267", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63858325057, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001672f60), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001672f80)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.
LabelSelector)(0x4001672fa0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Gl
usterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0x4001698680), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001672
fc0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeS
ource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001672fe0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil),
AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.20.0", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001673020)}}, Resources:v1.R
esourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x4001646960), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPo
licy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4000bc2a98), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x4000affc70), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), Runtime
ClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x40002072d8)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4000bc2ae8)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest version and try again
I0803 23:37:54.461149 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0803 23:37:54.538794 1 shared_informer.go:247] Caches are synced for garbage collector
I0803 23:37:54.538824 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0803 23:37:54.561399 1 shared_informer.go:247] Caches are synced for garbage collector
I0803 23:37:55.501048 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0803 23:37:55.518167 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-mq76w"
I0803 23:37:58.652528 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I0803 23:39:01.403762 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
E0803 23:39:01.509068 1 clusterroleaggregation_controller.go:181] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
==> kube-proxy [9d8357e9b98e5a01f551902057365a6f43c698ef3ffda88640f432be5ca342dc] <==
I0803 23:37:56.221465 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0803 23:37:56.222342 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0803 23:37:56.258218 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0803 23:37:56.258535 1 server_others.go:185] Using iptables Proxier.
I0803 23:37:56.258933 1 server.go:650] Version: v1.20.0
I0803 23:37:56.259801 1 config.go:315] Starting service config controller
I0803 23:37:56.259962 1 shared_informer.go:240] Waiting for caches to sync for service config
I0803 23:37:56.259994 1 config.go:224] Starting endpoint slice config controller
I0803 23:37:56.259998 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0803 23:37:56.360088 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0803 23:37:56.360151 1 shared_informer.go:247] Caches are synced for service config
==> kube-proxy [aceae907dc5dd357ef34d25fba3386bee6214298dda34f31bb744dd99aaf02c5] <==
I0803 23:39:44.318647 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0803 23:39:44.319004 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0803 23:39:44.417459 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0803 23:39:44.417835 1 server_others.go:185] Using iptables Proxier.
I0803 23:39:44.418477 1 server.go:650] Version: v1.20.0
I0803 23:39:44.419274 1 config.go:315] Starting service config controller
I0803 23:39:44.419435 1 shared_informer.go:240] Waiting for caches to sync for service config
I0803 23:39:44.419535 1 config.go:224] Starting endpoint slice config controller
I0803 23:39:44.419617 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0803 23:39:44.520087 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0803 23:39:44.520315 1 shared_informer.go:247] Caches are synced for service config
==> kube-scheduler [1cf5b72b69cb46a2f0ebd44d87f295610e0a42f9bfb29e2fb3e863c1645de1b9] <==
I0803 23:37:29.067175 1 serving.go:331] Generated self-signed cert in-memory
W0803 23:37:34.662180 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0803 23:37:34.662212 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0803 23:37:34.662221 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0803 23:37:34.662227 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0803 23:37:34.748097 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0803 23:37:34.750847 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0803 23:37:34.750872 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0803 23:37:34.750889 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0803 23:37:34.797005 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0803 23:37:34.797340 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0803 23:37:34.797712 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0803 23:37:34.798485 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0803 23:37:34.800735 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0803 23:37:34.801016 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0803 23:37:34.801226 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0803 23:37:34.801458 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0803 23:37:34.801813 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0803 23:37:34.802789 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0803 23:37:34.802989 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0803 23:37:34.803086 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0803 23:37:35.746888 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0803 23:37:35.932978 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
I0803 23:37:38.350967 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [9bf21e77a35b82c0eff0d1588e963d3c44c43c2c26455b9d13e89d93c07f4a7a] <==
I0803 23:39:32.931823 1 serving.go:331] Generated self-signed cert in-memory
W0803 23:39:40.431552 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0803 23:39:40.431587 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0803 23:39:40.431595 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0803 23:39:40.431602 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0803 23:39:40.650656 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0803 23:39:40.650741 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0803 23:39:40.650747 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0803 23:39:40.650770 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0803 23:39:40.956938 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Aug 03 23:43:58 old-k8s-version-820414 kubelet[663]: E0803 23:43:58.444353 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 03 23:44:08 old-k8s-version-820414 kubelet[663]: I0803 23:44:08.443737 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: e9f478937b2bff489b7ea0b9e7c88f8afe428985a501ab678646efdde70637b1
Aug 03 23:44:08 old-k8s-version-820414 kubelet[663]: E0803 23:44:08.444136 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
Aug 03 23:44:12 old-k8s-version-820414 kubelet[663]: E0803 23:44:12.444406 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 03 23:44:22 old-k8s-version-820414 kubelet[663]: I0803 23:44:22.443674 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: e9f478937b2bff489b7ea0b9e7c88f8afe428985a501ab678646efdde70637b1
Aug 03 23:44:22 old-k8s-version-820414 kubelet[663]: E0803 23:44:22.444030 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
Aug 03 23:44:23 old-k8s-version-820414 kubelet[663]: E0803 23:44:23.449169 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 03 23:44:35 old-k8s-version-820414 kubelet[663]: E0803 23:44:35.445923 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 03 23:44:37 old-k8s-version-820414 kubelet[663]: I0803 23:44:37.443821 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: e9f478937b2bff489b7ea0b9e7c88f8afe428985a501ab678646efdde70637b1
Aug 03 23:44:37 old-k8s-version-820414 kubelet[663]: E0803 23:44:37.444223 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
Aug 03 23:44:50 old-k8s-version-820414 kubelet[663]: I0803 23:44:50.443836 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: e9f478937b2bff489b7ea0b9e7c88f8afe428985a501ab678646efdde70637b1
Aug 03 23:44:50 old-k8s-version-820414 kubelet[663]: E0803 23:44:50.444155 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
Aug 03 23:44:50 old-k8s-version-820414 kubelet[663]: E0803 23:44:50.445023 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 03 23:45:02 old-k8s-version-820414 kubelet[663]: E0803 23:45:02.444334 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 03 23:45:04 old-k8s-version-820414 kubelet[663]: I0803 23:45:04.443724 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: e9f478937b2bff489b7ea0b9e7c88f8afe428985a501ab678646efdde70637b1
Aug 03 23:45:04 old-k8s-version-820414 kubelet[663]: E0803 23:45:04.444530 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
Aug 03 23:45:15 old-k8s-version-820414 kubelet[663]: E0803 23:45:15.444459 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 03 23:45:17 old-k8s-version-820414 kubelet[663]: I0803 23:45:17.443748 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: e9f478937b2bff489b7ea0b9e7c88f8afe428985a501ab678646efdde70637b1
Aug 03 23:45:17 old-k8s-version-820414 kubelet[663]: E0803 23:45:17.444534 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
Aug 03 23:45:27 old-k8s-version-820414 kubelet[663]: E0803 23:45:27.461148 663 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Aug 03 23:45:27 old-k8s-version-820414 kubelet[663]: E0803 23:45:27.461239 663 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Aug 03 23:45:27 old-k8s-version-820414 kubelet[663]: E0803 23:45:27.461739 663 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-nxdwh,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-wm57q_kube-system(fb610ad
c-a764-488d-83dd-61cc38a45f5f): ErrImagePull: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Aug 03 23:45:27 old-k8s-version-820414 kubelet[663]: E0803 23:45:27.461785 663 pod_workers.go:191] Error syncing pod fb610adc-a764-488d-83dd-61cc38a45f5f ("metrics-server-9975d5f86-wm57q_kube-system(fb610adc-a764-488d-83dd-61cc38a45f5f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Aug 03 23:45:30 old-k8s-version-820414 kubelet[663]: I0803 23:45:30.443733 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: e9f478937b2bff489b7ea0b9e7c88f8afe428985a501ab678646efdde70637b1
Aug 03 23:45:30 old-k8s-version-820414 kubelet[663]: E0803 23:45:30.444218 663 pod_workers.go:191] Error syncing pod ffd039c1-683a-48d6-aaaa-75fd4714221a ("dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-lfzsx_kubernetes-dashboard(ffd039c1-683a-48d6-aaaa-75fd4714221a)"
==> kubernetes-dashboard [32cdc2b56b59662ee956a5208730f2f361969d0adbd1439929e7e6c099a03838] <==
2024/08/03 23:40:05 Using namespace: kubernetes-dashboard
2024/08/03 23:40:05 Using in-cluster config to connect to apiserver
2024/08/03 23:40:05 Using secret token for csrf signing
2024/08/03 23:40:05 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/08/03 23:40:05 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/08/03 23:40:05 Successful initial request to the apiserver, version: v1.20.0
2024/08/03 23:40:05 Generating JWE encryption key
2024/08/03 23:40:05 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/08/03 23:40:05 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/08/03 23:40:06 Initializing JWE encryption key from synchronized object
2024/08/03 23:40:06 Creating in-cluster Sidecar client
2024/08/03 23:40:06 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/03 23:40:06 Serving insecurely on HTTP port: 9090
2024/08/03 23:40:36 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/03 23:41:06 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/03 23:41:36 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/03 23:42:06 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/03 23:42:36 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/03 23:43:06 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/03 23:43:36 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/03 23:44:06 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/03 23:44:36 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/03 23:45:06 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/03 23:40:05 Starting overwatch
==> storage-provisioner [9d49e481b2b6243d5e9de51f4fcc1d6d8cb677348b5fd9254200807f07c7297e] <==
I0803 23:39:44.104715 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0803 23:40:14.107752 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
==> storage-provisioner [fe656919428c126fa2c0d30d5ab782825c967bc723dfa769843ecf5bba788898] <==
I0803 23:40:26.665766 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0803 23:40:26.714249 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0803 23:40:26.714642 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0803 23:40:44.207107 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0803 23:40:44.207339 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-820414_3839ae29-6bce-49ce-8c93-a7cb3047f730!
I0803 23:40:44.208589 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"b1e39756-28e4-4d4b-8c03-26743d31ea97", APIVersion:"v1", ResourceVersion:"814", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-820414_3839ae29-6bce-49ce-8c93-a7cb3047f730 became leader
I0803 23:40:44.308151 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-820414_3839ae29-6bce-49ce-8c93-a7cb3047f730!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-820414 -n old-k8s-version-820414
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-820414 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-wm57q
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-820414 describe pod metrics-server-9975d5f86-wm57q
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-820414 describe pod metrics-server-9975d5f86-wm57q: exit status 1 (246.099647ms)
** stderr **
E0803 23:45:33.585545 1402396 memcache.go:287] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E0803 23:45:33.606309 1402396 memcache.go:121] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E0803 23:45:33.610960 1402396 memcache.go:121] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E0803 23:45:33.613223 1402396 memcache.go:121] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E0803 23:45:33.626991 1402396 memcache.go:121] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E0803 23:45:33.629984 1402396 memcache.go:121] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
Error from server (NotFound): pods "metrics-server-9975d5f86-wm57q" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-820414 describe pod metrics-server-9975d5f86-wm57q: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (379.53s)