=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-777320 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
E0831 23:11:40.634260 1166785 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/18943-1161402/.minikube/profiles/functional-059694/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-777320 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m9.254422485s)
-- stdout --
* [old-k8s-version-777320] minikube v1.33.1 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=18943
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18943-1161402/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18943-1161402/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.31.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.0
* Using the docker driver based on existing profile
* Starting "old-k8s-version-777320" primary control-plane node in "old-k8s-version-777320" cluster
* Pulling base image v0.0.44-1724862063-19530 ...
* Restarting existing docker container for "old-k8s-version-777320" ...
* Preparing Kubernetes v1.20.0 on containerd 1.7.21 ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-777320 addons enable metrics-server
* Enabled addons: storage-provisioner, default-storageclass, dashboard, metrics-server
-- /stdout --
** stderr **
I0831 23:11:30.706743 1378731 out.go:345] Setting OutFile to fd 1 ...
I0831 23:11:30.706963 1378731 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0831 23:11:30.706990 1378731 out.go:358] Setting ErrFile to fd 2...
I0831 23:11:30.707010 1378731 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0831 23:11:30.707299 1378731 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18943-1161402/.minikube/bin
I0831 23:11:30.707734 1378731 out.go:352] Setting JSON to false
I0831 23:11:30.709132 1378731 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":24840,"bootTime":1725121051,"procs":193,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1068-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0831 23:11:30.709398 1378731 start.go:139] virtualization:
I0831 23:11:30.715577 1378731 out.go:177] * [old-k8s-version-777320] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0831 23:11:30.718070 1378731 out.go:177] - MINIKUBE_LOCATION=18943
I0831 23:11:30.718140 1378731 notify.go:220] Checking for updates...
I0831 23:11:30.722003 1378731 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0831 23:11:30.724451 1378731 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18943-1161402/kubeconfig
I0831 23:11:30.726403 1378731 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18943-1161402/.minikube
I0831 23:11:30.728429 1378731 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0831 23:11:30.730457 1378731 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0831 23:11:30.732992 1378731 config.go:182] Loaded profile config "old-k8s-version-777320": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0831 23:11:30.735575 1378731 out.go:177] * Kubernetes 1.31.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.0
I0831 23:11:30.737259 1378731 driver.go:392] Setting default libvirt URI to qemu:///system
I0831 23:11:30.769713 1378731 docker.go:123] docker version: linux-27.2.0:Docker Engine - Community
I0831 23:11:30.769834 1378731 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0831 23:11:30.858270 1378731 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:68 SystemTime:2024-08-31 23:11:30.846235607 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1068-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0831 23:11:30.858381 1378731 docker.go:307] overlay module found
I0831 23:11:30.861100 1378731 out.go:177] * Using the docker driver based on existing profile
I0831 23:11:30.862835 1378731 start.go:297] selected driver: docker
I0831 23:11:30.862849 1378731 start.go:901] validating driver "docker" against &{Name:old-k8s-version-777320 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-777320 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0831 23:11:30.862960 1378731 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0831 23:11:30.863566 1378731 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0831 23:11:30.953619 1378731 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:68 SystemTime:2024-08-31 23:11:30.943670081 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1068-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0831 23:11:30.953958 1378731 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0831 23:11:30.953989 1378731 cni.go:84] Creating CNI manager for ""
I0831 23:11:30.954002 1378731 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0831 23:11:30.954039 1378731 start.go:340] cluster config:
{Name:old-k8s-version-777320 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-777320 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0831 23:11:30.957787 1378731 out.go:177] * Starting "old-k8s-version-777320" primary control-plane node in "old-k8s-version-777320" cluster
I0831 23:11:30.959753 1378731 cache.go:121] Beginning downloading kic base image for docker with containerd
I0831 23:11:30.961447 1378731 out.go:177] * Pulling base image v0.0.44-1724862063-19530 ...
I0831 23:11:30.962980 1378731 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0831 23:11:30.963043 1378731 preload.go:146] Found local preload: /home/jenkins/minikube-integration/18943-1161402/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0831 23:11:30.963050 1378731 cache.go:56] Caching tarball of preloaded images
I0831 23:11:30.963128 1378731 preload.go:172] Found /home/jenkins/minikube-integration/18943-1161402/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0831 23:11:30.963137 1378731 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0831 23:11:30.963251 1378731 profile.go:143] Saving config to /home/jenkins/minikube-integration/18943-1161402/.minikube/profiles/old-k8s-version-777320/config.json ...
I0831 23:11:30.963465 1378731 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 in local docker daemon
W0831 23:11:30.989076 1378731 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 is of wrong architecture
I0831 23:11:30.989092 1378731 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 to local cache
I0831 23:11:30.989161 1378731 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 in local cache directory
I0831 23:11:30.989178 1378731 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 in local cache directory, skipping pull
I0831 23:11:30.989182 1378731 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 exists in cache, skipping pull
I0831 23:11:30.989189 1378731 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 as a tarball
I0831 23:11:30.989195 1378731 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 from local cache
I0831 23:11:31.139693 1378731 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 from cached tarball
I0831 23:11:31.139733 1378731 cache.go:194] Successfully downloaded all kic artifacts
I0831 23:11:31.139777 1378731 start.go:360] acquireMachinesLock for old-k8s-version-777320: {Name:mk54b97042efa3274c921174b5e60d0f3ab02127 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0831 23:11:31.139853 1378731 start.go:364] duration metric: took 51.922µs to acquireMachinesLock for "old-k8s-version-777320"
I0831 23:11:31.139878 1378731 start.go:96] Skipping create...Using existing machine configuration
I0831 23:11:31.139885 1378731 fix.go:54] fixHost starting:
I0831 23:11:31.140170 1378731 cli_runner.go:164] Run: docker container inspect old-k8s-version-777320 --format={{.State.Status}}
I0831 23:11:31.162220 1378731 fix.go:112] recreateIfNeeded on old-k8s-version-777320: state=Stopped err=<nil>
W0831 23:11:31.162256 1378731 fix.go:138] unexpected machine state, will restart: <nil>
I0831 23:11:31.166433 1378731 out.go:177] * Restarting existing docker container for "old-k8s-version-777320" ...
I0831 23:11:31.168284 1378731 cli_runner.go:164] Run: docker start old-k8s-version-777320
I0831 23:11:31.558567 1378731 cli_runner.go:164] Run: docker container inspect old-k8s-version-777320 --format={{.State.Status}}
I0831 23:11:31.586417 1378731 kic.go:435] container "old-k8s-version-777320" state is running.
I0831 23:11:31.586802 1378731 cli_runner.go:164] Run: docker container inspect -f "{{with (index .NetworkSettings.Networks "old-k8s-version-777320")}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-777320
I0831 23:11:31.612062 1378731 profile.go:143] Saving config to /home/jenkins/minikube-integration/18943-1161402/.minikube/profiles/old-k8s-version-777320/config.json ...
I0831 23:11:31.612291 1378731 machine.go:93] provisionDockerMachine start ...
I0831 23:11:31.612367 1378731 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-777320
I0831 23:11:31.649638 1378731 main.go:141] libmachine: Using SSH client type: native
I0831 23:11:31.649905 1378731 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 34569 <nil> <nil>}
I0831 23:11:31.649921 1378731 main.go:141] libmachine: About to run SSH command:
hostname
I0831 23:11:31.650786 1378731 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0831 23:11:34.804569 1378731 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-777320
I0831 23:11:34.804600 1378731 ubuntu.go:169] provisioning hostname "old-k8s-version-777320"
I0831 23:11:34.804704 1378731 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-777320
I0831 23:11:34.837403 1378731 main.go:141] libmachine: Using SSH client type: native
I0831 23:11:34.837698 1378731 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 34569 <nil> <nil>}
I0831 23:11:34.837709 1378731 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-777320 && echo "old-k8s-version-777320" | sudo tee /etc/hostname
I0831 23:11:34.997894 1378731 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-777320
I0831 23:11:34.997977 1378731 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-777320
I0831 23:11:35.026247 1378731 main.go:141] libmachine: Using SSH client type: native
I0831 23:11:35.026523 1378731 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 34569 <nil> <nil>}
I0831 23:11:35.026540 1378731 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-777320' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-777320/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-777320' | sudo tee -a /etc/hosts;
fi
fi
I0831 23:11:35.169649 1378731 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0831 23:11:35.169680 1378731 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18943-1161402/.minikube CaCertPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18943-1161402/.minikube}
I0831 23:11:35.169702 1378731 ubuntu.go:177] setting up certificates
I0831 23:11:35.169711 1378731 provision.go:84] configureAuth start
I0831 23:11:35.169798 1378731 cli_runner.go:164] Run: docker container inspect -f "{{with (index .NetworkSettings.Networks "old-k8s-version-777320")}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-777320
I0831 23:11:35.198374 1378731 provision.go:143] copyHostCerts
I0831 23:11:35.198447 1378731 exec_runner.go:144] found /home/jenkins/minikube-integration/18943-1161402/.minikube/ca.pem, removing ...
I0831 23:11:35.198461 1378731 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18943-1161402/.minikube/ca.pem
I0831 23:11:35.198542 1378731 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18943-1161402/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18943-1161402/.minikube/ca.pem (1078 bytes)
I0831 23:11:35.198657 1378731 exec_runner.go:144] found /home/jenkins/minikube-integration/18943-1161402/.minikube/cert.pem, removing ...
I0831 23:11:35.198669 1378731 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18943-1161402/.minikube/cert.pem
I0831 23:11:35.198698 1378731 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18943-1161402/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18943-1161402/.minikube/cert.pem (1123 bytes)
I0831 23:11:35.198767 1378731 exec_runner.go:144] found /home/jenkins/minikube-integration/18943-1161402/.minikube/key.pem, removing ...
I0831 23:11:35.198778 1378731 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18943-1161402/.minikube/key.pem
I0831 23:11:35.198802 1378731 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18943-1161402/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18943-1161402/.minikube/key.pem (1679 bytes)
I0831 23:11:35.198866 1378731 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18943-1161402/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18943-1161402/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18943-1161402/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-777320 san=[127.0.0.1 192.168.85.2 localhost minikube old-k8s-version-777320]
I0831 23:11:35.425568 1378731 provision.go:177] copyRemoteCerts
I0831 23:11:35.425653 1378731 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0831 23:11:35.425698 1378731 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-777320
I0831 23:11:35.444738 1378731 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34569 SSHKeyPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/machines/old-k8s-version-777320/id_rsa Username:docker}
I0831 23:11:35.542737 1378731 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18943-1161402/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0831 23:11:35.571831 1378731 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18943-1161402/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0831 23:11:35.598406 1378731 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18943-1161402/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0831 23:11:35.624253 1378731 provision.go:87] duration metric: took 454.528814ms to configureAuth
I0831 23:11:35.624276 1378731 ubuntu.go:193] setting minikube options for container-runtime
I0831 23:11:35.624479 1378731 config.go:182] Loaded profile config "old-k8s-version-777320": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0831 23:11:35.624486 1378731 machine.go:96] duration metric: took 4.01218069s to provisionDockerMachine
I0831 23:11:35.624494 1378731 start.go:293] postStartSetup for "old-k8s-version-777320" (driver="docker")
I0831 23:11:35.624504 1378731 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0831 23:11:35.624553 1378731 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0831 23:11:35.624597 1378731 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-777320
I0831 23:11:35.648926 1378731 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34569 SSHKeyPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/machines/old-k8s-version-777320/id_rsa Username:docker}
I0831 23:11:35.746752 1378731 ssh_runner.go:195] Run: cat /etc/os-release
I0831 23:11:35.750657 1378731 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0831 23:11:35.750690 1378731 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0831 23:11:35.750700 1378731 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0831 23:11:35.750707 1378731 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0831 23:11:35.750718 1378731 filesync.go:126] Scanning /home/jenkins/minikube-integration/18943-1161402/.minikube/addons for local assets ...
I0831 23:11:35.750769 1378731 filesync.go:126] Scanning /home/jenkins/minikube-integration/18943-1161402/.minikube/files for local assets ...
I0831 23:11:35.750854 1378731 filesync.go:149] local asset: /home/jenkins/minikube-integration/18943-1161402/.minikube/files/etc/ssl/certs/11667852.pem -> 11667852.pem in /etc/ssl/certs
I0831 23:11:35.750963 1378731 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0831 23:11:35.760738 1378731 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18943-1161402/.minikube/files/etc/ssl/certs/11667852.pem --> /etc/ssl/certs/11667852.pem (1708 bytes)
I0831 23:11:35.793051 1378731 start.go:296] duration metric: took 168.540345ms for postStartSetup
I0831 23:11:35.793215 1378731 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0831 23:11:35.793303 1378731 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-777320
I0831 23:11:35.811349 1378731 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34569 SSHKeyPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/machines/old-k8s-version-777320/id_rsa Username:docker}
I0831 23:11:35.906901 1378731 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0831 23:11:35.912796 1378731 fix.go:56] duration metric: took 4.772903089s for fixHost
I0831 23:11:35.912821 1378731 start.go:83] releasing machines lock for "old-k8s-version-777320", held for 4.772956306s
I0831 23:11:35.912907 1378731 cli_runner.go:164] Run: docker container inspect -f "{{with (index .NetworkSettings.Networks "old-k8s-version-777320")}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-777320
I0831 23:11:35.938343 1378731 ssh_runner.go:195] Run: cat /version.json
I0831 23:11:35.938409 1378731 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-777320
I0831 23:11:35.938733 1378731 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0831 23:11:35.938790 1378731 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-777320
I0831 23:11:35.982756 1378731 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34569 SSHKeyPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/machines/old-k8s-version-777320/id_rsa Username:docker}
I0831 23:11:35.988142 1378731 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34569 SSHKeyPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/machines/old-k8s-version-777320/id_rsa Username:docker}
I0831 23:11:36.226444 1378731 ssh_runner.go:195] Run: systemctl --version
I0831 23:11:36.231055 1378731 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0831 23:11:36.235674 1378731 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0831 23:11:36.259871 1378731 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0831 23:11:36.259950 1378731 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0831 23:11:36.269154 1378731 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0831 23:11:36.269179 1378731 start.go:495] detecting cgroup driver to use...
I0831 23:11:36.269211 1378731 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0831 23:11:36.269257 1378731 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0831 23:11:36.292555 1378731 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0831 23:11:36.305250 1378731 docker.go:217] disabling cri-docker service (if available) ...
I0831 23:11:36.305329 1378731 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0831 23:11:36.319244 1378731 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0831 23:11:36.331943 1378731 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0831 23:11:36.445947 1378731 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0831 23:11:36.557725 1378731 docker.go:233] disabling docker service ...
I0831 23:11:36.557793 1378731 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0831 23:11:36.572151 1378731 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0831 23:11:36.584464 1378731 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0831 23:11:36.695409 1378731 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0831 23:11:36.804690 1378731 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0831 23:11:36.818299 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0831 23:11:36.839209 1378731 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0831 23:11:36.850012 1378731 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0831 23:11:36.860212 1378731 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0831 23:11:36.860356 1378731 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0831 23:11:36.871528 1378731 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0831 23:11:36.881865 1378731 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0831 23:11:36.894304 1378731 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0831 23:11:36.907561 1378731 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0831 23:11:36.917315 1378731 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0831 23:11:36.928349 1378731 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0831 23:11:36.938070 1378731 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0831 23:11:36.947174 1378731 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0831 23:11:37.088412 1378731 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0831 23:11:37.260269 1378731 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0831 23:11:37.260400 1378731 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0831 23:11:37.264228 1378731 start.go:563] Will wait 60s for crictl version
I0831 23:11:37.264347 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:11:37.267832 1378731 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0831 23:11:37.303429 1378731 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.21
RuntimeApiVersion: v1
I0831 23:11:37.303562 1378731 ssh_runner.go:195] Run: containerd --version
I0831 23:11:37.327983 1378731 ssh_runner.go:195] Run: containerd --version
I0831 23:11:37.354345 1378731 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.7.21 ...
I0831 23:11:37.356454 1378731 cli_runner.go:164] Run: docker network inspect old-k8s-version-777320 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0831 23:11:37.372147 1378731 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0831 23:11:37.375718 1378731 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0831 23:11:37.386620 1378731 kubeadm.go:883] updating cluster {Name:old-k8s-version-777320 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-777320 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0831 23:11:37.386745 1378731 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0831 23:11:37.386814 1378731 ssh_runner.go:195] Run: sudo crictl images --output json
I0831 23:11:37.423104 1378731 containerd.go:627] all images are preloaded for containerd runtime.
I0831 23:11:37.423128 1378731 containerd.go:534] Images already preloaded, skipping extraction
I0831 23:11:37.423187 1378731 ssh_runner.go:195] Run: sudo crictl images --output json
I0831 23:11:37.461017 1378731 containerd.go:627] all images are preloaded for containerd runtime.
I0831 23:11:37.461044 1378731 cache_images.go:84] Images are preloaded, skipping loading
I0831 23:11:37.461053 1378731 kubeadm.go:934] updating node { 192.168.85.2 8443 v1.20.0 containerd true true} ...
I0831 23:11:37.461181 1378731 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-777320 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-777320 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0831 23:11:37.461254 1378731 ssh_runner.go:195] Run: sudo crictl info
I0831 23:11:37.509356 1378731 cni.go:84] Creating CNI manager for ""
I0831 23:11:37.509429 1378731 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0831 23:11:37.509456 1378731 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0831 23:11:37.509510 1378731 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-777320 NodeName:old-k8s-version-777320 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0831 23:11:37.509700 1378731 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-777320"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0831 23:11:37.509798 1378731 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0831 23:11:37.521340 1378731 binaries.go:44] Found k8s binaries, skipping transfer
I0831 23:11:37.521422 1378731 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0831 23:11:37.536165 1378731 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0831 23:11:37.561387 1378731 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0831 23:11:37.592943 1378731 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0831 23:11:37.615248 1378731 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0831 23:11:37.618658 1378731 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0831 23:11:37.633118 1378731 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0831 23:11:37.750392 1378731 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0831 23:11:37.769825 1378731 certs.go:68] Setting up /home/jenkins/minikube-integration/18943-1161402/.minikube/profiles/old-k8s-version-777320 for IP: 192.168.85.2
I0831 23:11:37.769898 1378731 certs.go:194] generating shared ca certs ...
I0831 23:11:37.769928 1378731 certs.go:226] acquiring lock for ca certs: {Name:mk34cb0d7c9ce07dfc3fb4f77a59e5e1d853f8c8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0831 23:11:37.770086 1378731 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18943-1161402/.minikube/ca.key
I0831 23:11:37.770166 1378731 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18943-1161402/.minikube/proxy-client-ca.key
I0831 23:11:37.770200 1378731 certs.go:256] generating profile certs ...
I0831 23:11:37.770327 1378731 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18943-1161402/.minikube/profiles/old-k8s-version-777320/client.key
I0831 23:11:37.770434 1378731 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/18943-1161402/.minikube/profiles/old-k8s-version-777320/apiserver.key.ee02ddc2
I0831 23:11:37.770516 1378731 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18943-1161402/.minikube/profiles/old-k8s-version-777320/proxy-client.key
I0831 23:11:37.770664 1378731 certs.go:484] found cert: /home/jenkins/minikube-integration/18943-1161402/.minikube/certs/1166785.pem (1338 bytes)
W0831 23:11:37.770719 1378731 certs.go:480] ignoring /home/jenkins/minikube-integration/18943-1161402/.minikube/certs/1166785_empty.pem, impossibly tiny 0 bytes
I0831 23:11:37.770743 1378731 certs.go:484] found cert: /home/jenkins/minikube-integration/18943-1161402/.minikube/certs/ca-key.pem (1679 bytes)
I0831 23:11:37.770803 1378731 certs.go:484] found cert: /home/jenkins/minikube-integration/18943-1161402/.minikube/certs/ca.pem (1078 bytes)
I0831 23:11:37.770856 1378731 certs.go:484] found cert: /home/jenkins/minikube-integration/18943-1161402/.minikube/certs/cert.pem (1123 bytes)
I0831 23:11:37.770914 1378731 certs.go:484] found cert: /home/jenkins/minikube-integration/18943-1161402/.minikube/certs/key.pem (1679 bytes)
I0831 23:11:37.770993 1378731 certs.go:484] found cert: /home/jenkins/minikube-integration/18943-1161402/.minikube/files/etc/ssl/certs/11667852.pem (1708 bytes)
I0831 23:11:37.771662 1378731 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18943-1161402/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0831 23:11:37.836153 1378731 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18943-1161402/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0831 23:11:37.900528 1378731 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18943-1161402/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0831 23:11:37.981886 1378731 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18943-1161402/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0831 23:11:38.041246 1378731 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18943-1161402/.minikube/profiles/old-k8s-version-777320/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0831 23:11:38.087543 1378731 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18943-1161402/.minikube/profiles/old-k8s-version-777320/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0831 23:11:38.116853 1378731 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18943-1161402/.minikube/profiles/old-k8s-version-777320/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0831 23:11:38.145800 1378731 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18943-1161402/.minikube/profiles/old-k8s-version-777320/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0831 23:11:38.181964 1378731 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18943-1161402/.minikube/files/etc/ssl/certs/11667852.pem --> /usr/share/ca-certificates/11667852.pem (1708 bytes)
I0831 23:11:38.222719 1378731 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18943-1161402/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0831 23:11:38.256341 1378731 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18943-1161402/.minikube/certs/1166785.pem --> /usr/share/ca-certificates/1166785.pem (1338 bytes)
I0831 23:11:38.294188 1378731 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0831 23:11:38.318885 1378731 ssh_runner.go:195] Run: openssl version
I0831 23:11:38.326215 1378731 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11667852.pem && ln -fs /usr/share/ca-certificates/11667852.pem /etc/ssl/certs/11667852.pem"
I0831 23:11:38.337706 1378731 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11667852.pem
I0831 23:11:38.343688 1378731 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 31 22:31 /usr/share/ca-certificates/11667852.pem
I0831 23:11:38.343768 1378731 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11667852.pem
I0831 23:11:38.353492 1378731 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/11667852.pem /etc/ssl/certs/3ec20f2e.0"
I0831 23:11:38.362607 1378731 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0831 23:11:38.375290 1378731 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0831 23:11:38.380224 1378731 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 31 22:21 /usr/share/ca-certificates/minikubeCA.pem
I0831 23:11:38.380311 1378731 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0831 23:11:38.391839 1378731 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0831 23:11:38.406268 1378731 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1166785.pem && ln -fs /usr/share/ca-certificates/1166785.pem /etc/ssl/certs/1166785.pem"
I0831 23:11:38.417605 1378731 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1166785.pem
I0831 23:11:38.422328 1378731 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 31 22:31 /usr/share/ca-certificates/1166785.pem
I0831 23:11:38.422413 1378731 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1166785.pem
I0831 23:11:38.431386 1378731 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1166785.pem /etc/ssl/certs/51391683.0"
I0831 23:11:38.445160 1378731 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0831 23:11:38.450441 1378731 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0831 23:11:38.459574 1378731 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0831 23:11:38.471636 1378731 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0831 23:11:38.479390 1378731 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0831 23:11:38.488046 1378731 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0831 23:11:38.496256 1378731 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0831 23:11:38.506248 1378731 kubeadm.go:392] StartCluster: {Name:old-k8s-version-777320 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-777320 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0831 23:11:38.506358 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0831 23:11:38.506433 1378731 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0831 23:11:38.586317 1378731 cri.go:89] found id: "26aa1d510c36cb526536c021669ae3f5436cdad4f0a6f9c30b4b361249af6077"
I0831 23:11:38.586359 1378731 cri.go:89] found id: "0ddaf9925b5b8a2498baf923aedda0b04394c82cc0c7c18555b7233ea40ba24c"
I0831 23:11:38.586364 1378731 cri.go:89] found id: "766da44566779be7d752b980921d12fc4264187a60dc3e7ee972e8abe6ba683f"
I0831 23:11:38.586367 1378731 cri.go:89] found id: "375dfe16bc1a3f88bb1adae552829f1de1f6ccd7a3b2bf3eb9e823c85daa3329"
I0831 23:11:38.586370 1378731 cri.go:89] found id: "36189b23eed4dd70cc8796dc64533ece0f97c8515188d9c4bb6817079cf848fa"
I0831 23:11:38.586375 1378731 cri.go:89] found id: "cb403497717362a835119a12fcd9a98f048e1513652343987c5706732ded954d"
I0831 23:11:38.586378 1378731 cri.go:89] found id: "4a53de8c7cfef15e1b4d2eb2d08e3992e87a5d45cb56ec1579cce90b650a86a3"
I0831 23:11:38.586384 1378731 cri.go:89] found id: "24d2daafe86a0dcb6af4171206676787738fec4b49e748c8e217d63f6af8bb12"
I0831 23:11:38.586387 1378731 cri.go:89] found id: ""
I0831 23:11:38.586455 1378731 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0831 23:11:38.610888 1378731 cri.go:116] JSON = null
W0831 23:11:38.610958 1378731 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0831 23:11:38.611044 1378731 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0831 23:11:38.633500 1378731 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0831 23:11:38.633533 1378731 kubeadm.go:593] restartPrimaryControlPlane start ...
I0831 23:11:38.633594 1378731 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0831 23:11:38.646138 1378731 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0831 23:11:38.646637 1378731 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-777320" does not appear in /home/jenkins/minikube-integration/18943-1161402/kubeconfig
I0831 23:11:38.646770 1378731 kubeconfig.go:62] /home/jenkins/minikube-integration/18943-1161402/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-777320" cluster setting kubeconfig missing "old-k8s-version-777320" context setting]
I0831 23:11:38.647111 1378731 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18943-1161402/kubeconfig: {Name:mkb68eea79d6c84410a77cb04886486384945560 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0831 23:11:38.648836 1378731 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0831 23:11:38.662905 1378731 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.85.2
I0831 23:11:38.662942 1378731 kubeadm.go:597] duration metric: took 29.396367ms to restartPrimaryControlPlane
I0831 23:11:38.662953 1378731 kubeadm.go:394] duration metric: took 156.732898ms to StartCluster
I0831 23:11:38.662972 1378731 settings.go:142] acquiring lock: {Name:mkccd5b6f7cf87789c72627e47240ed1100ed135 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0831 23:11:38.663034 1378731 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/18943-1161402/kubeconfig
I0831 23:11:38.663646 1378731 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18943-1161402/kubeconfig: {Name:mkb68eea79d6c84410a77cb04886486384945560 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0831 23:11:38.663849 1378731 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0831 23:11:38.664229 1378731 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0831 23:11:38.664308 1378731 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-777320"
I0831 23:11:38.664353 1378731 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-777320"
W0831 23:11:38.664365 1378731 addons.go:243] addon storage-provisioner should already be in state true
I0831 23:11:38.664388 1378731 host.go:66] Checking if "old-k8s-version-777320" exists ...
I0831 23:11:38.664869 1378731 cli_runner.go:164] Run: docker container inspect old-k8s-version-777320 --format={{.State.Status}}
I0831 23:11:38.665243 1378731 config.go:182] Loaded profile config "old-k8s-version-777320": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0831 23:11:38.665313 1378731 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-777320"
I0831 23:11:38.665354 1378731 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-777320"
I0831 23:11:38.665617 1378731 cli_runner.go:164] Run: docker container inspect old-k8s-version-777320 --format={{.State.Status}}
I0831 23:11:38.668756 1378731 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-777320"
I0831 23:11:38.668844 1378731 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-777320"
W0831 23:11:38.668867 1378731 addons.go:243] addon metrics-server should already be in state true
I0831 23:11:38.668929 1378731 host.go:66] Checking if "old-k8s-version-777320" exists ...
I0831 23:11:38.669112 1378731 addons.go:69] Setting dashboard=true in profile "old-k8s-version-777320"
I0831 23:11:38.669150 1378731 addons.go:234] Setting addon dashboard=true in "old-k8s-version-777320"
W0831 23:11:38.669253 1378731 addons.go:243] addon dashboard should already be in state true
I0831 23:11:38.669287 1378731 host.go:66] Checking if "old-k8s-version-777320" exists ...
I0831 23:11:38.669438 1378731 out.go:177] * Verifying Kubernetes components...
I0831 23:11:38.669553 1378731 cli_runner.go:164] Run: docker container inspect old-k8s-version-777320 --format={{.State.Status}}
I0831 23:11:38.673787 1378731 cli_runner.go:164] Run: docker container inspect old-k8s-version-777320 --format={{.State.Status}}
I0831 23:11:38.675406 1378731 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0831 23:11:38.715995 1378731 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-777320"
W0831 23:11:38.716019 1378731 addons.go:243] addon default-storageclass should already be in state true
I0831 23:11:38.716045 1378731 host.go:66] Checking if "old-k8s-version-777320" exists ...
I0831 23:11:38.716464 1378731 cli_runner.go:164] Run: docker container inspect old-k8s-version-777320 --format={{.State.Status}}
I0831 23:11:38.737855 1378731 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0831 23:11:38.740793 1378731 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0831 23:11:38.740817 1378731 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0831 23:11:38.740882 1378731 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-777320
I0831 23:11:38.771363 1378731 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0831 23:11:38.776675 1378731 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0831 23:11:38.776818 1378731 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0831 23:11:38.776833 1378731 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0831 23:11:38.776902 1378731 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-777320
I0831 23:11:38.784671 1378731 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0831 23:11:38.784869 1378731 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0831 23:11:38.784882 1378731 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0831 23:11:38.784946 1378731 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-777320
I0831 23:11:38.788770 1378731 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0831 23:11:38.788794 1378731 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0831 23:11:38.788867 1378731 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-777320
I0831 23:11:38.800785 1378731 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34569 SSHKeyPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/machines/old-k8s-version-777320/id_rsa Username:docker}
I0831 23:11:38.851667 1378731 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34569 SSHKeyPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/machines/old-k8s-version-777320/id_rsa Username:docker}
I0831 23:11:38.851757 1378731 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34569 SSHKeyPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/machines/old-k8s-version-777320/id_rsa Username:docker}
I0831 23:11:38.868871 1378731 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34569 SSHKeyPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/machines/old-k8s-version-777320/id_rsa Username:docker}
I0831 23:11:38.949339 1378731 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0831 23:11:39.007257 1378731 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-777320" to be "Ready" ...
I0831 23:11:39.051819 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0831 23:11:39.133112 1378731 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0831 23:11:39.133137 1378731 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0831 23:11:39.177172 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0831 23:11:39.210639 1378731 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0831 23:11:39.210668 1378731 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0831 23:11:39.226607 1378731 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0831 23:11:39.226634 1378731 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0831 23:11:39.275882 1378731 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0831 23:11:39.275908 1378731 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
W0831 23:11:39.344401 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:39.344449 1378731 retry.go:31] will retry after 322.961593ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:39.351106 1378731 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0831 23:11:39.351132 1378731 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0831 23:11:39.376531 1378731 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0831 23:11:39.376561 1378731 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0831 23:11:39.427816 1378731 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0831 23:11:39.427848 1378731 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0831 23:11:39.439852 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0831 23:11:39.498149 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:39.498183 1378731 retry.go:31] will retry after 152.557067ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:39.513068 1378731 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0831 23:11:39.513147 1378731 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0831 23:11:39.577235 1378731 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0831 23:11:39.577315 1378731 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
W0831 23:11:39.638102 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:39.638181 1378731 retry.go:31] will retry after 186.307876ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:39.650717 1378731 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0831 23:11:39.650881 1378731 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0831 23:11:39.650966 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0831 23:11:39.668283 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0831 23:11:39.692567 1378731 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0831 23:11:39.692675 1378731 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0831 23:11:39.785685 1378731 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0831 23:11:39.785758 1378731 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0831 23:11:39.824979 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0831 23:11:39.879579 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0831 23:11:39.989193 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:39.989227 1378731 retry.go:31] will retry after 312.731886ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0831 23:11:40.022201 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:40.022238 1378731 retry.go:31] will retry after 332.965344ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0831 23:11:40.143983 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:40.144019 1378731 retry.go:31] will retry after 294.435757ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0831 23:11:40.145098 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:40.145123 1378731 retry.go:31] will retry after 318.056978ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:40.302498 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0831 23:11:40.355869 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0831 23:11:40.439229 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0831 23:11:40.463628 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0831 23:11:40.541909 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:40.541944 1378731 retry.go:31] will retry after 424.678116ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0831 23:11:40.695200 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:40.695235 1378731 retry.go:31] will retry after 478.420841ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0831 23:11:40.695287 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:40.695299 1378731 retry.go:31] will retry after 449.135693ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0831 23:11:40.762382 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:40.762416 1378731 retry.go:31] will retry after 244.069745ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:40.966780 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0831 23:11:41.007068 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0831 23:11:41.008709 1378731 node_ready.go:53] error getting node "old-k8s-version-777320": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-777320": dial tcp 192.168.85.2:8443: connect: connection refused
I0831 23:11:41.145239 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0831 23:11:41.174639 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0831 23:11:41.186845 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:41.186883 1378731 retry.go:31] will retry after 1.229507317s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0831 23:11:41.235172 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:41.235205 1378731 retry.go:31] will retry after 768.939399ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0831 23:11:41.405216 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:41.405251 1378731 retry.go:31] will retry after 467.238443ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0831 23:11:41.421724 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:41.421759 1378731 retry.go:31] will retry after 942.875982ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:41.872742 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0831 23:11:41.999262 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:41.999296 1378731 retry.go:31] will retry after 1.212792863s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:42.004581 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0831 23:11:42.127681 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:42.127723 1378731 retry.go:31] will retry after 967.720059ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:42.365142 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0831 23:11:42.417455 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0831 23:11:42.552948 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:42.552989 1378731 retry.go:31] will retry after 1.873679093s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0831 23:11:42.584317 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:42.584350 1378731 retry.go:31] will retry after 1.46956855s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:43.095637 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0831 23:11:43.209851 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:43.209884 1378731 retry.go:31] will retry after 1.729502041s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:43.213150 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0831 23:11:43.339765 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:43.339794 1378731 retry.go:31] will retry after 2.738322629s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:43.508378 1378731 node_ready.go:53] error getting node "old-k8s-version-777320": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-777320": dial tcp 192.168.85.2:8443: connect: connection refused
I0831 23:11:44.054326 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0831 23:11:44.187593 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:44.187680 1378731 retry.go:31] will retry after 1.456310282s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:44.426892 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0831 23:11:44.526438 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:44.526524 1378731 retry.go:31] will retry after 1.620074156s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:44.939688 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0831 23:11:45.054824 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:45.054873 1378731 retry.go:31] will retry after 1.417825109s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:45.645038 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0831 23:11:45.737925 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:45.737961 1378731 retry.go:31] will retry after 2.32677157s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:46.016244 1378731 node_ready.go:53] error getting node "old-k8s-version-777320": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-777320": dial tcp 192.168.85.2:8443: connect: connection refused
I0831 23:11:46.078557 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0831 23:11:46.147036 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0831 23:11:46.180780 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:46.180814 1378731 retry.go:31] will retry after 1.539414359s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0831 23:11:46.244968 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:46.245001 1378731 retry.go:31] will retry after 2.277868708s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:46.473466 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0831 23:11:46.603822 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:46.603904 1378731 retry.go:31] will retry after 2.603018679s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0831 23:11:47.721370 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0831 23:11:48.065049 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0831 23:11:48.523996 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0831 23:11:49.207742 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0831 23:11:58.012308 1378731 node_ready.go:53] error getting node "old-k8s-version-777320": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-777320": net/http: TLS handshake timeout
I0831 23:11:58.101744 1378731 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (10.380335928s)
W0831 23:11:58.101797 1378731 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
I0831 23:11:58.101817 1378731 retry.go:31] will retry after 2.67664588s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
I0831 23:11:58.255715 1378731 node_ready.go:49] node "old-k8s-version-777320" has status "Ready":"True"
I0831 23:11:58.255748 1378731 node_ready.go:38] duration metric: took 19.248439892s for node "old-k8s-version-777320" to be "Ready" ...
I0831 23:11:58.255760 1378731 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0831 23:11:58.415519 1378731 pod_ready.go:79] waiting up to 6m0s for pod "coredns-74ff55c5b-9zjlw" in "kube-system" namespace to be "Ready" ...
I0831 23:11:58.454355 1378731 pod_ready.go:93] pod "coredns-74ff55c5b-9zjlw" in "kube-system" namespace has status "Ready":"True"
I0831 23:11:58.454427 1378731 pod_ready.go:82] duration metric: took 38.869997ms for pod "coredns-74ff55c5b-9zjlw" in "kube-system" namespace to be "Ready" ...
I0831 23:11:58.454453 1378731 pod_ready.go:79] waiting up to 6m0s for pod "etcd-old-k8s-version-777320" in "kube-system" namespace to be "Ready" ...
I0831 23:11:58.634689 1378731 pod_ready.go:93] pod "etcd-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"True"
I0831 23:11:58.634776 1378731 pod_ready.go:82] duration metric: took 180.301236ms for pod "etcd-old-k8s-version-777320" in "kube-system" namespace to be "Ready" ...
I0831 23:11:58.634823 1378731 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-777320" in "kube-system" namespace to be "Ready" ...
I0831 23:11:58.654225 1378731 pod_ready.go:93] pod "kube-apiserver-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"True"
I0831 23:11:58.654323 1378731 pod_ready.go:82] duration metric: took 19.451929ms for pod "kube-apiserver-old-k8s-version-777320" in "kube-system" namespace to be "Ready" ...
I0831 23:11:58.654366 1378731 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-777320" in "kube-system" namespace to be "Ready" ...
I0831 23:11:58.669157 1378731 pod_ready.go:93] pod "kube-controller-manager-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"True"
I0831 23:11:58.669177 1378731 pod_ready.go:82] duration metric: took 14.765064ms for pod "kube-controller-manager-old-k8s-version-777320" in "kube-system" namespace to be "Ready" ...
I0831 23:11:58.669188 1378731 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-wv4m2" in "kube-system" namespace to be "Ready" ...
I0831 23:11:58.684450 1378731 pod_ready.go:93] pod "kube-proxy-wv4m2" in "kube-system" namespace has status "Ready":"True"
I0831 23:11:58.684472 1378731 pod_ready.go:82] duration metric: took 15.275798ms for pod "kube-proxy-wv4m2" in "kube-system" namespace to be "Ready" ...
I0831 23:11:58.684483 1378731 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace to be "Ready" ...
I0831 23:11:59.815820 1378731 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (11.750731556s)
I0831 23:11:59.816023 1378731 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (11.291999097s)
I0831 23:12:00.174737 1378731 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (10.966862691s)
I0831 23:12:00.177439 1378731 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-777320 addons enable metrics-server
I0831 23:12:00.692371 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:00.779393 1378731 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0831 23:12:01.207928 1378731 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-777320"
I0831 23:12:01.209711 1378731 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, dashboard, metrics-server
I0831 23:12:01.211763 1378731 addons.go:510] duration metric: took 22.547528426s for enable addons: enabled=[storage-provisioner default-storageclass dashboard metrics-server]
I0831 23:12:03.190721 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:05.690463 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:07.692026 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:10.191037 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:12.191484 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:14.690025 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:16.690512 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:18.691292 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:21.193555 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:23.692583 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:25.693679 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:28.190891 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:30.191926 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:32.690502 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:35.190820 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:37.191863 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:39.691029 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:42.193412 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:44.694913 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:47.191173 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:49.695833 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:52.191824 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:54.691448 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:57.193952 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:12:59.694321 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:02.191299 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:04.691939 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:07.191322 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:09.193357 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:11.194224 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:13.691715 1378731 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:15.690548 1378731 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace has status "Ready":"True"
I0831 23:13:15.690572 1378731 pod_ready.go:82] duration metric: took 1m17.006081998s for pod "kube-scheduler-old-k8s-version-777320" in "kube-system" namespace to be "Ready" ...
I0831 23:13:15.690583 1378731 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace to be "Ready" ...
I0831 23:13:17.696613 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:19.697907 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:22.198364 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:24.696283 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:26.697096 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:28.697287 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:31.197273 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:33.197608 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:35.696960 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:37.697610 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:39.698516 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:41.701870 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:44.196741 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:46.695826 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:48.702143 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:51.197077 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:53.199769 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:55.696539 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:57.697083 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:13:59.697346 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:01.697834 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:03.698734 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:06.215182 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:08.696475 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:11.196506 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:13.198343 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:15.205635 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:17.697578 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:19.698115 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:22.197020 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:24.198318 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:26.696577 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:29.201121 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:31.203109 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:33.696847 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:35.697726 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:38.196231 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:40.196969 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:42.198287 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:44.709020 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:47.196611 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:49.197118 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:51.696326 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:54.196212 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:56.197892 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:14:58.696210 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:00.697616 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:03.196518 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:05.198404 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:07.696398 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:09.696846 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:11.697346 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:14.197747 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:16.696992 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:18.697969 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:21.196969 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:23.199049 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:25.697828 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:28.196668 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:30.197625 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:32.695961 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:34.696422 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:36.697773 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:39.196366 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:41.696800 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:44.197679 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:46.697301 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:48.697622 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:51.197240 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:53.198307 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:55.696882 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:57.697723 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:15:59.699213 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:02.197612 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:04.695940 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:06.697098 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:09.196553 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:11.196775 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:13.197295 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:15.197621 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:17.199013 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:19.696565 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:22.196858 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:24.197025 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:26.197316 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:28.697307 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:30.798722 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:33.199301 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:35.697709 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:38.196839 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:40.197305 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:42.206822 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:44.696384 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:46.696596 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:48.697473 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:51.196978 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:53.697754 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:56.196597 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:16:58.202125 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:17:00.277460 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:17:02.698322 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:17:05.197916 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:17:07.199172 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:17:09.696783 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:17:11.696974 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:17:13.697262 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:17:15.697766 1378731 pod_ready.go:103] pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace has status "Ready":"False"
I0831 23:17:15.697802 1378731 pod_ready.go:82] duration metric: took 4m0.007204981s for pod "metrics-server-9975d5f86-dl7gj" in "kube-system" namespace to be "Ready" ...
E0831 23:17:15.697813 1378731 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I0831 23:17:15.697821 1378731 pod_ready.go:39] duration metric: took 5m17.442049954s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0831 23:17:15.697835 1378731 api_server.go:52] waiting for apiserver process to appear ...
I0831 23:17:15.697872 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0831 23:17:15.697943 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0831 23:17:15.736011 1378731 cri.go:89] found id: "2b314ddb4c1637e9a96260a3016921d4c647744eac2a23a86ba97ac80539955e"
I0831 23:17:15.736035 1378731 cri.go:89] found id: "24d2daafe86a0dcb6af4171206676787738fec4b49e748c8e217d63f6af8bb12"
I0831 23:17:15.736041 1378731 cri.go:89] found id: ""
I0831 23:17:15.736048 1378731 logs.go:276] 2 containers: [2b314ddb4c1637e9a96260a3016921d4c647744eac2a23a86ba97ac80539955e 24d2daafe86a0dcb6af4171206676787738fec4b49e748c8e217d63f6af8bb12]
I0831 23:17:15.736105 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:15.739722 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:15.743067 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0831 23:17:15.743144 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0831 23:17:15.783638 1378731 cri.go:89] found id: "adc270d3e8398b7a86ff787dfd6fa155a7deeb47c29d94cf0371e7f3af2cf66a"
I0831 23:17:15.783667 1378731 cri.go:89] found id: "36189b23eed4dd70cc8796dc64533ece0f97c8515188d9c4bb6817079cf848fa"
I0831 23:17:15.783672 1378731 cri.go:89] found id: ""
I0831 23:17:15.783679 1378731 logs.go:276] 2 containers: [adc270d3e8398b7a86ff787dfd6fa155a7deeb47c29d94cf0371e7f3af2cf66a 36189b23eed4dd70cc8796dc64533ece0f97c8515188d9c4bb6817079cf848fa]
I0831 23:17:15.783736 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:15.787379 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:15.790990 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0831 23:17:15.791075 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0831 23:17:15.838120 1378731 cri.go:89] found id: "83c393cb9b979e9591d3e9004c20ad7a85c3cf5a2fb01002fa02cdd21598c0ee"
I0831 23:17:15.838145 1378731 cri.go:89] found id: "26aa1d510c36cb526536c021669ae3f5436cdad4f0a6f9c30b4b361249af6077"
I0831 23:17:15.838151 1378731 cri.go:89] found id: ""
I0831 23:17:15.838159 1378731 logs.go:276] 2 containers: [83c393cb9b979e9591d3e9004c20ad7a85c3cf5a2fb01002fa02cdd21598c0ee 26aa1d510c36cb526536c021669ae3f5436cdad4f0a6f9c30b4b361249af6077]
I0831 23:17:15.838218 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:15.842023 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:15.845511 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0831 23:17:15.845635 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0831 23:17:15.890643 1378731 cri.go:89] found id: "f3564f974c7c186a4cf3110fbdf83d7607a54cbd7d58484326748df57213e666"
I0831 23:17:15.890664 1378731 cri.go:89] found id: "cb403497717362a835119a12fcd9a98f048e1513652343987c5706732ded954d"
I0831 23:17:15.890669 1378731 cri.go:89] found id: ""
I0831 23:17:15.890676 1378731 logs.go:276] 2 containers: [f3564f974c7c186a4cf3110fbdf83d7607a54cbd7d58484326748df57213e666 cb403497717362a835119a12fcd9a98f048e1513652343987c5706732ded954d]
I0831 23:17:15.890762 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:15.894411 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:15.897666 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0831 23:17:15.897743 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0831 23:17:15.943706 1378731 cri.go:89] found id: "a630dbfa8aa905e5ea3326c49649056da78bba5cfd2beda22ff0f2f93515a197"
I0831 23:17:15.943730 1378731 cri.go:89] found id: "375dfe16bc1a3f88bb1adae552829f1de1f6ccd7a3b2bf3eb9e823c85daa3329"
I0831 23:17:15.943735 1378731 cri.go:89] found id: ""
I0831 23:17:15.943766 1378731 logs.go:276] 2 containers: [a630dbfa8aa905e5ea3326c49649056da78bba5cfd2beda22ff0f2f93515a197 375dfe16bc1a3f88bb1adae552829f1de1f6ccd7a3b2bf3eb9e823c85daa3329]
I0831 23:17:15.943842 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:15.947487 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:15.951394 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0831 23:17:15.951525 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0831 23:17:15.998464 1378731 cri.go:89] found id: "2ba9272459fbd3d5920c42ffd67f3fc7be523ddb8abd1b3e2f8db38f6db5a2bd"
I0831 23:17:15.998489 1378731 cri.go:89] found id: "4a53de8c7cfef15e1b4d2eb2d08e3992e87a5d45cb56ec1579cce90b650a86a3"
I0831 23:17:15.998496 1378731 cri.go:89] found id: ""
I0831 23:17:15.998504 1378731 logs.go:276] 2 containers: [2ba9272459fbd3d5920c42ffd67f3fc7be523ddb8abd1b3e2f8db38f6db5a2bd 4a53de8c7cfef15e1b4d2eb2d08e3992e87a5d45cb56ec1579cce90b650a86a3]
I0831 23:17:15.998594 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:16.004283 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:16.009432 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0831 23:17:16.009593 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0831 23:17:16.054331 1378731 cri.go:89] found id: "e7bba7657fd955c1b7ffaed6f8954f4add6c68cbbebb5450b878b68fecc3dfd4"
I0831 23:17:16.054397 1378731 cri.go:89] found id: "0ddaf9925b5b8a2498baf923aedda0b04394c82cc0c7c18555b7233ea40ba24c"
I0831 23:17:16.054417 1378731 cri.go:89] found id: ""
I0831 23:17:16.054432 1378731 logs.go:276] 2 containers: [e7bba7657fd955c1b7ffaed6f8954f4add6c68cbbebb5450b878b68fecc3dfd4 0ddaf9925b5b8a2498baf923aedda0b04394c82cc0c7c18555b7233ea40ba24c]
I0831 23:17:16.054506 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:16.058325 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:16.062125 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0831 23:17:16.062198 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0831 23:17:16.110244 1378731 cri.go:89] found id: "3a128b2ebef5226632792617aecdd7d9fa214ff983a449971d7ccdfab3a99f21"
I0831 23:17:16.110268 1378731 cri.go:89] found id: ""
I0831 23:17:16.110277 1378731 logs.go:276] 1 containers: [3a128b2ebef5226632792617aecdd7d9fa214ff983a449971d7ccdfab3a99f21]
I0831 23:17:16.110349 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:16.114110 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0831 23:17:16.114215 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0831 23:17:16.154992 1378731 cri.go:89] found id: "f7e4d956562c970c31e64420c5803c72175a04dd6fcef52066a3ece0a6233f9f"
I0831 23:17:16.155016 1378731 cri.go:89] found id: "a7e7bee1e72395c1a5b201c2a16ae1e8c0725a75e13db42a8afd0bd7b61f1a6b"
I0831 23:17:16.155021 1378731 cri.go:89] found id: ""
I0831 23:17:16.155028 1378731 logs.go:276] 2 containers: [f7e4d956562c970c31e64420c5803c72175a04dd6fcef52066a3ece0a6233f9f a7e7bee1e72395c1a5b201c2a16ae1e8c0725a75e13db42a8afd0bd7b61f1a6b]
I0831 23:17:16.155088 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:16.159471 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:16.163212 1378731 logs.go:123] Gathering logs for describe nodes ...
I0831 23:17:16.163239 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0831 23:17:16.311122 1378731 logs.go:123] Gathering logs for kube-controller-manager [4a53de8c7cfef15e1b4d2eb2d08e3992e87a5d45cb56ec1579cce90b650a86a3] ...
I0831 23:17:16.311158 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4a53de8c7cfef15e1b4d2eb2d08e3992e87a5d45cb56ec1579cce90b650a86a3"
I0831 23:17:16.395216 1378731 logs.go:123] Gathering logs for storage-provisioner [a7e7bee1e72395c1a5b201c2a16ae1e8c0725a75e13db42a8afd0bd7b61f1a6b] ...
I0831 23:17:16.395252 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a7e7bee1e72395c1a5b201c2a16ae1e8c0725a75e13db42a8afd0bd7b61f1a6b"
I0831 23:17:16.433807 1378731 logs.go:123] Gathering logs for container status ...
I0831 23:17:16.433836 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0831 23:17:16.499825 1378731 logs.go:123] Gathering logs for kubelet ...
I0831 23:17:16.499852 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0831 23:17:16.559083 1378731 logs.go:138] Found kubelet problem: Aug 31 23:11:59 old-k8s-version-777320 kubelet[661]: E0831 23:11:59.886301 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0831 23:17:16.559507 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:00 old-k8s-version-777320 kubelet[661]: E0831 23:12:00.799346 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:16.563102 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:16 old-k8s-version-777320 kubelet[661]: E0831 23:12:16.573045 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0831 23:17:16.565584 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:28 old-k8s-version-777320 kubelet[661]: E0831 23:12:28.934864 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.565923 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:29 old-k8s-version-777320 kubelet[661]: E0831 23:12:29.938937 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.566118 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:30 old-k8s-version-777320 kubelet[661]: E0831 23:12:30.563156 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:16.566566 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:30 old-k8s-version-777320 kubelet[661]: E0831 23:12:30.944101 661 pod_workers.go:191] Error syncing pod a63ab31c-0052-473f-8538-7ccd4026e42f ("storage-provisioner_kube-system(a63ab31c-0052-473f-8538-7ccd4026e42f)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(a63ab31c-0052-473f-8538-7ccd4026e42f)"
W0831 23:17:16.566900 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:35 old-k8s-version-777320 kubelet[661]: E0831 23:12:35.100827 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.569739 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:41 old-k8s-version-777320 kubelet[661]: E0831 23:12:41.565180 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0831 23:17:16.570343 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:50 old-k8s-version-777320 kubelet[661]: E0831 23:12:50.005945 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.570665 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:53 old-k8s-version-777320 kubelet[661]: E0831 23:12:53.558398 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:16.570996 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:55 old-k8s-version-777320 kubelet[661]: E0831 23:12:55.108037 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.571188 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:06 old-k8s-version-777320 kubelet[661]: E0831 23:13:06.558380 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:16.571528 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:07 old-k8s-version-777320 kubelet[661]: E0831 23:13:07.557412 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.571853 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:19 old-k8s-version-777320 kubelet[661]: E0831 23:13:19.558459 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:16.572325 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:20 old-k8s-version-777320 kubelet[661]: E0831 23:13:20.098381 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.572674 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:25 old-k8s-version-777320 kubelet[661]: E0831 23:13:25.100789 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.575241 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:31 old-k8s-version-777320 kubelet[661]: E0831 23:13:31.566325 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0831 23:17:16.575584 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:39 old-k8s-version-777320 kubelet[661]: E0831 23:13:39.557527 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.575782 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:46 old-k8s-version-777320 kubelet[661]: E0831 23:13:46.576899 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:16.576125 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:51 old-k8s-version-777320 kubelet[661]: E0831 23:13:51.557404 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.576320 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:59 old-k8s-version-777320 kubelet[661]: E0831 23:13:59.557798 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:16.576945 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:06 old-k8s-version-777320 kubelet[661]: E0831 23:14:06.253495 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.577135 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:12 old-k8s-version-777320 kubelet[661]: E0831 23:14:12.562241 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:16.577478 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:15 old-k8s-version-777320 kubelet[661]: E0831 23:14:15.101214 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.577671 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:23 old-k8s-version-777320 kubelet[661]: E0831 23:14:23.557778 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:16.578016 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:29 old-k8s-version-777320 kubelet[661]: E0831 23:14:29.557518 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.578210 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:36 old-k8s-version-777320 kubelet[661]: E0831 23:14:36.558367 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:16.578552 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:44 old-k8s-version-777320 kubelet[661]: E0831 23:14:44.558217 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.578756 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:47 old-k8s-version-777320 kubelet[661]: E0831 23:14:47.557763 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:16.579101 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:58 old-k8s-version-777320 kubelet[661]: E0831 23:14:58.571753 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.581643 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:02 old-k8s-version-777320 kubelet[661]: E0831 23:15:02.567140 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0831 23:17:16.581981 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:13 old-k8s-version-777320 kubelet[661]: E0831 23:15:13.557443 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.582174 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:15 old-k8s-version-777320 kubelet[661]: E0831 23:15:15.557843 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:16.582497 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:27 old-k8s-version-777320 kubelet[661]: E0831 23:15:27.558332 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:16.582963 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:28 old-k8s-version-777320 kubelet[661]: E0831 23:15:28.485753 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.583303 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:35 old-k8s-version-777320 kubelet[661]: E0831 23:15:35.101354 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.583497 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:41 old-k8s-version-777320 kubelet[661]: E0831 23:15:41.558221 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:16.583827 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:46 old-k8s-version-777320 kubelet[661]: E0831 23:15:46.558727 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.584021 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:52 old-k8s-version-777320 kubelet[661]: E0831 23:15:52.560966 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:16.584359 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:00 old-k8s-version-777320 kubelet[661]: E0831 23:16:00.559529 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.584545 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:04 old-k8s-version-777320 kubelet[661]: E0831 23:16:04.557871 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:16.584888 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:12 old-k8s-version-777320 kubelet[661]: E0831 23:16:12.558116 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.585076 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:17 old-k8s-version-777320 kubelet[661]: E0831 23:16:17.558685 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:16.585409 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:26 old-k8s-version-777320 kubelet[661]: E0831 23:16:26.559804 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.585606 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:30 old-k8s-version-777320 kubelet[661]: E0831 23:16:30.558289 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:16.585936 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:37 old-k8s-version-777320 kubelet[661]: E0831 23:16:37.557945 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.586126 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:45 old-k8s-version-777320 kubelet[661]: E0831 23:16:45.557768 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:16.586455 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:50 old-k8s-version-777320 kubelet[661]: E0831 23:16:50.558846 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.586641 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:58 old-k8s-version-777320 kubelet[661]: E0831 23:16:58.561819 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:16.586974 1378731 logs.go:138] Found kubelet problem: Aug 31 23:17:02 old-k8s-version-777320 kubelet[661]: E0831 23:17:02.558100 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:16.587173 1378731 logs.go:138] Found kubelet problem: Aug 31 23:17:09 old-k8s-version-777320 kubelet[661]: E0831 23:17:09.557874 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0831 23:17:16.587183 1378731 logs.go:123] Gathering logs for etcd [36189b23eed4dd70cc8796dc64533ece0f97c8515188d9c4bb6817079cf848fa] ...
I0831 23:17:16.587198 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 36189b23eed4dd70cc8796dc64533ece0f97c8515188d9c4bb6817079cf848fa"
I0831 23:17:16.638160 1378731 logs.go:123] Gathering logs for kube-scheduler [f3564f974c7c186a4cf3110fbdf83d7607a54cbd7d58484326748df57213e666] ...
I0831 23:17:16.638196 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f3564f974c7c186a4cf3110fbdf83d7607a54cbd7d58484326748df57213e666"
I0831 23:17:16.678811 1378731 logs.go:123] Gathering logs for kube-scheduler [cb403497717362a835119a12fcd9a98f048e1513652343987c5706732ded954d] ...
I0831 23:17:16.678841 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cb403497717362a835119a12fcd9a98f048e1513652343987c5706732ded954d"
I0831 23:17:16.723142 1378731 logs.go:123] Gathering logs for kube-proxy [375dfe16bc1a3f88bb1adae552829f1de1f6ccd7a3b2bf3eb9e823c85daa3329] ...
I0831 23:17:16.723175 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 375dfe16bc1a3f88bb1adae552829f1de1f6ccd7a3b2bf3eb9e823c85daa3329"
I0831 23:17:16.781476 1378731 logs.go:123] Gathering logs for kindnet [0ddaf9925b5b8a2498baf923aedda0b04394c82cc0c7c18555b7233ea40ba24c] ...
I0831 23:17:16.781513 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0ddaf9925b5b8a2498baf923aedda0b04394c82cc0c7c18555b7233ea40ba24c"
I0831 23:17:16.827016 1378731 logs.go:123] Gathering logs for containerd ...
I0831 23:17:16.827045 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0831 23:17:16.892742 1378731 logs.go:123] Gathering logs for kube-apiserver [2b314ddb4c1637e9a96260a3016921d4c647744eac2a23a86ba97ac80539955e] ...
I0831 23:17:16.892821 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2b314ddb4c1637e9a96260a3016921d4c647744eac2a23a86ba97ac80539955e"
I0831 23:17:16.973231 1378731 logs.go:123] Gathering logs for kube-apiserver [24d2daafe86a0dcb6af4171206676787738fec4b49e748c8e217d63f6af8bb12] ...
I0831 23:17:16.973266 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 24d2daafe86a0dcb6af4171206676787738fec4b49e748c8e217d63f6af8bb12"
I0831 23:17:17.073665 1378731 logs.go:123] Gathering logs for etcd [adc270d3e8398b7a86ff787dfd6fa155a7deeb47c29d94cf0371e7f3af2cf66a] ...
I0831 23:17:17.073702 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 adc270d3e8398b7a86ff787dfd6fa155a7deeb47c29d94cf0371e7f3af2cf66a"
I0831 23:17:17.123022 1378731 logs.go:123] Gathering logs for coredns [83c393cb9b979e9591d3e9004c20ad7a85c3cf5a2fb01002fa02cdd21598c0ee] ...
I0831 23:17:17.123055 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 83c393cb9b979e9591d3e9004c20ad7a85c3cf5a2fb01002fa02cdd21598c0ee"
I0831 23:17:17.161757 1378731 logs.go:123] Gathering logs for coredns [26aa1d510c36cb526536c021669ae3f5436cdad4f0a6f9c30b4b361249af6077] ...
I0831 23:17:17.161789 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 26aa1d510c36cb526536c021669ae3f5436cdad4f0a6f9c30b4b361249af6077"
I0831 23:17:17.207656 1378731 logs.go:123] Gathering logs for kube-proxy [a630dbfa8aa905e5ea3326c49649056da78bba5cfd2beda22ff0f2f93515a197] ...
I0831 23:17:17.207688 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a630dbfa8aa905e5ea3326c49649056da78bba5cfd2beda22ff0f2f93515a197"
I0831 23:17:17.253344 1378731 logs.go:123] Gathering logs for kindnet [e7bba7657fd955c1b7ffaed6f8954f4add6c68cbbebb5450b878b68fecc3dfd4] ...
I0831 23:17:17.253373 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e7bba7657fd955c1b7ffaed6f8954f4add6c68cbbebb5450b878b68fecc3dfd4"
I0831 23:17:17.305840 1378731 logs.go:123] Gathering logs for kubernetes-dashboard [3a128b2ebef5226632792617aecdd7d9fa214ff983a449971d7ccdfab3a99f21] ...
I0831 23:17:17.305872 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3a128b2ebef5226632792617aecdd7d9fa214ff983a449971d7ccdfab3a99f21"
I0831 23:17:17.350496 1378731 logs.go:123] Gathering logs for dmesg ...
I0831 23:17:17.350531 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0831 23:17:17.367849 1378731 logs.go:123] Gathering logs for kube-controller-manager [2ba9272459fbd3d5920c42ffd67f3fc7be523ddb8abd1b3e2f8db38f6db5a2bd] ...
I0831 23:17:17.367879 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2ba9272459fbd3d5920c42ffd67f3fc7be523ddb8abd1b3e2f8db38f6db5a2bd"
I0831 23:17:17.430837 1378731 logs.go:123] Gathering logs for storage-provisioner [f7e4d956562c970c31e64420c5803c72175a04dd6fcef52066a3ece0a6233f9f] ...
I0831 23:17:17.430872 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f7e4d956562c970c31e64420c5803c72175a04dd6fcef52066a3ece0a6233f9f"
I0831 23:17:17.476393 1378731 out.go:358] Setting ErrFile to fd 2...
I0831 23:17:17.476424 1378731 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0831 23:17:17.476507 1378731 out.go:270] X Problems detected in kubelet:
X Problems detected in kubelet:
W0831 23:17:17.476522 1378731 out.go:270] Aug 31 23:16:45 old-k8s-version-777320 kubelet[661]: E0831 23:16:45.557768 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 31 23:16:45 old-k8s-version-777320 kubelet[661]: E0831 23:16:45.557768 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:17.476537 1378731 out.go:270] Aug 31 23:16:50 old-k8s-version-777320 kubelet[661]: E0831 23:16:50.558846 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
Aug 31 23:16:50 old-k8s-version-777320 kubelet[661]: E0831 23:16:50.558846 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:17.476565 1378731 out.go:270] Aug 31 23:16:58 old-k8s-version-777320 kubelet[661]: E0831 23:16:58.561819 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 31 23:16:58 old-k8s-version-777320 kubelet[661]: E0831 23:16:58.561819 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:17.476585 1378731 out.go:270] Aug 31 23:17:02 old-k8s-version-777320 kubelet[661]: E0831 23:17:02.558100 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
Aug 31 23:17:02 old-k8s-version-777320 kubelet[661]: E0831 23:17:02.558100 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:17.476599 1378731 out.go:270] Aug 31 23:17:09 old-k8s-version-777320 kubelet[661]: E0831 23:17:09.557874 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 31 23:17:09 old-k8s-version-777320 kubelet[661]: E0831 23:17:09.557874 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0831 23:17:17.476670 1378731 out.go:358] Setting ErrFile to fd 2...
I0831 23:17:17.476689 1378731 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0831 23:17:27.478286 1378731 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0831 23:17:27.490816 1378731 api_server.go:72] duration metric: took 5m48.826929616s to wait for apiserver process to appear ...
I0831 23:17:27.490838 1378731 api_server.go:88] waiting for apiserver healthz status ...
I0831 23:17:27.490882 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0831 23:17:27.490938 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0831 23:17:27.569029 1378731 cri.go:89] found id: "2b314ddb4c1637e9a96260a3016921d4c647744eac2a23a86ba97ac80539955e"
I0831 23:17:27.569048 1378731 cri.go:89] found id: "24d2daafe86a0dcb6af4171206676787738fec4b49e748c8e217d63f6af8bb12"
I0831 23:17:27.569053 1378731 cri.go:89] found id: ""
I0831 23:17:27.569060 1378731 logs.go:276] 2 containers: [2b314ddb4c1637e9a96260a3016921d4c647744eac2a23a86ba97ac80539955e 24d2daafe86a0dcb6af4171206676787738fec4b49e748c8e217d63f6af8bb12]
I0831 23:17:27.569113 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.573327 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.577199 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0831 23:17:27.577262 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0831 23:17:27.626986 1378731 cri.go:89] found id: "adc270d3e8398b7a86ff787dfd6fa155a7deeb47c29d94cf0371e7f3af2cf66a"
I0831 23:17:27.627004 1378731 cri.go:89] found id: "36189b23eed4dd70cc8796dc64533ece0f97c8515188d9c4bb6817079cf848fa"
I0831 23:17:27.627009 1378731 cri.go:89] found id: ""
I0831 23:17:27.627017 1378731 logs.go:276] 2 containers: [adc270d3e8398b7a86ff787dfd6fa155a7deeb47c29d94cf0371e7f3af2cf66a 36189b23eed4dd70cc8796dc64533ece0f97c8515188d9c4bb6817079cf848fa]
I0831 23:17:27.627071 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.631361 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.635643 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0831 23:17:27.635706 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0831 23:17:27.683136 1378731 cri.go:89] found id: "83c393cb9b979e9591d3e9004c20ad7a85c3cf5a2fb01002fa02cdd21598c0ee"
I0831 23:17:27.683156 1378731 cri.go:89] found id: "26aa1d510c36cb526536c021669ae3f5436cdad4f0a6f9c30b4b361249af6077"
I0831 23:17:27.683160 1378731 cri.go:89] found id: ""
I0831 23:17:27.683167 1378731 logs.go:276] 2 containers: [83c393cb9b979e9591d3e9004c20ad7a85c3cf5a2fb01002fa02cdd21598c0ee 26aa1d510c36cb526536c021669ae3f5436cdad4f0a6f9c30b4b361249af6077]
I0831 23:17:27.683221 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.687219 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.692442 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0831 23:17:27.692509 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0831 23:17:27.789373 1378731 cri.go:89] found id: "f3564f974c7c186a4cf3110fbdf83d7607a54cbd7d58484326748df57213e666"
I0831 23:17:27.789445 1378731 cri.go:89] found id: "cb403497717362a835119a12fcd9a98f048e1513652343987c5706732ded954d"
I0831 23:17:27.789465 1378731 cri.go:89] found id: ""
I0831 23:17:27.789493 1378731 logs.go:276] 2 containers: [f3564f974c7c186a4cf3110fbdf83d7607a54cbd7d58484326748df57213e666 cb403497717362a835119a12fcd9a98f048e1513652343987c5706732ded954d]
I0831 23:17:27.789562 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.799289 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.803458 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0831 23:17:27.803580 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0831 23:17:27.870602 1378731 cri.go:89] found id: "a630dbfa8aa905e5ea3326c49649056da78bba5cfd2beda22ff0f2f93515a197"
I0831 23:17:27.870624 1378731 cri.go:89] found id: "375dfe16bc1a3f88bb1adae552829f1de1f6ccd7a3b2bf3eb9e823c85daa3329"
I0831 23:17:27.870629 1378731 cri.go:89] found id: ""
I0831 23:17:27.870636 1378731 logs.go:276] 2 containers: [a630dbfa8aa905e5ea3326c49649056da78bba5cfd2beda22ff0f2f93515a197 375dfe16bc1a3f88bb1adae552829f1de1f6ccd7a3b2bf3eb9e823c85daa3329]
I0831 23:17:27.870694 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.874793 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.878737 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0831 23:17:27.878804 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0831 23:17:27.960687 1378731 cri.go:89] found id: "2ba9272459fbd3d5920c42ffd67f3fc7be523ddb8abd1b3e2f8db38f6db5a2bd"
I0831 23:17:27.960708 1378731 cri.go:89] found id: "4a53de8c7cfef15e1b4d2eb2d08e3992e87a5d45cb56ec1579cce90b650a86a3"
I0831 23:17:27.960713 1378731 cri.go:89] found id: ""
I0831 23:17:27.960720 1378731 logs.go:276] 2 containers: [2ba9272459fbd3d5920c42ffd67f3fc7be523ddb8abd1b3e2f8db38f6db5a2bd 4a53de8c7cfef15e1b4d2eb2d08e3992e87a5d45cb56ec1579cce90b650a86a3]
I0831 23:17:27.960779 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.964573 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.969609 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0831 23:17:27.969674 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0831 23:17:28.029658 1378731 cri.go:89] found id: "e7bba7657fd955c1b7ffaed6f8954f4add6c68cbbebb5450b878b68fecc3dfd4"
I0831 23:17:28.029682 1378731 cri.go:89] found id: "0ddaf9925b5b8a2498baf923aedda0b04394c82cc0c7c18555b7233ea40ba24c"
I0831 23:17:28.029689 1378731 cri.go:89] found id: ""
I0831 23:17:28.029696 1378731 logs.go:276] 2 containers: [e7bba7657fd955c1b7ffaed6f8954f4add6c68cbbebb5450b878b68fecc3dfd4 0ddaf9925b5b8a2498baf923aedda0b04394c82cc0c7c18555b7233ea40ba24c]
I0831 23:17:28.029760 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:28.034482 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:28.039042 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0831 23:17:28.039128 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0831 23:17:28.089883 1378731 cri.go:89] found id: "3a128b2ebef5226632792617aecdd7d9fa214ff983a449971d7ccdfab3a99f21"
I0831 23:17:28.089909 1378731 cri.go:89] found id: ""
I0831 23:17:28.089923 1378731 logs.go:276] 1 containers: [3a128b2ebef5226632792617aecdd7d9fa214ff983a449971d7ccdfab3a99f21]
I0831 23:17:28.090037 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:28.094024 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0831 23:17:28.094139 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0831 23:17:28.148204 1378731 cri.go:89] found id: "f7e4d956562c970c31e64420c5803c72175a04dd6fcef52066a3ece0a6233f9f"
I0831 23:17:28.148263 1378731 cri.go:89] found id: "a7e7bee1e72395c1a5b201c2a16ae1e8c0725a75e13db42a8afd0bd7b61f1a6b"
I0831 23:17:28.148292 1378731 cri.go:89] found id: ""
I0831 23:17:28.148313 1378731 logs.go:276] 2 containers: [f7e4d956562c970c31e64420c5803c72175a04dd6fcef52066a3ece0a6233f9f a7e7bee1e72395c1a5b201c2a16ae1e8c0725a75e13db42a8afd0bd7b61f1a6b]
I0831 23:17:28.148397 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:28.153035 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:28.157041 1378731 logs.go:123] Gathering logs for etcd [36189b23eed4dd70cc8796dc64533ece0f97c8515188d9c4bb6817079cf848fa] ...
I0831 23:17:28.157118 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 36189b23eed4dd70cc8796dc64533ece0f97c8515188d9c4bb6817079cf848fa"
I0831 23:17:28.219799 1378731 logs.go:123] Gathering logs for containerd ...
I0831 23:17:28.219874 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0831 23:17:28.289711 1378731 logs.go:123] Gathering logs for etcd [adc270d3e8398b7a86ff787dfd6fa155a7deeb47c29d94cf0371e7f3af2cf66a] ...
I0831 23:17:28.289790 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 adc270d3e8398b7a86ff787dfd6fa155a7deeb47c29d94cf0371e7f3af2cf66a"
I0831 23:17:28.344442 1378731 logs.go:123] Gathering logs for kube-controller-manager [4a53de8c7cfef15e1b4d2eb2d08e3992e87a5d45cb56ec1579cce90b650a86a3] ...
I0831 23:17:28.344473 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4a53de8c7cfef15e1b4d2eb2d08e3992e87a5d45cb56ec1579cce90b650a86a3"
I0831 23:17:28.417370 1378731 logs.go:123] Gathering logs for kubernetes-dashboard [3a128b2ebef5226632792617aecdd7d9fa214ff983a449971d7ccdfab3a99f21] ...
I0831 23:17:28.417462 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3a128b2ebef5226632792617aecdd7d9fa214ff983a449971d7ccdfab3a99f21"
I0831 23:17:28.475114 1378731 logs.go:123] Gathering logs for container status ...
I0831 23:17:28.475141 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0831 23:17:28.555107 1378731 logs.go:123] Gathering logs for kube-apiserver [2b314ddb4c1637e9a96260a3016921d4c647744eac2a23a86ba97ac80539955e] ...
I0831 23:17:28.555136 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2b314ddb4c1637e9a96260a3016921d4c647744eac2a23a86ba97ac80539955e"
I0831 23:17:28.652948 1378731 logs.go:123] Gathering logs for coredns [26aa1d510c36cb526536c021669ae3f5436cdad4f0a6f9c30b4b361249af6077] ...
I0831 23:17:28.653044 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 26aa1d510c36cb526536c021669ae3f5436cdad4f0a6f9c30b4b361249af6077"
I0831 23:17:28.718275 1378731 logs.go:123] Gathering logs for kube-scheduler [cb403497717362a835119a12fcd9a98f048e1513652343987c5706732ded954d] ...
I0831 23:17:28.718299 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cb403497717362a835119a12fcd9a98f048e1513652343987c5706732ded954d"
I0831 23:17:28.776545 1378731 logs.go:123] Gathering logs for kube-proxy [a630dbfa8aa905e5ea3326c49649056da78bba5cfd2beda22ff0f2f93515a197] ...
I0831 23:17:28.776572 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a630dbfa8aa905e5ea3326c49649056da78bba5cfd2beda22ff0f2f93515a197"
I0831 23:17:28.830806 1378731 logs.go:123] Gathering logs for kube-proxy [375dfe16bc1a3f88bb1adae552829f1de1f6ccd7a3b2bf3eb9e823c85daa3329] ...
I0831 23:17:28.830831 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 375dfe16bc1a3f88bb1adae552829f1de1f6ccd7a3b2bf3eb9e823c85daa3329"
I0831 23:17:28.953408 1378731 logs.go:123] Gathering logs for kube-controller-manager [2ba9272459fbd3d5920c42ffd67f3fc7be523ddb8abd1b3e2f8db38f6db5a2bd] ...
I0831 23:17:28.953438 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2ba9272459fbd3d5920c42ffd67f3fc7be523ddb8abd1b3e2f8db38f6db5a2bd"
I0831 23:17:29.052029 1378731 logs.go:123] Gathering logs for kindnet [e7bba7657fd955c1b7ffaed6f8954f4add6c68cbbebb5450b878b68fecc3dfd4] ...
I0831 23:17:29.052112 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e7bba7657fd955c1b7ffaed6f8954f4add6c68cbbebb5450b878b68fecc3dfd4"
I0831 23:17:29.132067 1378731 logs.go:123] Gathering logs for kubelet ...
I0831 23:17:29.132142 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0831 23:17:29.205613 1378731 logs.go:138] Found kubelet problem: Aug 31 23:11:59 old-k8s-version-777320 kubelet[661]: E0831 23:11:59.886301 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0831 23:17:29.206125 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:00 old-k8s-version-777320 kubelet[661]: E0831 23:12:00.799346 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.209084 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:16 old-k8s-version-777320 kubelet[661]: E0831 23:12:16.573045 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0831 23:17:29.211702 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:28 old-k8s-version-777320 kubelet[661]: E0831 23:12:28.934864 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.212063 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:29 old-k8s-version-777320 kubelet[661]: E0831 23:12:29.938937 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.212274 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:30 old-k8s-version-777320 kubelet[661]: E0831 23:12:30.563156 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.212793 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:30 old-k8s-version-777320 kubelet[661]: E0831 23:12:30.944101 661 pod_workers.go:191] Error syncing pod a63ab31c-0052-473f-8538-7ccd4026e42f ("storage-provisioner_kube-system(a63ab31c-0052-473f-8538-7ccd4026e42f)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(a63ab31c-0052-473f-8538-7ccd4026e42f)"
W0831 23:17:29.213242 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:35 old-k8s-version-777320 kubelet[661]: E0831 23:12:35.100827 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.216103 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:41 old-k8s-version-777320 kubelet[661]: E0831 23:12:41.565180 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0831 23:17:29.216741 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:50 old-k8s-version-777320 kubelet[661]: E0831 23:12:50.005945 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.217085 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:53 old-k8s-version-777320 kubelet[661]: E0831 23:12:53.558398 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.217442 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:55 old-k8s-version-777320 kubelet[661]: E0831 23:12:55.108037 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.217651 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:06 old-k8s-version-777320 kubelet[661]: E0831 23:13:06.558380 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.218006 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:07 old-k8s-version-777320 kubelet[661]: E0831 23:13:07.557412 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.218346 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:19 old-k8s-version-777320 kubelet[661]: E0831 23:13:19.558459 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.218826 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:20 old-k8s-version-777320 kubelet[661]: E0831 23:13:20.098381 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.219254 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:25 old-k8s-version-777320 kubelet[661]: E0831 23:13:25.100789 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.221881 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:31 old-k8s-version-777320 kubelet[661]: E0831 23:13:31.566325 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0831 23:17:29.222317 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:39 old-k8s-version-777320 kubelet[661]: E0831 23:13:39.557527 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.222567 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:46 old-k8s-version-777320 kubelet[661]: E0831 23:13:46.576899 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.222999 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:51 old-k8s-version-777320 kubelet[661]: E0831 23:13:51.557404 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.223228 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:59 old-k8s-version-777320 kubelet[661]: E0831 23:13:59.557798 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.223904 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:06 old-k8s-version-777320 kubelet[661]: E0831 23:14:06.253495 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.224132 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:12 old-k8s-version-777320 kubelet[661]: E0831 23:14:12.562241 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.224600 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:15 old-k8s-version-777320 kubelet[661]: E0831 23:14:15.101214 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.224848 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:23 old-k8s-version-777320 kubelet[661]: E0831 23:14:23.557778 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.225290 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:29 old-k8s-version-777320 kubelet[661]: E0831 23:14:29.557518 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.225554 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:36 old-k8s-version-777320 kubelet[661]: E0831 23:14:36.558367 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.226034 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:44 old-k8s-version-777320 kubelet[661]: E0831 23:14:44.558217 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.226519 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:47 old-k8s-version-777320 kubelet[661]: E0831 23:14:47.557763 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.227154 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:58 old-k8s-version-777320 kubelet[661]: E0831 23:14:58.571753 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.230275 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:02 old-k8s-version-777320 kubelet[661]: E0831 23:15:02.567140 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0831 23:17:29.230707 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:13 old-k8s-version-777320 kubelet[661]: E0831 23:15:13.557443 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.230980 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:15 old-k8s-version-777320 kubelet[661]: E0831 23:15:15.557843 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.231342 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:27 old-k8s-version-777320 kubelet[661]: E0831 23:15:27.558332 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.231835 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:28 old-k8s-version-777320 kubelet[661]: E0831 23:15:28.485753 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.232186 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:35 old-k8s-version-777320 kubelet[661]: E0831 23:15:35.101354 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.232406 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:41 old-k8s-version-777320 kubelet[661]: E0831 23:15:41.558221 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.232779 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:46 old-k8s-version-777320 kubelet[661]: E0831 23:15:46.558727 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.233028 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:52 old-k8s-version-777320 kubelet[661]: E0831 23:15:52.560966 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.233399 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:00 old-k8s-version-777320 kubelet[661]: E0831 23:16:00.559529 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.233620 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:04 old-k8s-version-777320 kubelet[661]: E0831 23:16:04.557871 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.233986 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:12 old-k8s-version-777320 kubelet[661]: E0831 23:16:12.558116 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.234213 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:17 old-k8s-version-777320 kubelet[661]: E0831 23:16:17.558685 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.234579 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:26 old-k8s-version-777320 kubelet[661]: E0831 23:16:26.559804 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.234813 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:30 old-k8s-version-777320 kubelet[661]: E0831 23:16:30.558289 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.235197 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:37 old-k8s-version-777320 kubelet[661]: E0831 23:16:37.557945 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.235435 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:45 old-k8s-version-777320 kubelet[661]: E0831 23:16:45.557768 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.235812 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:50 old-k8s-version-777320 kubelet[661]: E0831 23:16:50.558846 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.236045 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:58 old-k8s-version-777320 kubelet[661]: E0831 23:16:58.561819 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.236417 1378731 logs.go:138] Found kubelet problem: Aug 31 23:17:02 old-k8s-version-777320 kubelet[661]: E0831 23:17:02.558100 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.236650 1378731 logs.go:138] Found kubelet problem: Aug 31 23:17:09 old-k8s-version-777320 kubelet[661]: E0831 23:17:09.557874 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.237021 1378731 logs.go:138] Found kubelet problem: Aug 31 23:17:17 old-k8s-version-777320 kubelet[661]: E0831 23:17:17.557481 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.237248 1378731 logs.go:138] Found kubelet problem: Aug 31 23:17:24 old-k8s-version-777320 kubelet[661]: E0831 23:17:24.557898 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0831 23:17:29.237274 1378731 logs.go:123] Gathering logs for dmesg ...
I0831 23:17:29.237305 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0831 23:17:29.257013 1378731 logs.go:123] Gathering logs for describe nodes ...
I0831 23:17:29.257041 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0831 23:17:29.448128 1378731 logs.go:123] Gathering logs for kube-apiserver [24d2daafe86a0dcb6af4171206676787738fec4b49e748c8e217d63f6af8bb12] ...
I0831 23:17:29.448212 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 24d2daafe86a0dcb6af4171206676787738fec4b49e748c8e217d63f6af8bb12"
I0831 23:17:29.539734 1378731 logs.go:123] Gathering logs for coredns [83c393cb9b979e9591d3e9004c20ad7a85c3cf5a2fb01002fa02cdd21598c0ee] ...
I0831 23:17:29.539770 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 83c393cb9b979e9591d3e9004c20ad7a85c3cf5a2fb01002fa02cdd21598c0ee"
I0831 23:17:29.591574 1378731 logs.go:123] Gathering logs for kube-scheduler [f3564f974c7c186a4cf3110fbdf83d7607a54cbd7d58484326748df57213e666] ...
I0831 23:17:29.591602 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f3564f974c7c186a4cf3110fbdf83d7607a54cbd7d58484326748df57213e666"
I0831 23:17:29.658215 1378731 logs.go:123] Gathering logs for kindnet [0ddaf9925b5b8a2498baf923aedda0b04394c82cc0c7c18555b7233ea40ba24c] ...
I0831 23:17:29.658241 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0ddaf9925b5b8a2498baf923aedda0b04394c82cc0c7c18555b7233ea40ba24c"
I0831 23:17:29.717457 1378731 logs.go:123] Gathering logs for storage-provisioner [f7e4d956562c970c31e64420c5803c72175a04dd6fcef52066a3ece0a6233f9f] ...
I0831 23:17:29.717478 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f7e4d956562c970c31e64420c5803c72175a04dd6fcef52066a3ece0a6233f9f"
I0831 23:17:29.781489 1378731 logs.go:123] Gathering logs for storage-provisioner [a7e7bee1e72395c1a5b201c2a16ae1e8c0725a75e13db42a8afd0bd7b61f1a6b] ...
I0831 23:17:29.781520 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a7e7bee1e72395c1a5b201c2a16ae1e8c0725a75e13db42a8afd0bd7b61f1a6b"
I0831 23:17:29.848601 1378731 out.go:358] Setting ErrFile to fd 2...
I0831 23:17:29.848638 1378731 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0831 23:17:29.848687 1378731 out.go:270] X Problems detected in kubelet:
X Problems detected in kubelet:
W0831 23:17:29.848702 1378731 out.go:270] Aug 31 23:16:58 old-k8s-version-777320 kubelet[661]: E0831 23:16:58.561819 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 31 23:16:58 old-k8s-version-777320 kubelet[661]: E0831 23:16:58.561819 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.848708 1378731 out.go:270] Aug 31 23:17:02 old-k8s-version-777320 kubelet[661]: E0831 23:17:02.558100 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
Aug 31 23:17:02 old-k8s-version-777320 kubelet[661]: E0831 23:17:02.558100 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.848719 1378731 out.go:270] Aug 31 23:17:09 old-k8s-version-777320 kubelet[661]: E0831 23:17:09.557874 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 31 23:17:09 old-k8s-version-777320 kubelet[661]: E0831 23:17:09.557874 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.848725 1378731 out.go:270] Aug 31 23:17:17 old-k8s-version-777320 kubelet[661]: E0831 23:17:17.557481 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
Aug 31 23:17:17 old-k8s-version-777320 kubelet[661]: E0831 23:17:17.557481 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.848731 1378731 out.go:270] Aug 31 23:17:24 old-k8s-version-777320 kubelet[661]: E0831 23:17:24.557898 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 31 23:17:24 old-k8s-version-777320 kubelet[661]: E0831 23:17:24.557898 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0831 23:17:29.848742 1378731 out.go:358] Setting ErrFile to fd 2...
I0831 23:17:29.848748 1378731 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0831 23:17:39.849201 1378731 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0831 23:17:39.865165 1378731 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0831 23:17:39.867576 1378731 out.go:201]
W0831 23:17:39.869895 1378731 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0831 23:17:39.870097 1378731 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0831 23:17:39.870173 1378731 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0831 23:17:39.870268 1378731 out.go:270] *
*
W0831 23:17:39.871923 1378731 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0831 23:17:39.874230 1378731 out.go:201]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-777320 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:223: -----------------------post-mortem--------------------------------
helpers_test.go:231: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:232: (dbg) Run: docker inspect old-k8s-version-777320
helpers_test.go:236: (dbg) docker inspect old-k8s-version-777320:
-- stdout --
[
{
"Id": "a0fb772b5847e065625edac3c79e4b2949dd304f0ad24eea8325ae73091d9423",
"Created": "2024-08-31T23:08:38.062309395Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 1378943,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-08-31T23:11:31.315449048Z",
"FinishedAt": "2024-08-31T23:11:30.105645735Z"
},
"Image": "sha256:eb620c1d7126103417d4dc31eb6aaaf95b0878713d0303a36cb77002c31b0deb",
"ResolvConfPath": "/var/lib/docker/containers/a0fb772b5847e065625edac3c79e4b2949dd304f0ad24eea8325ae73091d9423/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/a0fb772b5847e065625edac3c79e4b2949dd304f0ad24eea8325ae73091d9423/hostname",
"HostsPath": "/var/lib/docker/containers/a0fb772b5847e065625edac3c79e4b2949dd304f0ad24eea8325ae73091d9423/hosts",
"LogPath": "/var/lib/docker/containers/a0fb772b5847e065625edac3c79e4b2949dd304f0ad24eea8325ae73091d9423/a0fb772b5847e065625edac3c79e4b2949dd304f0ad24eea8325ae73091d9423-json.log",
"Name": "/old-k8s-version-777320",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-777320:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-777320",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/8add83426e057939da9c6fbb8f75474c978129250571fd895e712911f5023d00-init/diff:/var/lib/docker/overlay2/e3c84f94aefed91511672b053b6e522f115b49b6c1ddbd2cec747cd29cd10f0e/diff",
"MergedDir": "/var/lib/docker/overlay2/8add83426e057939da9c6fbb8f75474c978129250571fd895e712911f5023d00/merged",
"UpperDir": "/var/lib/docker/overlay2/8add83426e057939da9c6fbb8f75474c978129250571fd895e712911f5023d00/diff",
"WorkDir": "/var/lib/docker/overlay2/8add83426e057939da9c6fbb8f75474c978129250571fd895e712911f5023d00/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-777320",
"Source": "/var/lib/docker/volumes/old-k8s-version-777320/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-777320",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-777320",
"name.minikube.sigs.k8s.io": "old-k8s-version-777320",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "359bf95e5684a6fd47bf81d741668739b6cdf2ae5ac336347ef3227c5bede6e4",
"SandboxKey": "/var/run/docker/netns/359bf95e5684",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34569"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34570"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34573"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34571"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34572"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-777320": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:55:02",
"DriverOpts": null,
"NetworkID": "d45d3b66a7a4ac5b8b8d5d381122902efc71f6e44cafe9c01564b674a675e021",
"EndpointID": "b0b1a3b2bd7eb7e346f7ee15206f5542d274c662877059da74aae468495efd4a",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-777320",
"a0fb772b5847"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:240: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-777320 -n old-k8s-version-777320
helpers_test.go:245: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:246: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:248: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-777320 logs -n 25
helpers_test.go:248: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-777320 logs -n 25: (2.683501321s)
helpers_test.go:253: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| start | -p cert-expiration-429828 | cert-expiration-429828 | jenkins | v1.33.1 | 31 Aug 24 23:07 UTC | 31 Aug 24 23:07 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-env-627131 | force-systemd-env-627131 | jenkins | v1.33.1 | 31 Aug 24 23:07 UTC | 31 Aug 24 23:07 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-env-627131 | force-systemd-env-627131 | jenkins | v1.33.1 | 31 Aug 24 23:07 UTC | 31 Aug 24 23:07 UTC |
| start | -p cert-options-610986 | cert-options-610986 | jenkins | v1.33.1 | 31 Aug 24 23:07 UTC | 31 Aug 24 23:08 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-610986 ssh | cert-options-610986 | jenkins | v1.33.1 | 31 Aug 24 23:08 UTC | 31 Aug 24 23:08 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-610986 -- sudo | cert-options-610986 | jenkins | v1.33.1 | 31 Aug 24 23:08 UTC | 31 Aug 24 23:08 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-610986 | cert-options-610986 | jenkins | v1.33.1 | 31 Aug 24 23:08 UTC | 31 Aug 24 23:08 UTC |
| start | -p old-k8s-version-777320 | old-k8s-version-777320 | jenkins | v1.33.1 | 31 Aug 24 23:08 UTC | 31 Aug 24 23:11 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-429828 | cert-expiration-429828 | jenkins | v1.33.1 | 31 Aug 24 23:10 UTC | 31 Aug 24 23:11 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-429828 | cert-expiration-429828 | jenkins | v1.33.1 | 31 Aug 24 23:11 UTC | 31 Aug 24 23:11 UTC |
| start | -p no-preload-039701 | no-preload-039701 | jenkins | v1.33.1 | 31 Aug 24 23:11 UTC | 31 Aug 24 23:12 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0 | | | | | |
| addons | enable metrics-server -p old-k8s-version-777320 | old-k8s-version-777320 | jenkins | v1.33.1 | 31 Aug 24 23:11 UTC | 31 Aug 24 23:11 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-777320 | old-k8s-version-777320 | jenkins | v1.33.1 | 31 Aug 24 23:11 UTC | 31 Aug 24 23:11 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-777320 | old-k8s-version-777320 | jenkins | v1.33.1 | 31 Aug 24 23:11 UTC | 31 Aug 24 23:11 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-777320 | old-k8s-version-777320 | jenkins | v1.33.1 | 31 Aug 24 23:11 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-039701 | no-preload-039701 | jenkins | v1.33.1 | 31 Aug 24 23:12 UTC | 31 Aug 24 23:12 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-039701 | no-preload-039701 | jenkins | v1.33.1 | 31 Aug 24 23:12 UTC | 31 Aug 24 23:12 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-039701 | no-preload-039701 | jenkins | v1.33.1 | 31 Aug 24 23:12 UTC | 31 Aug 24 23:12 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-039701 | no-preload-039701 | jenkins | v1.33.1 | 31 Aug 24 23:12 UTC | 31 Aug 24 23:17 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0 | | | | | |
| image | no-preload-039701 image list | no-preload-039701 | jenkins | v1.33.1 | 31 Aug 24 23:17 UTC | 31 Aug 24 23:17 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-039701 | no-preload-039701 | jenkins | v1.33.1 | 31 Aug 24 23:17 UTC | 31 Aug 24 23:17 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-039701 | no-preload-039701 | jenkins | v1.33.1 | 31 Aug 24 23:17 UTC | 31 Aug 24 23:17 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-039701 | no-preload-039701 | jenkins | v1.33.1 | 31 Aug 24 23:17 UTC | 31 Aug 24 23:17 UTC |
| delete | -p no-preload-039701 | no-preload-039701 | jenkins | v1.33.1 | 31 Aug 24 23:17 UTC | 31 Aug 24 23:17 UTC |
| start | -p embed-certs-642101 | embed-certs-642101 | jenkins | v1.33.1 | 31 Aug 24 23:17 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0 | | | | | |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/08/31 23:17:29
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.22.5 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0831 23:17:29.184753 1389847 out.go:345] Setting OutFile to fd 1 ...
I0831 23:17:29.184889 1389847 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0831 23:17:29.184900 1389847 out.go:358] Setting ErrFile to fd 2...
I0831 23:17:29.184907 1389847 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0831 23:17:29.185182 1389847 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18943-1161402/.minikube/bin
I0831 23:17:29.185592 1389847 out.go:352] Setting JSON to false
I0831 23:17:29.186591 1389847 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":25198,"bootTime":1725121051,"procs":219,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1068-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0831 23:17:29.186660 1389847 start.go:139] virtualization:
I0831 23:17:29.190022 1389847 out.go:177] * [embed-certs-642101] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0831 23:17:29.193717 1389847 out.go:177] - MINIKUBE_LOCATION=18943
I0831 23:17:29.193772 1389847 notify.go:220] Checking for updates...
I0831 23:17:29.198645 1389847 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0831 23:17:29.201017 1389847 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18943-1161402/kubeconfig
I0831 23:17:29.203514 1389847 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18943-1161402/.minikube
I0831 23:17:29.205888 1389847 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0831 23:17:29.208440 1389847 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0831 23:17:29.210917 1389847 config.go:182] Loaded profile config "old-k8s-version-777320": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0831 23:17:29.211007 1389847 driver.go:392] Setting default libvirt URI to qemu:///system
I0831 23:17:29.256365 1389847 docker.go:123] docker version: linux-27.2.0:Docker Engine - Community
I0831 23:17:29.256490 1389847 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0831 23:17:29.346242 1389847 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:35 OomKillDisable:true NGoroutines:53 SystemTime:2024-08-31 23:17:29.330591836 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1068-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0831 23:17:29.346355 1389847 docker.go:307] overlay module found
I0831 23:17:29.348852 1389847 out.go:177] * Using the docker driver based on user configuration
I0831 23:17:29.351031 1389847 start.go:297] selected driver: docker
I0831 23:17:29.351057 1389847 start.go:901] validating driver "docker" against <nil>
I0831 23:17:29.351072 1389847 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0831 23:17:29.351714 1389847 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0831 23:17:29.453381 1389847 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:35 OomKillDisable:true NGoroutines:53 SystemTime:2024-08-31 23:17:29.440161431 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1068-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0831 23:17:29.453544 1389847 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0831 23:17:29.453765 1389847 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0831 23:17:29.456217 1389847 out.go:177] * Using Docker driver with root privileges
I0831 23:17:29.458673 1389847 cni.go:84] Creating CNI manager for ""
I0831 23:17:29.458696 1389847 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0831 23:17:29.458707 1389847 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0831 23:17:29.458788 1389847 start.go:340] cluster config:
{Name:embed-certs-642101 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:embed-certs-642101 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Stati
cIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0831 23:17:29.460861 1389847 out.go:177] * Starting "embed-certs-642101" primary control-plane node in "embed-certs-642101" cluster
I0831 23:17:29.462877 1389847 cache.go:121] Beginning downloading kic base image for docker with containerd
I0831 23:17:29.465167 1389847 out.go:177] * Pulling base image v0.0.44-1724862063-19530 ...
I0831 23:17:29.466961 1389847 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0831 23:17:29.467013 1389847 preload.go:146] Found local preload: /home/jenkins/minikube-integration/18943-1161402/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4
I0831 23:17:29.467022 1389847 cache.go:56] Caching tarball of preloaded images
I0831 23:17:29.467108 1389847 preload.go:172] Found /home/jenkins/minikube-integration/18943-1161402/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0831 23:17:29.467118 1389847 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on containerd
I0831 23:17:29.467222 1389847 profile.go:143] Saving config to /home/jenkins/minikube-integration/18943-1161402/.minikube/profiles/embed-certs-642101/config.json ...
I0831 23:17:29.467239 1389847 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18943-1161402/.minikube/profiles/embed-certs-642101/config.json: {Name:mkfe72873c21533ddfd13c6ee833dabdbedf9987 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0831 23:17:29.467341 1389847 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 in local docker daemon
W0831 23:17:29.491296 1389847 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 is of wrong architecture
I0831 23:17:29.491314 1389847 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 to local cache
I0831 23:17:29.491384 1389847 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 in local cache directory
I0831 23:17:29.491401 1389847 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 in local cache directory, skipping pull
I0831 23:17:29.491405 1389847 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 exists in cache, skipping pull
I0831 23:17:29.491413 1389847 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 as a tarball
I0831 23:17:29.491418 1389847 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 from local cache
I0831 23:17:29.652141 1389847 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 from cached tarball
I0831 23:17:29.652174 1389847 cache.go:194] Successfully downloaded all kic artifacts
I0831 23:17:29.652217 1389847 start.go:360] acquireMachinesLock for embed-certs-642101: {Name:mk89ae457c6278bd9e003059d7535244d6329bfc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0831 23:17:29.653860 1389847 start.go:364] duration metric: took 1.615838ms to acquireMachinesLock for "embed-certs-642101"
I0831 23:17:29.653911 1389847 start.go:93] Provisioning new machine with config: &{Name:embed-certs-642101 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:embed-certs-642101 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableM
etrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0831 23:17:29.654014 1389847 start.go:125] createHost starting for "" (driver="docker")
I0831 23:17:27.478286 1378731 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0831 23:17:27.490816 1378731 api_server.go:72] duration metric: took 5m48.826929616s to wait for apiserver process to appear ...
I0831 23:17:27.490838 1378731 api_server.go:88] waiting for apiserver healthz status ...
I0831 23:17:27.490882 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0831 23:17:27.490938 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0831 23:17:27.569029 1378731 cri.go:89] found id: "2b314ddb4c1637e9a96260a3016921d4c647744eac2a23a86ba97ac80539955e"
I0831 23:17:27.569048 1378731 cri.go:89] found id: "24d2daafe86a0dcb6af4171206676787738fec4b49e748c8e217d63f6af8bb12"
I0831 23:17:27.569053 1378731 cri.go:89] found id: ""
I0831 23:17:27.569060 1378731 logs.go:276] 2 containers: [2b314ddb4c1637e9a96260a3016921d4c647744eac2a23a86ba97ac80539955e 24d2daafe86a0dcb6af4171206676787738fec4b49e748c8e217d63f6af8bb12]
I0831 23:17:27.569113 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.573327 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.577199 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0831 23:17:27.577262 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0831 23:17:27.626986 1378731 cri.go:89] found id: "adc270d3e8398b7a86ff787dfd6fa155a7deeb47c29d94cf0371e7f3af2cf66a"
I0831 23:17:27.627004 1378731 cri.go:89] found id: "36189b23eed4dd70cc8796dc64533ece0f97c8515188d9c4bb6817079cf848fa"
I0831 23:17:27.627009 1378731 cri.go:89] found id: ""
I0831 23:17:27.627017 1378731 logs.go:276] 2 containers: [adc270d3e8398b7a86ff787dfd6fa155a7deeb47c29d94cf0371e7f3af2cf66a 36189b23eed4dd70cc8796dc64533ece0f97c8515188d9c4bb6817079cf848fa]
I0831 23:17:27.627071 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.631361 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.635643 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0831 23:17:27.635706 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0831 23:17:27.683136 1378731 cri.go:89] found id: "83c393cb9b979e9591d3e9004c20ad7a85c3cf5a2fb01002fa02cdd21598c0ee"
I0831 23:17:27.683156 1378731 cri.go:89] found id: "26aa1d510c36cb526536c021669ae3f5436cdad4f0a6f9c30b4b361249af6077"
I0831 23:17:27.683160 1378731 cri.go:89] found id: ""
I0831 23:17:27.683167 1378731 logs.go:276] 2 containers: [83c393cb9b979e9591d3e9004c20ad7a85c3cf5a2fb01002fa02cdd21598c0ee 26aa1d510c36cb526536c021669ae3f5436cdad4f0a6f9c30b4b361249af6077]
I0831 23:17:27.683221 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.687219 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.692442 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0831 23:17:27.692509 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0831 23:17:27.789373 1378731 cri.go:89] found id: "f3564f974c7c186a4cf3110fbdf83d7607a54cbd7d58484326748df57213e666"
I0831 23:17:27.789445 1378731 cri.go:89] found id: "cb403497717362a835119a12fcd9a98f048e1513652343987c5706732ded954d"
I0831 23:17:27.789465 1378731 cri.go:89] found id: ""
I0831 23:17:27.789493 1378731 logs.go:276] 2 containers: [f3564f974c7c186a4cf3110fbdf83d7607a54cbd7d58484326748df57213e666 cb403497717362a835119a12fcd9a98f048e1513652343987c5706732ded954d]
I0831 23:17:27.789562 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.799289 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.803458 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0831 23:17:27.803580 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0831 23:17:27.870602 1378731 cri.go:89] found id: "a630dbfa8aa905e5ea3326c49649056da78bba5cfd2beda22ff0f2f93515a197"
I0831 23:17:27.870624 1378731 cri.go:89] found id: "375dfe16bc1a3f88bb1adae552829f1de1f6ccd7a3b2bf3eb9e823c85daa3329"
I0831 23:17:27.870629 1378731 cri.go:89] found id: ""
I0831 23:17:27.870636 1378731 logs.go:276] 2 containers: [a630dbfa8aa905e5ea3326c49649056da78bba5cfd2beda22ff0f2f93515a197 375dfe16bc1a3f88bb1adae552829f1de1f6ccd7a3b2bf3eb9e823c85daa3329]
I0831 23:17:27.870694 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.874793 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.878737 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0831 23:17:27.878804 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0831 23:17:27.960687 1378731 cri.go:89] found id: "2ba9272459fbd3d5920c42ffd67f3fc7be523ddb8abd1b3e2f8db38f6db5a2bd"
I0831 23:17:27.960708 1378731 cri.go:89] found id: "4a53de8c7cfef15e1b4d2eb2d08e3992e87a5d45cb56ec1579cce90b650a86a3"
I0831 23:17:27.960713 1378731 cri.go:89] found id: ""
I0831 23:17:27.960720 1378731 logs.go:276] 2 containers: [2ba9272459fbd3d5920c42ffd67f3fc7be523ddb8abd1b3e2f8db38f6db5a2bd 4a53de8c7cfef15e1b4d2eb2d08e3992e87a5d45cb56ec1579cce90b650a86a3]
I0831 23:17:27.960779 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.964573 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:27.969609 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0831 23:17:27.969674 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0831 23:17:28.029658 1378731 cri.go:89] found id: "e7bba7657fd955c1b7ffaed6f8954f4add6c68cbbebb5450b878b68fecc3dfd4"
I0831 23:17:28.029682 1378731 cri.go:89] found id: "0ddaf9925b5b8a2498baf923aedda0b04394c82cc0c7c18555b7233ea40ba24c"
I0831 23:17:28.029689 1378731 cri.go:89] found id: ""
I0831 23:17:28.029696 1378731 logs.go:276] 2 containers: [e7bba7657fd955c1b7ffaed6f8954f4add6c68cbbebb5450b878b68fecc3dfd4 0ddaf9925b5b8a2498baf923aedda0b04394c82cc0c7c18555b7233ea40ba24c]
I0831 23:17:28.029760 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:28.034482 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:28.039042 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0831 23:17:28.039128 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0831 23:17:28.089883 1378731 cri.go:89] found id: "3a128b2ebef5226632792617aecdd7d9fa214ff983a449971d7ccdfab3a99f21"
I0831 23:17:28.089909 1378731 cri.go:89] found id: ""
I0831 23:17:28.089923 1378731 logs.go:276] 1 containers: [3a128b2ebef5226632792617aecdd7d9fa214ff983a449971d7ccdfab3a99f21]
I0831 23:17:28.090037 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:28.094024 1378731 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0831 23:17:28.094139 1378731 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0831 23:17:28.148204 1378731 cri.go:89] found id: "f7e4d956562c970c31e64420c5803c72175a04dd6fcef52066a3ece0a6233f9f"
I0831 23:17:28.148263 1378731 cri.go:89] found id: "a7e7bee1e72395c1a5b201c2a16ae1e8c0725a75e13db42a8afd0bd7b61f1a6b"
I0831 23:17:28.148292 1378731 cri.go:89] found id: ""
I0831 23:17:28.148313 1378731 logs.go:276] 2 containers: [f7e4d956562c970c31e64420c5803c72175a04dd6fcef52066a3ece0a6233f9f a7e7bee1e72395c1a5b201c2a16ae1e8c0725a75e13db42a8afd0bd7b61f1a6b]
I0831 23:17:28.148397 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:28.153035 1378731 ssh_runner.go:195] Run: which crictl
I0831 23:17:28.157041 1378731 logs.go:123] Gathering logs for etcd [36189b23eed4dd70cc8796dc64533ece0f97c8515188d9c4bb6817079cf848fa] ...
I0831 23:17:28.157118 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 36189b23eed4dd70cc8796dc64533ece0f97c8515188d9c4bb6817079cf848fa"
I0831 23:17:28.219799 1378731 logs.go:123] Gathering logs for containerd ...
I0831 23:17:28.219874 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0831 23:17:28.289711 1378731 logs.go:123] Gathering logs for etcd [adc270d3e8398b7a86ff787dfd6fa155a7deeb47c29d94cf0371e7f3af2cf66a] ...
I0831 23:17:28.289790 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 adc270d3e8398b7a86ff787dfd6fa155a7deeb47c29d94cf0371e7f3af2cf66a"
I0831 23:17:28.344442 1378731 logs.go:123] Gathering logs for kube-controller-manager [4a53de8c7cfef15e1b4d2eb2d08e3992e87a5d45cb56ec1579cce90b650a86a3] ...
I0831 23:17:28.344473 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4a53de8c7cfef15e1b4d2eb2d08e3992e87a5d45cb56ec1579cce90b650a86a3"
I0831 23:17:28.417370 1378731 logs.go:123] Gathering logs for kubernetes-dashboard [3a128b2ebef5226632792617aecdd7d9fa214ff983a449971d7ccdfab3a99f21] ...
I0831 23:17:28.417462 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3a128b2ebef5226632792617aecdd7d9fa214ff983a449971d7ccdfab3a99f21"
I0831 23:17:28.475114 1378731 logs.go:123] Gathering logs for container status ...
I0831 23:17:28.475141 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0831 23:17:28.555107 1378731 logs.go:123] Gathering logs for kube-apiserver [2b314ddb4c1637e9a96260a3016921d4c647744eac2a23a86ba97ac80539955e] ...
I0831 23:17:28.555136 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2b314ddb4c1637e9a96260a3016921d4c647744eac2a23a86ba97ac80539955e"
I0831 23:17:28.652948 1378731 logs.go:123] Gathering logs for coredns [26aa1d510c36cb526536c021669ae3f5436cdad4f0a6f9c30b4b361249af6077] ...
I0831 23:17:28.653044 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 26aa1d510c36cb526536c021669ae3f5436cdad4f0a6f9c30b4b361249af6077"
I0831 23:17:28.718275 1378731 logs.go:123] Gathering logs for kube-scheduler [cb403497717362a835119a12fcd9a98f048e1513652343987c5706732ded954d] ...
I0831 23:17:28.718299 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cb403497717362a835119a12fcd9a98f048e1513652343987c5706732ded954d"
I0831 23:17:28.776545 1378731 logs.go:123] Gathering logs for kube-proxy [a630dbfa8aa905e5ea3326c49649056da78bba5cfd2beda22ff0f2f93515a197] ...
I0831 23:17:28.776572 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a630dbfa8aa905e5ea3326c49649056da78bba5cfd2beda22ff0f2f93515a197"
I0831 23:17:28.830806 1378731 logs.go:123] Gathering logs for kube-proxy [375dfe16bc1a3f88bb1adae552829f1de1f6ccd7a3b2bf3eb9e823c85daa3329] ...
I0831 23:17:28.830831 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 375dfe16bc1a3f88bb1adae552829f1de1f6ccd7a3b2bf3eb9e823c85daa3329"
I0831 23:17:28.953408 1378731 logs.go:123] Gathering logs for kube-controller-manager [2ba9272459fbd3d5920c42ffd67f3fc7be523ddb8abd1b3e2f8db38f6db5a2bd] ...
I0831 23:17:28.953438 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2ba9272459fbd3d5920c42ffd67f3fc7be523ddb8abd1b3e2f8db38f6db5a2bd"
I0831 23:17:29.052029 1378731 logs.go:123] Gathering logs for kindnet [e7bba7657fd955c1b7ffaed6f8954f4add6c68cbbebb5450b878b68fecc3dfd4] ...
I0831 23:17:29.052112 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e7bba7657fd955c1b7ffaed6f8954f4add6c68cbbebb5450b878b68fecc3dfd4"
I0831 23:17:29.132067 1378731 logs.go:123] Gathering logs for kubelet ...
I0831 23:17:29.132142 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0831 23:17:29.205613 1378731 logs.go:138] Found kubelet problem: Aug 31 23:11:59 old-k8s-version-777320 kubelet[661]: E0831 23:11:59.886301 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0831 23:17:29.206125 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:00 old-k8s-version-777320 kubelet[661]: E0831 23:12:00.799346 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.209084 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:16 old-k8s-version-777320 kubelet[661]: E0831 23:12:16.573045 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0831 23:17:29.211702 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:28 old-k8s-version-777320 kubelet[661]: E0831 23:12:28.934864 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.212063 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:29 old-k8s-version-777320 kubelet[661]: E0831 23:12:29.938937 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.212274 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:30 old-k8s-version-777320 kubelet[661]: E0831 23:12:30.563156 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.212793 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:30 old-k8s-version-777320 kubelet[661]: E0831 23:12:30.944101 661 pod_workers.go:191] Error syncing pod a63ab31c-0052-473f-8538-7ccd4026e42f ("storage-provisioner_kube-system(a63ab31c-0052-473f-8538-7ccd4026e42f)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(a63ab31c-0052-473f-8538-7ccd4026e42f)"
W0831 23:17:29.213242 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:35 old-k8s-version-777320 kubelet[661]: E0831 23:12:35.100827 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.216103 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:41 old-k8s-version-777320 kubelet[661]: E0831 23:12:41.565180 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0831 23:17:29.216741 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:50 old-k8s-version-777320 kubelet[661]: E0831 23:12:50.005945 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.217085 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:53 old-k8s-version-777320 kubelet[661]: E0831 23:12:53.558398 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.217442 1378731 logs.go:138] Found kubelet problem: Aug 31 23:12:55 old-k8s-version-777320 kubelet[661]: E0831 23:12:55.108037 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.217651 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:06 old-k8s-version-777320 kubelet[661]: E0831 23:13:06.558380 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.218006 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:07 old-k8s-version-777320 kubelet[661]: E0831 23:13:07.557412 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.218346 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:19 old-k8s-version-777320 kubelet[661]: E0831 23:13:19.558459 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.218826 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:20 old-k8s-version-777320 kubelet[661]: E0831 23:13:20.098381 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.219254 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:25 old-k8s-version-777320 kubelet[661]: E0831 23:13:25.100789 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.221881 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:31 old-k8s-version-777320 kubelet[661]: E0831 23:13:31.566325 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0831 23:17:29.222317 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:39 old-k8s-version-777320 kubelet[661]: E0831 23:13:39.557527 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.222567 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:46 old-k8s-version-777320 kubelet[661]: E0831 23:13:46.576899 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.222999 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:51 old-k8s-version-777320 kubelet[661]: E0831 23:13:51.557404 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.223228 1378731 logs.go:138] Found kubelet problem: Aug 31 23:13:59 old-k8s-version-777320 kubelet[661]: E0831 23:13:59.557798 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.223904 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:06 old-k8s-version-777320 kubelet[661]: E0831 23:14:06.253495 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.224132 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:12 old-k8s-version-777320 kubelet[661]: E0831 23:14:12.562241 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.224600 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:15 old-k8s-version-777320 kubelet[661]: E0831 23:14:15.101214 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.224848 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:23 old-k8s-version-777320 kubelet[661]: E0831 23:14:23.557778 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.225290 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:29 old-k8s-version-777320 kubelet[661]: E0831 23:14:29.557518 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.225554 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:36 old-k8s-version-777320 kubelet[661]: E0831 23:14:36.558367 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.226034 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:44 old-k8s-version-777320 kubelet[661]: E0831 23:14:44.558217 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.226519 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:47 old-k8s-version-777320 kubelet[661]: E0831 23:14:47.557763 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.227154 1378731 logs.go:138] Found kubelet problem: Aug 31 23:14:58 old-k8s-version-777320 kubelet[661]: E0831 23:14:58.571753 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.230275 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:02 old-k8s-version-777320 kubelet[661]: E0831 23:15:02.567140 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0831 23:17:29.230707 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:13 old-k8s-version-777320 kubelet[661]: E0831 23:15:13.557443 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.230980 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:15 old-k8s-version-777320 kubelet[661]: E0831 23:15:15.557843 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.231342 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:27 old-k8s-version-777320 kubelet[661]: E0831 23:15:27.558332 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.231835 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:28 old-k8s-version-777320 kubelet[661]: E0831 23:15:28.485753 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.232186 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:35 old-k8s-version-777320 kubelet[661]: E0831 23:15:35.101354 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.232406 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:41 old-k8s-version-777320 kubelet[661]: E0831 23:15:41.558221 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.232779 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:46 old-k8s-version-777320 kubelet[661]: E0831 23:15:46.558727 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.233028 1378731 logs.go:138] Found kubelet problem: Aug 31 23:15:52 old-k8s-version-777320 kubelet[661]: E0831 23:15:52.560966 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.233399 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:00 old-k8s-version-777320 kubelet[661]: E0831 23:16:00.559529 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.233620 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:04 old-k8s-version-777320 kubelet[661]: E0831 23:16:04.557871 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.233986 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:12 old-k8s-version-777320 kubelet[661]: E0831 23:16:12.558116 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.234213 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:17 old-k8s-version-777320 kubelet[661]: E0831 23:16:17.558685 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.234579 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:26 old-k8s-version-777320 kubelet[661]: E0831 23:16:26.559804 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.234813 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:30 old-k8s-version-777320 kubelet[661]: E0831 23:16:30.558289 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.235197 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:37 old-k8s-version-777320 kubelet[661]: E0831 23:16:37.557945 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.235435 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:45 old-k8s-version-777320 kubelet[661]: E0831 23:16:45.557768 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.235812 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:50 old-k8s-version-777320 kubelet[661]: E0831 23:16:50.558846 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.236045 1378731 logs.go:138] Found kubelet problem: Aug 31 23:16:58 old-k8s-version-777320 kubelet[661]: E0831 23:16:58.561819 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.236417 1378731 logs.go:138] Found kubelet problem: Aug 31 23:17:02 old-k8s-version-777320 kubelet[661]: E0831 23:17:02.558100 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.236650 1378731 logs.go:138] Found kubelet problem: Aug 31 23:17:09 old-k8s-version-777320 kubelet[661]: E0831 23:17:09.557874 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.237021 1378731 logs.go:138] Found kubelet problem: Aug 31 23:17:17 old-k8s-version-777320 kubelet[661]: E0831 23:17:17.557481 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.237248 1378731 logs.go:138] Found kubelet problem: Aug 31 23:17:24 old-k8s-version-777320 kubelet[661]: E0831 23:17:24.557898 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0831 23:17:29.237274 1378731 logs.go:123] Gathering logs for dmesg ...
I0831 23:17:29.237305 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0831 23:17:29.257013 1378731 logs.go:123] Gathering logs for describe nodes ...
I0831 23:17:29.257041 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0831 23:17:29.448128 1378731 logs.go:123] Gathering logs for kube-apiserver [24d2daafe86a0dcb6af4171206676787738fec4b49e748c8e217d63f6af8bb12] ...
I0831 23:17:29.448212 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 24d2daafe86a0dcb6af4171206676787738fec4b49e748c8e217d63f6af8bb12"
I0831 23:17:29.539734 1378731 logs.go:123] Gathering logs for coredns [83c393cb9b979e9591d3e9004c20ad7a85c3cf5a2fb01002fa02cdd21598c0ee] ...
I0831 23:17:29.539770 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 83c393cb9b979e9591d3e9004c20ad7a85c3cf5a2fb01002fa02cdd21598c0ee"
I0831 23:17:29.591574 1378731 logs.go:123] Gathering logs for kube-scheduler [f3564f974c7c186a4cf3110fbdf83d7607a54cbd7d58484326748df57213e666] ...
I0831 23:17:29.591602 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f3564f974c7c186a4cf3110fbdf83d7607a54cbd7d58484326748df57213e666"
I0831 23:17:29.658215 1378731 logs.go:123] Gathering logs for kindnet [0ddaf9925b5b8a2498baf923aedda0b04394c82cc0c7c18555b7233ea40ba24c] ...
I0831 23:17:29.658241 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0ddaf9925b5b8a2498baf923aedda0b04394c82cc0c7c18555b7233ea40ba24c"
I0831 23:17:29.717457 1378731 logs.go:123] Gathering logs for storage-provisioner [f7e4d956562c970c31e64420c5803c72175a04dd6fcef52066a3ece0a6233f9f] ...
I0831 23:17:29.717478 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f7e4d956562c970c31e64420c5803c72175a04dd6fcef52066a3ece0a6233f9f"
I0831 23:17:29.781489 1378731 logs.go:123] Gathering logs for storage-provisioner [a7e7bee1e72395c1a5b201c2a16ae1e8c0725a75e13db42a8afd0bd7b61f1a6b] ...
I0831 23:17:29.781520 1378731 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a7e7bee1e72395c1a5b201c2a16ae1e8c0725a75e13db42a8afd0bd7b61f1a6b"
I0831 23:17:29.848601 1378731 out.go:358] Setting ErrFile to fd 2...
I0831 23:17:29.848638 1378731 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0831 23:17:29.848687 1378731 out.go:270] X Problems detected in kubelet:
W0831 23:17:29.848702 1378731 out.go:270] Aug 31 23:16:58 old-k8s-version-777320 kubelet[661]: E0831 23:16:58.561819 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.848708 1378731 out.go:270] Aug 31 23:17:02 old-k8s-version-777320 kubelet[661]: E0831 23:17:02.558100 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.848719 1378731 out.go:270] Aug 31 23:17:09 old-k8s-version-777320 kubelet[661]: E0831 23:17:09.557874 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0831 23:17:29.848725 1378731 out.go:270] Aug 31 23:17:17 old-k8s-version-777320 kubelet[661]: E0831 23:17:17.557481 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
W0831 23:17:29.848731 1378731 out.go:270] Aug 31 23:17:24 old-k8s-version-777320 kubelet[661]: E0831 23:17:24.557898 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0831 23:17:29.848742 1378731 out.go:358] Setting ErrFile to fd 2...
I0831 23:17:29.848748 1378731 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0831 23:17:29.656572 1389847 out.go:235] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0831 23:17:29.656896 1389847 start.go:159] libmachine.API.Create for "embed-certs-642101" (driver="docker")
I0831 23:17:29.656931 1389847 client.go:168] LocalClient.Create starting
I0831 23:17:29.657003 1389847 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18943-1161402/.minikube/certs/ca.pem
I0831 23:17:29.657036 1389847 main.go:141] libmachine: Decoding PEM data...
I0831 23:17:29.657054 1389847 main.go:141] libmachine: Parsing certificate...
I0831 23:17:29.657113 1389847 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18943-1161402/.minikube/certs/cert.pem
I0831 23:17:29.657133 1389847 main.go:141] libmachine: Decoding PEM data...
I0831 23:17:29.657143 1389847 main.go:141] libmachine: Parsing certificate...
I0831 23:17:29.657584 1389847 cli_runner.go:164] Run: docker network inspect embed-certs-642101 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0831 23:17:29.676805 1389847 cli_runner.go:211] docker network inspect embed-certs-642101 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0831 23:17:29.676903 1389847 network_create.go:284] running [docker network inspect embed-certs-642101] to gather additional debugging logs...
I0831 23:17:29.676921 1389847 cli_runner.go:164] Run: docker network inspect embed-certs-642101
W0831 23:17:29.691275 1389847 cli_runner.go:211] docker network inspect embed-certs-642101 returned with exit code 1
I0831 23:17:29.691317 1389847 network_create.go:287] error running [docker network inspect embed-certs-642101]: docker network inspect embed-certs-642101: exit status 1
stdout:
[]
stderr:
Error response from daemon: network embed-certs-642101 not found
I0831 23:17:29.691332 1389847 network_create.go:289] output of [docker network inspect embed-certs-642101]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network embed-certs-642101 not found
** /stderr **
I0831 23:17:29.691475 1389847 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0831 23:17:29.715432 1389847 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-180241d62096 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:0a:e1:60:90} reservation:<nil>}
I0831 23:17:29.715862 1389847 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-12d09e5d3a70 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:0e:d7:4f:4e} reservation:<nil>}
I0831 23:17:29.716277 1389847 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-884799888d32 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:df:89:a0:61} reservation:<nil>}
I0831 23:17:29.716836 1389847 network.go:206] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40018e8780}
I0831 23:17:29.716857 1389847 network_create.go:124] attempt to create docker network embed-certs-642101 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I0831 23:17:29.716921 1389847 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-642101 embed-certs-642101
I0831 23:17:29.808542 1389847 network_create.go:108] docker network embed-certs-642101 192.168.76.0/24 created
I0831 23:17:29.808572 1389847 kic.go:121] calculated static IP "192.168.76.2" for the "embed-certs-642101" container
I0831 23:17:29.808927 1389847 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0831 23:17:29.843585 1389847 cli_runner.go:164] Run: docker volume create embed-certs-642101 --label name.minikube.sigs.k8s.io=embed-certs-642101 --label created_by.minikube.sigs.k8s.io=true
I0831 23:17:29.863085 1389847 oci.go:103] Successfully created a docker volume embed-certs-642101
I0831 23:17:29.863172 1389847 cli_runner.go:164] Run: docker run --rm --name embed-certs-642101-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-642101 --entrypoint /usr/bin/test -v embed-certs-642101:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 -d /var/lib
I0831 23:17:30.546493 1389847 oci.go:107] Successfully prepared a docker volume embed-certs-642101
I0831 23:17:30.546576 1389847 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0831 23:17:30.546601 1389847 kic.go:194] Starting extracting preloaded images to volume ...
I0831 23:17:30.546686 1389847 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/18943-1161402/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-642101:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 -I lz4 -xf /preloaded.tar -C /extractDir
I0831 23:17:35.174991 1389847 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/18943-1161402/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-642101:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 -I lz4 -xf /preloaded.tar -C /extractDir: (4.628265716s)
I0831 23:17:35.175024 1389847 kic.go:203] duration metric: took 4.628418396s to extract preloaded images to volume ...
W0831 23:17:35.175174 1389847 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0831 23:17:35.175296 1389847 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0831 23:17:35.232048 1389847 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-642101 --name embed-certs-642101 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-642101 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-642101 --network embed-certs-642101 --ip 192.168.76.2 --volume embed-certs-642101:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0
I0831 23:17:35.625717 1389847 cli_runner.go:164] Run: docker container inspect embed-certs-642101 --format={{.State.Running}}
I0831 23:17:35.645201 1389847 cli_runner.go:164] Run: docker container inspect embed-certs-642101 --format={{.State.Status}}
I0831 23:17:35.665213 1389847 cli_runner.go:164] Run: docker exec embed-certs-642101 stat /var/lib/dpkg/alternatives/iptables
I0831 23:17:35.738161 1389847 oci.go:144] the created container "embed-certs-642101" has a running status.
I0831 23:17:35.738192 1389847 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/18943-1161402/.minikube/machines/embed-certs-642101/id_rsa...
I0831 23:17:36.441543 1389847 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/18943-1161402/.minikube/machines/embed-certs-642101/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0831 23:17:36.464802 1389847 cli_runner.go:164] Run: docker container inspect embed-certs-642101 --format={{.State.Status}}
I0831 23:17:36.482393 1389847 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0831 23:17:36.482426 1389847 kic_runner.go:114] Args: [docker exec --privileged embed-certs-642101 chown docker:docker /home/docker/.ssh/authorized_keys]
I0831 23:17:36.540094 1389847 cli_runner.go:164] Run: docker container inspect embed-certs-642101 --format={{.State.Status}}
I0831 23:17:36.580561 1389847 machine.go:93] provisionDockerMachine start ...
I0831 23:17:36.580660 1389847 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-642101
I0831 23:17:36.599422 1389847 main.go:141] libmachine: Using SSH client type: native
I0831 23:17:36.600025 1389847 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 34579 <nil> <nil>}
I0831 23:17:36.600060 1389847 main.go:141] libmachine: About to run SSH command:
hostname
I0831 23:17:36.745648 1389847 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-642101
I0831 23:17:36.745675 1389847 ubuntu.go:169] provisioning hostname "embed-certs-642101"
I0831 23:17:36.745740 1389847 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-642101
I0831 23:17:36.765411 1389847 main.go:141] libmachine: Using SSH client type: native
I0831 23:17:36.765662 1389847 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 34579 <nil> <nil>}
I0831 23:17:36.765674 1389847 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-642101 && echo "embed-certs-642101" | sudo tee /etc/hostname
I0831 23:17:36.934910 1389847 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-642101
I0831 23:17:36.934992 1389847 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-642101
I0831 23:17:36.958333 1389847 main.go:141] libmachine: Using SSH client type: native
I0831 23:17:36.958619 1389847 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 34579 <nil> <nil>}
I0831 23:17:36.958646 1389847 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-642101' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-642101/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-642101' | sudo tee -a /etc/hosts;
fi
fi
I0831 23:17:37.136887 1389847 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0831 23:17:37.136916 1389847 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18943-1161402/.minikube CaCertPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18943-1161402/.minikube}
I0831 23:17:37.136955 1389847 ubuntu.go:177] setting up certificates
I0831 23:17:37.136964 1389847 provision.go:84] configureAuth start
I0831 23:17:37.137034 1389847 cli_runner.go:164] Run: docker container inspect -f "{{with (index .NetworkSettings.Networks "embed-certs-642101")}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-642101
I0831 23:17:37.161563 1389847 provision.go:143] copyHostCerts
I0831 23:17:37.161633 1389847 exec_runner.go:144] found /home/jenkins/minikube-integration/18943-1161402/.minikube/ca.pem, removing ...
I0831 23:17:37.161647 1389847 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18943-1161402/.minikube/ca.pem
I0831 23:17:37.161715 1389847 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18943-1161402/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18943-1161402/.minikube/ca.pem (1078 bytes)
I0831 23:17:37.161804 1389847 exec_runner.go:144] found /home/jenkins/minikube-integration/18943-1161402/.minikube/cert.pem, removing ...
I0831 23:17:37.161815 1389847 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18943-1161402/.minikube/cert.pem
I0831 23:17:37.161841 1389847 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18943-1161402/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18943-1161402/.minikube/cert.pem (1123 bytes)
I0831 23:17:37.161910 1389847 exec_runner.go:144] found /home/jenkins/minikube-integration/18943-1161402/.minikube/key.pem, removing ...
I0831 23:17:37.161918 1389847 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18943-1161402/.minikube/key.pem
I0831 23:17:37.161944 1389847 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18943-1161402/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18943-1161402/.minikube/key.pem (1679 bytes)
I0831 23:17:37.162004 1389847 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18943-1161402/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18943-1161402/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18943-1161402/.minikube/certs/ca-key.pem org=jenkins.embed-certs-642101 san=[127.0.0.1 192.168.76.2 embed-certs-642101 localhost minikube]
I0831 23:17:37.863643 1389847 provision.go:177] copyRemoteCerts
I0831 23:17:37.863727 1389847 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0831 23:17:37.863772 1389847 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-642101
I0831 23:17:37.880725 1389847 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34579 SSHKeyPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/machines/embed-certs-642101/id_rsa Username:docker}
I0831 23:17:37.978357 1389847 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18943-1161402/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0831 23:17:38.005396 1389847 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18943-1161402/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
I0831 23:17:38.047384 1389847 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18943-1161402/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0831 23:17:38.078132 1389847 provision.go:87] duration metric: took 941.148253ms to configureAuth
I0831 23:17:38.078161 1389847 ubuntu.go:193] setting minikube options for container-runtime
I0831 23:17:38.078363 1389847 config.go:182] Loaded profile config "embed-certs-642101": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0831 23:17:38.078372 1389847 machine.go:96] duration metric: took 1.497790823s to provisionDockerMachine
I0831 23:17:38.078379 1389847 client.go:171] duration metric: took 8.42144202s to LocalClient.Create
I0831 23:17:38.078402 1389847 start.go:167] duration metric: took 8.421507686s to libmachine.API.Create "embed-certs-642101"
I0831 23:17:38.078412 1389847 start.go:293] postStartSetup for "embed-certs-642101" (driver="docker")
I0831 23:17:38.078422 1389847 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0831 23:17:38.078478 1389847 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0831 23:17:38.078521 1389847 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-642101
I0831 23:17:38.097216 1389847 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34579 SSHKeyPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/machines/embed-certs-642101/id_rsa Username:docker}
I0831 23:17:38.194416 1389847 ssh_runner.go:195] Run: cat /etc/os-release
I0831 23:17:38.197946 1389847 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0831 23:17:38.198001 1389847 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0831 23:17:38.198020 1389847 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0831 23:17:38.198028 1389847 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0831 23:17:38.198041 1389847 filesync.go:126] Scanning /home/jenkins/minikube-integration/18943-1161402/.minikube/addons for local assets ...
I0831 23:17:38.198108 1389847 filesync.go:126] Scanning /home/jenkins/minikube-integration/18943-1161402/.minikube/files for local assets ...
I0831 23:17:38.198195 1389847 filesync.go:149] local asset: /home/jenkins/minikube-integration/18943-1161402/.minikube/files/etc/ssl/certs/11667852.pem -> 11667852.pem in /etc/ssl/certs
I0831 23:17:38.198303 1389847 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0831 23:17:38.207736 1389847 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18943-1161402/.minikube/files/etc/ssl/certs/11667852.pem --> /etc/ssl/certs/11667852.pem (1708 bytes)
I0831 23:17:38.234865 1389847 start.go:296] duration metric: took 156.439001ms for postStartSetup
I0831 23:17:38.235254 1389847 cli_runner.go:164] Run: docker container inspect -f "{{with (index .NetworkSettings.Networks "embed-certs-642101")}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-642101
I0831 23:17:38.252094 1389847 profile.go:143] Saving config to /home/jenkins/minikube-integration/18943-1161402/.minikube/profiles/embed-certs-642101/config.json ...
I0831 23:17:38.252682 1389847 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0831 23:17:38.252739 1389847 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-642101
I0831 23:17:38.269397 1389847 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34579 SSHKeyPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/machines/embed-certs-642101/id_rsa Username:docker}
I0831 23:17:38.361813 1389847 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0831 23:17:38.366384 1389847 start.go:128] duration metric: took 8.71235102s to createHost
I0831 23:17:38.366408 1389847 start.go:83] releasing machines lock for "embed-certs-642101", held for 8.712521703s
I0831 23:17:38.366478 1389847 cli_runner.go:164] Run: docker container inspect -f "{{with (index .NetworkSettings.Networks "embed-certs-642101")}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-642101
I0831 23:17:38.384055 1389847 ssh_runner.go:195] Run: cat /version.json
I0831 23:17:38.384117 1389847 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-642101
I0831 23:17:38.384445 1389847 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0831 23:17:38.384501 1389847 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-642101
I0831 23:17:38.404672 1389847 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34579 SSHKeyPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/machines/embed-certs-642101/id_rsa Username:docker}
I0831 23:17:38.414498 1389847 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34579 SSHKeyPath:/home/jenkins/minikube-integration/18943-1161402/.minikube/machines/embed-certs-642101/id_rsa Username:docker}
I0831 23:17:38.496120 1389847 ssh_runner.go:195] Run: systemctl --version
I0831 23:17:38.628296 1389847 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0831 23:17:38.632544 1389847 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0831 23:17:38.658407 1389847 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0831 23:17:38.658486 1389847 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0831 23:17:38.688723 1389847 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0831 23:17:38.688749 1389847 start.go:495] detecting cgroup driver to use...
I0831 23:17:38.688782 1389847 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0831 23:17:38.688857 1389847 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0831 23:17:38.701220 1389847 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0831 23:17:38.712501 1389847 docker.go:217] disabling cri-docker service (if available) ...
I0831 23:17:38.712565 1389847 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0831 23:17:38.726520 1389847 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0831 23:17:38.741171 1389847 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0831 23:17:38.836585 1389847 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0831 23:17:38.934914 1389847 docker.go:233] disabling docker service ...
I0831 23:17:38.935014 1389847 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0831 23:17:38.957796 1389847 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0831 23:17:38.970666 1389847 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0831 23:17:39.095636 1389847 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0831 23:17:39.201131 1389847 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0831 23:17:39.213822 1389847 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0831 23:17:39.230984 1389847 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0831 23:17:39.242054 1389847 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0831 23:17:39.252649 1389847 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0831 23:17:39.252719 1389847 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0831 23:17:39.263746 1389847 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0831 23:17:39.274821 1389847 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0831 23:17:39.285173 1389847 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0831 23:17:39.295451 1389847 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0831 23:17:39.305998 1389847 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0831 23:17:39.315602 1389847 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0831 23:17:39.325212 1389847 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0831 23:17:39.335576 1389847 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0831 23:17:39.344101 1389847 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0831 23:17:39.352824 1389847 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0831 23:17:39.443291 1389847 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0831 23:17:39.587650 1389847 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0831 23:17:39.587792 1389847 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0831 23:17:39.591455 1389847 start.go:563] Will wait 60s for crictl version
I0831 23:17:39.591567 1389847 ssh_runner.go:195] Run: which crictl
I0831 23:17:39.594905 1389847 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0831 23:17:39.632378 1389847 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.21
RuntimeApiVersion: v1
I0831 23:17:39.632500 1389847 ssh_runner.go:195] Run: containerd --version
I0831 23:17:39.658853 1389847 ssh_runner.go:195] Run: containerd --version
I0831 23:17:39.686747 1389847 out.go:177] * Preparing Kubernetes v1.31.0 on containerd 1.7.21 ...
I0831 23:17:39.849201 1378731 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0831 23:17:39.865165 1378731 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0831 23:17:39.867576 1378731 out.go:201]
W0831 23:17:39.869895 1378731 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0831 23:17:39.870097 1378731 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0831 23:17:39.870173 1378731 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0831 23:17:39.870268 1378731 out.go:270] *
W0831 23:17:39.871923 1378731 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0831 23:17:39.874230 1378731 out.go:201]
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
c2de4a0a64d9d 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 7d62dde8e02e6 dashboard-metrics-scraper-8d5bb5db8-klp6x
f7e4d956562c9 ba04bb24b9575 4 minutes ago Running storage-provisioner 2 ef529c5ec9d62 storage-provisioner
3a128b2ebef52 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 42c2ce80f7590 kubernetes-dashboard-cd95d586-m6vqc
83c393cb9b979 db91994f4ee8f 5 minutes ago Running coredns 1 e2c8a901df77a coredns-74ff55c5b-9zjlw
7983f300cc438 1611cd07b61d5 5 minutes ago Running busybox 1 eb34053df2a01 busybox
a7e7bee1e7239 ba04bb24b9575 5 minutes ago Exited storage-provisioner 1 ef529c5ec9d62 storage-provisioner
a630dbfa8aa90 25a5233254979 5 minutes ago Running kube-proxy 1 75dbdd8273c83 kube-proxy-wv4m2
e7bba7657fd95 6a23fa8fd2b78 5 minutes ago Running kindnet-cni 1 5982b1f353096 kindnet-ww8r9
f3564f974c7c1 e7605f88f17d6 5 minutes ago Running kube-scheduler 1 a51d6cde483fe kube-scheduler-old-k8s-version-777320
2ba9272459fbd 1df8a2b116bd1 5 minutes ago Running kube-controller-manager 1 527cef79ab943 kube-controller-manager-old-k8s-version-777320
2b314ddb4c163 2c08bbbc02d3a 5 minutes ago Running kube-apiserver 1 8ec6592e666a5 kube-apiserver-old-k8s-version-777320
adc270d3e8398 05b738aa1bc63 5 minutes ago Running etcd 1 bb139b4e7bce4 etcd-old-k8s-version-777320
d193ce9f04406 1611cd07b61d5 6 minutes ago Exited busybox 0 5d450d668c301 busybox
26aa1d510c36c db91994f4ee8f 7 minutes ago Exited coredns 0 cb5b195b1ace9 coredns-74ff55c5b-9zjlw
0ddaf9925b5b8 6a23fa8fd2b78 8 minutes ago Exited kindnet-cni 0 e0407d6abf40e kindnet-ww8r9
375dfe16bc1a3 25a5233254979 8 minutes ago Exited kube-proxy 0 1148dc69eaa72 kube-proxy-wv4m2
36189b23eed4d 05b738aa1bc63 8 minutes ago Exited etcd 0 677bb9ccead83 etcd-old-k8s-version-777320
cb40349771736 e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 d095b9e73e8ea kube-scheduler-old-k8s-version-777320
4a53de8c7cfef 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 ff92a6a21a4a5 kube-controller-manager-old-k8s-version-777320
24d2daafe86a0 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 789f00d8ece98 kube-apiserver-old-k8s-version-777320
==> containerd <==
Aug 31 23:13:31 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:13:31.563236969Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" host=fake.domain
Aug 31 23:13:31 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:13:31.564975506Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Aug 31 23:13:31 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:13:31.565207095Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Aug 31 23:14:05 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:14:05.560995768Z" level=info msg="CreateContainer within sandbox \"7d62dde8e02e626042d9c3c4ad31065f17803d4060ee187321991ffb2e6780e4\" for container name:\"dashboard-metrics-scraper\" attempt:4"
Aug 31 23:14:05 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:14:05.583053548Z" level=info msg="CreateContainer within sandbox \"7d62dde8e02e626042d9c3c4ad31065f17803d4060ee187321991ffb2e6780e4\" for name:\"dashboard-metrics-scraper\" attempt:4 returns container id \"c861355db08d33725db8674fb1b5c327d86ab02d70cdbe92bfe91b8f02218ecc\""
Aug 31 23:14:05 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:14:05.584034246Z" level=info msg="StartContainer for \"c861355db08d33725db8674fb1b5c327d86ab02d70cdbe92bfe91b8f02218ecc\""
Aug 31 23:14:05 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:14:05.654258843Z" level=info msg="StartContainer for \"c861355db08d33725db8674fb1b5c327d86ab02d70cdbe92bfe91b8f02218ecc\" returns successfully"
Aug 31 23:14:05 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:14:05.681042561Z" level=info msg="shim disconnected" id=c861355db08d33725db8674fb1b5c327d86ab02d70cdbe92bfe91b8f02218ecc namespace=k8s.io
Aug 31 23:14:05 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:14:05.681108046Z" level=warning msg="cleaning up after shim disconnected" id=c861355db08d33725db8674fb1b5c327d86ab02d70cdbe92bfe91b8f02218ecc namespace=k8s.io
Aug 31 23:14:05 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:14:05.681118737Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 31 23:14:06 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:14:06.255220328Z" level=info msg="RemoveContainer for \"99aaa3d691aed3c094a3ee12a314c6eb163fd63cb1c632764d107c7a9fc1fef3\""
Aug 31 23:14:06 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:14:06.261705506Z" level=info msg="RemoveContainer for \"99aaa3d691aed3c094a3ee12a314c6eb163fd63cb1c632764d107c7a9fc1fef3\" returns successfully"
Aug 31 23:15:02 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:15:02.558633283Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 31 23:15:02 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:15:02.564722294Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" host=fake.domain
Aug 31 23:15:02 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:15:02.566704867Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Aug 31 23:15:02 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:15:02.566782717Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Aug 31 23:15:27 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:15:27.559759417Z" level=info msg="CreateContainer within sandbox \"7d62dde8e02e626042d9c3c4ad31065f17803d4060ee187321991ffb2e6780e4\" for container name:\"dashboard-metrics-scraper\" attempt:5"
Aug 31 23:15:27 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:15:27.579818936Z" level=info msg="CreateContainer within sandbox \"7d62dde8e02e626042d9c3c4ad31065f17803d4060ee187321991ffb2e6780e4\" for name:\"dashboard-metrics-scraper\" attempt:5 returns container id \"c2de4a0a64d9d9a0769c26950e0e4a346b6b730b12124485a252c62fde7e17ca\""
Aug 31 23:15:27 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:15:27.580715269Z" level=info msg="StartContainer for \"c2de4a0a64d9d9a0769c26950e0e4a346b6b730b12124485a252c62fde7e17ca\""
Aug 31 23:15:27 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:15:27.652958321Z" level=info msg="StartContainer for \"c2de4a0a64d9d9a0769c26950e0e4a346b6b730b12124485a252c62fde7e17ca\" returns successfully"
Aug 31 23:15:27 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:15:27.676008155Z" level=info msg="shim disconnected" id=c2de4a0a64d9d9a0769c26950e0e4a346b6b730b12124485a252c62fde7e17ca namespace=k8s.io
Aug 31 23:15:27 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:15:27.676065312Z" level=warning msg="cleaning up after shim disconnected" id=c2de4a0a64d9d9a0769c26950e0e4a346b6b730b12124485a252c62fde7e17ca namespace=k8s.io
Aug 31 23:15:27 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:15:27.676076832Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 31 23:15:28 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:15:28.492310823Z" level=info msg="RemoveContainer for \"c861355db08d33725db8674fb1b5c327d86ab02d70cdbe92bfe91b8f02218ecc\""
Aug 31 23:15:28 old-k8s-version-777320 containerd[570]: time="2024-08-31T23:15:28.497970707Z" level=info msg="RemoveContainer for \"c861355db08d33725db8674fb1b5c327d86ab02d70cdbe92bfe91b8f02218ecc\" returns successfully"
==> coredns [26aa1d510c36cb526536c021669ae3f5436cdad4f0a6f9c30b4b361249af6077] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:45805 - 31679 "HINFO IN 2404844539766162594.7152286968403205230. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.027017036s
==> coredns [83c393cb9b979e9591d3e9004c20ad7a85c3cf5a2fb01002fa02cdd21598c0ee] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:59626 - 24808 "HINFO IN 815135547465917707.4799201704170482130. udp 56 false 512" NXDOMAIN qr,rd,ra 56 0.014735862s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I0831 23:12:30.552542 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-08-31 23:12:00.551394242 +0000 UTC m=+0.038268959) (total time: 30.001051784s):
Trace[2019727887]: [30.001051784s] [30.001051784s] END
E0831 23:12:30.552581 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0831 23:12:30.553676 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-08-31 23:12:00.55317396 +0000 UTC m=+0.040048759) (total time: 30.000485116s):
Trace[939984059]: [30.000485116s] [30.000485116s] END
E0831 23:12:30.553690 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0831 23:12:30.554322 1 trace.go:116] Trace[1474941318]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-08-31 23:12:00.554011619 +0000 UTC m=+0.040886327) (total time: 30.000297384s):
Trace[1474941318]: [30.000297384s] [30.000297384s] END
E0831 23:12:30.554334 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> describe nodes <==
Name: old-k8s-version-777320
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-777320
kubernetes.io/os=linux
minikube.k8s.io/commit=8ab9a20c866aaad18bea6fac47c5d146303457d2
minikube.k8s.io/name=old-k8s-version-777320
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_08_31T23_09_15_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 31 Aug 2024 23:09:11 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-777320
AcquireTime: <unset>
RenewTime: Sat, 31 Aug 2024 23:17:41 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 31 Aug 2024 23:12:50 +0000 Sat, 31 Aug 2024 23:09:05 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 31 Aug 2024 23:12:50 +0000 Sat, 31 Aug 2024 23:09:05 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 31 Aug 2024 23:12:50 +0000 Sat, 31 Aug 2024 23:09:05 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sat, 31 Aug 2024 23:12:50 +0000 Sat, 31 Aug 2024 23:09:30 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.85.2
Hostname: old-k8s-version-777320
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022300Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022300Ki
pods: 110
System Info:
Machine ID: 98b5aab821e246fd90c4c728ddf20943
System UUID: 0346832c-168e-4caa-8b7a-9e1aa935440e
Boot ID: 844307fd-f17e-4b74-a327-71aead28c204
Kernel Version: 5.15.0-1068-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.21
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m36s
kube-system coredns-74ff55c5b-9zjlw 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 8m12s
kube-system etcd-old-k8s-version-777320 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 8m19s
kube-system kindnet-ww8r9 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 8m12s
kube-system kube-apiserver-old-k8s-version-777320 250m (12%) 0 (0%) 0 (0%) 0 (0%) 8m19s
kube-system kube-controller-manager-old-k8s-version-777320 200m (10%) 0 (0%) 0 (0%) 0 (0%) 8m19s
kube-system kube-proxy-wv4m2 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m12s
kube-system kube-scheduler-old-k8s-version-777320 100m (5%) 0 (0%) 0 (0%) 0 (0%) 8m19s
kube-system metrics-server-9975d5f86-dl7gj 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 6m25s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m11s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-klp6x 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m24s
kubernetes-dashboard kubernetes-dashboard-cd95d586-m6vqc 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m24s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%) 100m (5%)
memory 420Mi (5%) 220Mi (2%)
ephemeral-storage 100Mi (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m39s (x5 over 8m39s) kubelet Node old-k8s-version-777320 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m39s (x4 over 8m39s) kubelet Node old-k8s-version-777320 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m39s (x4 over 8m39s) kubelet Node old-k8s-version-777320 status is now: NodeHasSufficientPID
Normal Starting 8m20s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m20s kubelet Node old-k8s-version-777320 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m20s kubelet Node old-k8s-version-777320 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m20s kubelet Node old-k8s-version-777320 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m19s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m12s kubelet Node old-k8s-version-777320 status is now: NodeReady
Normal Starting 8m11s kube-proxy Starting kube-proxy.
Normal Starting 5m56s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 5m56s (x8 over 5m56s) kubelet Node old-k8s-version-777320 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m56s (x8 over 5m56s) kubelet Node old-k8s-version-777320 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m56s (x7 over 5m56s) kubelet Node old-k8s-version-777320 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 5m56s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m42s kube-proxy Starting kube-proxy.
==> dmesg <==
==> etcd [36189b23eed4dd70cc8796dc64533ece0f97c8515188d9c4bb6817079cf848fa] <==
raft2024/08/31 23:09:04 INFO: 9f0758e1c58a86ed is starting a new election at term 1
raft2024/08/31 23:09:04 INFO: 9f0758e1c58a86ed became candidate at term 2
raft2024/08/31 23:09:04 INFO: 9f0758e1c58a86ed received MsgVoteResp from 9f0758e1c58a86ed at term 2
raft2024/08/31 23:09:04 INFO: 9f0758e1c58a86ed became leader at term 2
raft2024/08/31 23:09:04 INFO: raft.node: 9f0758e1c58a86ed elected leader 9f0758e1c58a86ed at term 2
2024-08-31 23:09:04.995769 I | etcdserver: setting up the initial cluster version to 3.4
2024-08-31 23:09:04.996866 N | etcdserver/membership: set the initial cluster version to 3.4
2024-08-31 23:09:04.997200 I | etcdserver/api: enabled capabilities for version 3.4
2024-08-31 23:09:04.997407 I | etcdserver: published {Name:old-k8s-version-777320 ClientURLs:[https://192.168.85.2:2379]} to cluster 68eaea490fab4e05
2024-08-31 23:09:04.999528 I | embed: ready to serve client requests
2024-08-31 23:09:05.005080 I | embed: serving client requests on 192.168.85.2:2379
2024-08-31 23:09:05.005388 I | embed: ready to serve client requests
2024-08-31 23:09:05.006842 I | embed: serving client requests on 127.0.0.1:2379
2024-08-31 23:09:28.136003 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:09:32.138696 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:09:42.139131 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:09:52.138859 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:10:02.138957 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:10:12.138769 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:10:22.138792 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:10:32.138942 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:10:42.141051 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:10:52.138603 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:11:02.138836 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:11:12.138874 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [adc270d3e8398b7a86ff787dfd6fa155a7deeb47c29d94cf0371e7f3af2cf66a] <==
2024-08-31 23:13:39.693725 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:13:49.693055 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:13:59.693128 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:14:09.693251 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:14:19.693212 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:14:29.693185 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:14:39.693094 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:14:49.693143 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:14:59.693826 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:15:09.693270 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:15:19.693080 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:15:29.693115 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:15:39.693573 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:15:49.693151 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:15:59.692941 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:16:09.693323 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:16:19.694153 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:16:29.694322 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:16:39.693739 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:16:49.693219 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:16:59.694942 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:17:09.693739 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:17:19.693065 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:17:29.693217 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-31 23:17:39.693834 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
23:17:42 up 7:00, 0 users, load average: 2.00, 2.08, 2.51
Linux old-k8s-version-777320 5.15.0-1068-aws #74~20.04.1-Ubuntu SMP Tue Aug 6 19:45:17 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [0ddaf9925b5b8a2498baf923aedda0b04394c82cc0c7c18555b7233ea40ba24c] <==
I0831 23:09:33.908912 1 controller.go:338] Waiting for informer caches to sync
I0831 23:09:33.908919 1 shared_informer.go:313] Waiting for caches to sync for kube-network-policies
I0831 23:09:34.008983 1 shared_informer.go:320] Caches are synced for kube-network-policies
I0831 23:09:34.009016 1 metrics.go:61] Registering metrics
I0831 23:09:34.009067 1 controller.go:374] Syncing nftables rules
I0831 23:09:43.826036 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0831 23:09:43.826131 1 main.go:299] handling current node
I0831 23:09:53.826106 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0831 23:09:53.826147 1 main.go:299] handling current node
I0831 23:10:03.834728 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0831 23:10:03.834765 1 main.go:299] handling current node
I0831 23:10:13.833777 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0831 23:10:13.833813 1 main.go:299] handling current node
I0831 23:10:23.825734 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0831 23:10:23.825764 1 main.go:299] handling current node
I0831 23:10:33.825869 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0831 23:10:33.825905 1 main.go:299] handling current node
I0831 23:10:43.828705 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0831 23:10:43.828743 1 main.go:299] handling current node
I0831 23:10:53.826698 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0831 23:10:53.826739 1 main.go:299] handling current node
I0831 23:11:03.834529 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0831 23:11:03.834566 1 main.go:299] handling current node
I0831 23:11:13.825846 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0831 23:11:13.825884 1 main.go:299] handling current node
==> kindnet [e7bba7657fd955c1b7ffaed6f8954f4add6c68cbbebb5450b878b68fecc3dfd4] <==
I0831 23:15:41.012151 1 main.go:299] handling current node
I0831 23:15:51.016971 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0831 23:15:51.017011 1 main.go:299] handling current node
I0831 23:16:01.009417 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0831 23:16:01.009464 1 main.go:299] handling current node
I0831 23:16:11.009757 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0831 23:16:11.009803 1 main.go:299] handling current node
I0831 23:16:21.012984 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0831 23:16:21.013031 1 main.go:299] handling current node
I0831 23:16:31.018021 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0831 23:16:31.018060 1 main.go:299] handling current node
I0831 23:16:41.012804 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0831 23:16:41.012845 1 main.go:299] handling current node
I0831 23:16:51.018757 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0831 23:16:51.018802 1 main.go:299] handling current node
I0831 23:17:01.011102 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0831 23:17:01.014009 1 main.go:299] handling current node
I0831 23:17:11.016724 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0831 23:17:11.016768 1 main.go:299] handling current node
I0831 23:17:21.018220 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0831 23:17:21.018258 1 main.go:299] handling current node
I0831 23:17:31.018565 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0831 23:17:31.018613 1 main.go:299] handling current node
I0831 23:17:41.017080 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0831 23:17:41.017118 1 main.go:299] handling current node
==> kube-apiserver [24d2daafe86a0dcb6af4171206676787738fec4b49e748c8e217d63f6af8bb12] <==
I0831 23:09:12.248716 1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
I0831 23:09:12.248745 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I0831 23:09:12.273452 1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000
I0831 23:09:12.278465 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I0831 23:09:12.278490 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0831 23:09:12.845313 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0831 23:09:12.890725 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0831 23:09:12.957063 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.85.2]
I0831 23:09:12.958252 1 controller.go:606] quota admission added evaluator for: endpoints
I0831 23:09:12.962993 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0831 23:09:13.940135 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0831 23:09:14.410624 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0831 23:09:14.457825 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0831 23:09:22.954871 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0831 23:09:30.441890 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0831 23:09:30.523377 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0831 23:09:45.943686 1 client.go:360] parsed scheme: "passthrough"
I0831 23:09:45.943732 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0831 23:09:45.943902 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0831 23:10:21.408807 1 client.go:360] parsed scheme: "passthrough"
I0831 23:10:21.408855 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0831 23:10:21.408865 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0831 23:11:05.873851 1 client.go:360] parsed scheme: "passthrough"
I0831 23:11:05.873951 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0831 23:11:05.873980 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [2b314ddb4c1637e9a96260a3016921d4c647744eac2a23a86ba97ac80539955e] <==
I0831 23:14:16.629373 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0831 23:14:16.629381 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0831 23:14:51.248315 1 client.go:360] parsed scheme: "passthrough"
I0831 23:14:51.248549 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0831 23:14:51.248701 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0831 23:15:01.403862 1 handler_proxy.go:102] no RequestInfo found in the context
E0831 23:15:01.404119 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0831 23:15:01.404142 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0831 23:15:35.816519 1 client.go:360] parsed scheme: "passthrough"
I0831 23:15:35.816563 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0831 23:15:35.816572 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0831 23:16:09.495071 1 client.go:360] parsed scheme: "passthrough"
I0831 23:16:09.495127 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0831 23:16:09.495139 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0831 23:16:49.202937 1 client.go:360] parsed scheme: "passthrough"
I0831 23:16:49.202981 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0831 23:16:49.202989 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0831 23:16:59.378519 1 handler_proxy.go:102] no RequestInfo found in the context
E0831 23:16:59.378616 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0831 23:16:59.378625 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0831 23:17:29.082995 1 client.go:360] parsed scheme: "passthrough"
I0831 23:17:29.083045 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0831 23:17:29.083057 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [2ba9272459fbd3d5920c42ffd67f3fc7be523ddb8abd1b3e2f8db38f6db5a2bd] <==
E0831 23:13:19.289976 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0831 23:13:22.894977 1 request.go:655] Throttling request took 1.048375539s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0831 23:13:23.746609 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0831 23:13:49.791790 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0831 23:13:55.397266 1 request.go:655] Throttling request took 1.048420785s, request: GET:https://192.168.85.2:8443/apis/autoscaling/v1?timeout=32s
W0831 23:13:56.248790 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0831 23:14:20.293642 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0831 23:14:27.899228 1 request.go:655] Throttling request took 1.047225051s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0831 23:14:28.750641 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0831 23:14:50.795356 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0831 23:15:00.404285 1 request.go:655] Throttling request took 1.051332704s, request: GET:https://192.168.85.2:8443/apis/events.k8s.io/v1beta1?timeout=32s
W0831 23:15:01.253009 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0831 23:15:21.298535 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0831 23:15:32.903339 1 request.go:655] Throttling request took 1.04848932s, request: GET:https://192.168.85.2:8443/apis/coordination.k8s.io/v1beta1?timeout=32s
W0831 23:15:33.758758 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0831 23:15:51.800264 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0831 23:16:05.409313 1 request.go:655] Throttling request took 1.048302746s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0831 23:16:06.268959 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0831 23:16:22.302025 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0831 23:16:37.919727 1 request.go:655] Throttling request took 1.048629981s, request: GET:https://192.168.85.2:8443/apis/authorization.k8s.io/v1?timeout=32s
W0831 23:16:38.771076 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0831 23:16:52.803764 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0831 23:17:10.421460 1 request.go:655] Throttling request took 1.048264197s, request: GET:https://192.168.85.2:8443/apis/events.k8s.io/v1beta1?timeout=32s
W0831 23:17:11.273026 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0831 23:17:23.305934 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
==> kube-controller-manager [4a53de8c7cfef15e1b4d2eb2d08e3992e87a5d45cb56ec1579cce90b650a86a3] <==
I0831 23:09:30.456747 1 disruption.go:339] Sending events to api server.
I0831 23:09:30.496798 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-ww8r9"
I0831 23:09:30.520170 1 shared_informer.go:247] Caches are synced for deployment
I0831 23:09:30.526917 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-wv4m2"
I0831 23:09:30.539948 1 shared_informer.go:247] Caches are synced for endpoint_slice
I0831 23:09:30.547069 1 shared_informer.go:247] Caches are synced for ClusterRoleAggregator
I0831 23:09:30.560208 1 shared_informer.go:247] Caches are synced for endpoint
I0831 23:09:30.567495 1 shared_informer.go:247] Caches are synced for resource quota
I0831 23:09:30.577507 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-74ff55c5b to 2"
I0831 23:09:30.592071 1 shared_informer.go:247] Caches are synced for endpoint_slice_mirroring
I0831 23:09:30.609375 1 shared_informer.go:247] Caches are synced for resource quota
I0831 23:09:30.661608 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-frm8z"
E0831 23:09:30.718827 1 daemon_controller.go:320] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"418c55ad-e911-47e8-b152-b9f3bb93a15e", ResourceVersion:"258", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63860742554, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4000e51c00), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4000e51c20)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.
LabelSelector)(0x4000e51c40), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Gl
usterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0x4001043780), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4000e51
c60), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeS
ource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4000e51c80), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil),
AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.20.0", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4000e51cc0)}}, Resources:v1.R
esourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x4000e41b60), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPo
licy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4000d9f9d8), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x40002d4af0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), Runtime
ClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x400098f3f8)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4000d9fa48)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest version and try again
I0831 23:09:30.720311 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-9zjlw"
I0831 23:09:30.757287 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
E0831 23:09:30.806339 1 daemon_controller.go:320] kube-system/kindnet failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kindnet", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"8d85d4f3-5120-4a15-9d28-11a494458e42", ResourceVersion:"385", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63860742555, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1", "kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"apps/v1\",\"kind\":\"DaemonSet\",\"metadata\":{\"annotations\":{},\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"},\"name\":\"kindnet\",\"namespace\":\"kube-system\"},\"spec\":{\"selector\":{\"matchLabels\":{\"app\":\"k
indnet\"}},\"template\":{\"metadata\":{\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"}},\"spec\":{\"containers\":[{\"env\":[{\"name\":\"HOST_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.hostIP\"}}},{\"name\":\"POD_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.podIP\"}}},{\"name\":\"POD_SUBNET\",\"value\":\"10.244.0.0/16\"}],\"image\":\"docker.io/kindest/kindnetd:v20240813-c6f155d6\",\"name\":\"kindnet-cni\",\"resources\":{\"limits\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"},\"requests\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"}},\"securityContext\":{\"capabilities\":{\"add\":[\"NET_RAW\",\"NET_ADMIN\"]},\"privileged\":false},\"volumeMounts\":[{\"mountPath\":\"/etc/cni/net.d\",\"name\":\"cni-cfg\"},{\"mountPath\":\"/run/xtables.lock\",\"name\":\"xtables-lock\",\"readOnly\":false},{\"mountPath\":\"/lib/modules\",\"name\":\"lib-modules\",\"readOnly\":true}]}],\"hostNetwork\":true,\"serviceAccountName\":\"kindnet\",\"tolerations\":[{\"effect\":\"NoSchedule\",\"operator\
":\"Exists\"}],\"volumes\":[{\"hostPath\":{\"path\":\"/etc/cni/net.d\",\"type\":\"DirectoryOrCreate\"},\"name\":\"cni-cfg\"},{\"hostPath\":{\"path\":\"/run/xtables.lock\",\"type\":\"FileOrCreate\"},\"name\":\"xtables-lock\"},{\"hostPath\":{\"path\":\"/lib/modules\"},\"name\":\"lib-modules\"}]}}}}\n"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubectl-client-side-apply", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001c4ad20), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001c4ad40)}, v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001c4ad60), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001c4ad80)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0x4001c4ada0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generatio
n:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"cni-cfg", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001c4adc0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:
(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001c4ade0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlo
ckStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CS
I:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001c4ae00), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Q
uobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kindnet-cni", Image:"docker.io/kindest/kindnetd:v20240813-c6f155d6", Command:[]string(nil), Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"HOST_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001c4ae20)}, v1.EnvVar{Name:"POD_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001c4ae60)}, v1.EnvVar{Name:"POD_SUBNET", Value:"10.244.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"cpu":resource.Quantity{i
:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"cni-cfg", ReadOnly:false, MountPath:"/etc/cni/net.d", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", Sub
Path:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x4001c74000), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4001c32dd8), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"kindnet", DeprecatedServiceAccount:"kindnet", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x40004cfea0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinit
y:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x400011be50)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4001c32e20)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:1, NumberReady:0, ObservedGeneration:1, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:1, CollisionCount:(*int32)(nil), Conditions:[]v
1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kindnet": the object has been modified; please apply your changes to the latest version and try again
I0831 23:09:30.986664 1 shared_informer.go:247] Caches are synced for garbage collector
I0831 23:09:30.986695 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0831 23:09:31.020215 1 shared_informer.go:247] Caches are synced for garbage collector
I0831 23:09:32.030493 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0831 23:09:32.076462 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-frm8z"
I0831 23:09:35.387190 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I0831 23:11:16.425226 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
I0831 23:11:16.475093 1 event.go:291] "Event occurred" object="kube-system/metrics-server-9975d5f86" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"metrics-server-9975d5f86-\" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount \"metrics-server\" not found"
E0831 23:11:16.497326 1 replica_set.go:532] sync "kube-system/metrics-server-9975d5f86" failed with pods "metrics-server-9975d5f86-" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount "metrics-server" not found
==> kube-proxy [375dfe16bc1a3f88bb1adae552829f1de1f6ccd7a3b2bf3eb9e823c85daa3329] <==
I0831 23:09:31.633497 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0831 23:09:31.633592 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0831 23:09:31.658403 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0831 23:09:31.658498 1 server_others.go:185] Using iptables Proxier.
I0831 23:09:31.658712 1 server.go:650] Version: v1.20.0
I0831 23:09:31.659982 1 config.go:315] Starting service config controller
I0831 23:09:31.659991 1 shared_informer.go:240] Waiting for caches to sync for service config
I0831 23:09:31.660080 1 config.go:224] Starting endpoint slice config controller
I0831 23:09:31.660112 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0831 23:09:31.760169 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0831 23:09:31.760319 1 shared_informer.go:247] Caches are synced for service config
==> kube-proxy [a630dbfa8aa905e5ea3326c49649056da78bba5cfd2beda22ff0f2f93515a197] <==
I0831 23:12:00.771629 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0831 23:12:00.771807 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0831 23:12:00.799728 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0831 23:12:00.799816 1 server_others.go:185] Using iptables Proxier.
I0831 23:12:00.800019 1 server.go:650] Version: v1.20.0
I0831 23:12:00.800848 1 config.go:315] Starting service config controller
I0831 23:12:00.800866 1 shared_informer.go:240] Waiting for caches to sync for service config
I0831 23:12:00.800897 1 config.go:224] Starting endpoint slice config controller
I0831 23:12:00.800900 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0831 23:12:00.900992 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0831 23:12:00.901034 1 shared_informer.go:247] Caches are synced for service config
==> kube-scheduler [cb403497717362a835119a12fcd9a98f048e1513652343987c5706732ded954d] <==
W0831 23:09:11.422214 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0831 23:09:11.422225 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0831 23:09:11.518128 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0831 23:09:11.525545 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0831 23:09:11.525602 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0831 23:09:11.525649 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0831 23:09:11.530581 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0831 23:09:11.530940 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0831 23:09:11.532025 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0831 23:09:11.532132 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0831 23:09:11.532452 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0831 23:09:11.532489 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0831 23:09:11.555812 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0831 23:09:11.555897 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0831 23:09:11.556080 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0831 23:09:11.556136 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0831 23:09:11.556186 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0831 23:09:11.556245 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0831 23:09:12.427208 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0831 23:09:12.445282 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0831 23:09:12.474733 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0831 23:09:12.512419 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0831 23:09:12.530963 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0831 23:09:12.696933 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
I0831 23:09:15.025870 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [f3564f974c7c186a4cf3110fbdf83d7607a54cbd7d58484326748df57213e666] <==
I0831 23:11:53.869258 1 serving.go:331] Generated self-signed cert in-memory
W0831 23:11:58.214971 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0831 23:11:58.215015 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0831 23:11:58.215029 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0831 23:11:58.215035 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0831 23:11:58.341396 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0831 23:11:58.341544 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0831 23:11:58.342717 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0831 23:11:58.342816 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0831 23:11:58.543839 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Aug 31 23:15:52 old-k8s-version-777320 kubelet[661]: E0831 23:15:52.560966 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 31 23:16:00 old-k8s-version-777320 kubelet[661]: I0831 23:16:00.557648 661 scope.go:95] [topologymanager] RemoveContainer - Container ID: c2de4a0a64d9d9a0769c26950e0e4a346b6b730b12124485a252c62fde7e17ca
Aug 31 23:16:00 old-k8s-version-777320 kubelet[661]: E0831 23:16:00.559529 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
Aug 31 23:16:04 old-k8s-version-777320 kubelet[661]: E0831 23:16:04.557871 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 31 23:16:12 old-k8s-version-777320 kubelet[661]: I0831 23:16:12.557285 661 scope.go:95] [topologymanager] RemoveContainer - Container ID: c2de4a0a64d9d9a0769c26950e0e4a346b6b730b12124485a252c62fde7e17ca
Aug 31 23:16:12 old-k8s-version-777320 kubelet[661]: E0831 23:16:12.558116 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
Aug 31 23:16:17 old-k8s-version-777320 kubelet[661]: E0831 23:16:17.558685 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 31 23:16:26 old-k8s-version-777320 kubelet[661]: I0831 23:16:26.557579 661 scope.go:95] [topologymanager] RemoveContainer - Container ID: c2de4a0a64d9d9a0769c26950e0e4a346b6b730b12124485a252c62fde7e17ca
Aug 31 23:16:26 old-k8s-version-777320 kubelet[661]: E0831 23:16:26.559804 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
Aug 31 23:16:30 old-k8s-version-777320 kubelet[661]: E0831 23:16:30.558289 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 31 23:16:37 old-k8s-version-777320 kubelet[661]: I0831 23:16:37.557115 661 scope.go:95] [topologymanager] RemoveContainer - Container ID: c2de4a0a64d9d9a0769c26950e0e4a346b6b730b12124485a252c62fde7e17ca
Aug 31 23:16:37 old-k8s-version-777320 kubelet[661]: E0831 23:16:37.557945 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
Aug 31 23:16:45 old-k8s-version-777320 kubelet[661]: E0831 23:16:45.557768 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 31 23:16:50 old-k8s-version-777320 kubelet[661]: I0831 23:16:50.557309 661 scope.go:95] [topologymanager] RemoveContainer - Container ID: c2de4a0a64d9d9a0769c26950e0e4a346b6b730b12124485a252c62fde7e17ca
Aug 31 23:16:50 old-k8s-version-777320 kubelet[661]: E0831 23:16:50.558846 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
Aug 31 23:16:58 old-k8s-version-777320 kubelet[661]: E0831 23:16:58.561819 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 31 23:17:02 old-k8s-version-777320 kubelet[661]: I0831 23:17:02.557749 661 scope.go:95] [topologymanager] RemoveContainer - Container ID: c2de4a0a64d9d9a0769c26950e0e4a346b6b730b12124485a252c62fde7e17ca
Aug 31 23:17:02 old-k8s-version-777320 kubelet[661]: E0831 23:17:02.558100 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
Aug 31 23:17:09 old-k8s-version-777320 kubelet[661]: E0831 23:17:09.557874 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 31 23:17:17 old-k8s-version-777320 kubelet[661]: I0831 23:17:17.557132 661 scope.go:95] [topologymanager] RemoveContainer - Container ID: c2de4a0a64d9d9a0769c26950e0e4a346b6b730b12124485a252c62fde7e17ca
Aug 31 23:17:17 old-k8s-version-777320 kubelet[661]: E0831 23:17:17.557481 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
Aug 31 23:17:24 old-k8s-version-777320 kubelet[661]: E0831 23:17:24.557898 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 31 23:17:32 old-k8s-version-777320 kubelet[661]: I0831 23:17:32.557112 661 scope.go:95] [topologymanager] RemoveContainer - Container ID: c2de4a0a64d9d9a0769c26950e0e4a346b6b730b12124485a252c62fde7e17ca
Aug 31 23:17:32 old-k8s-version-777320 kubelet[661]: E0831 23:17:32.557441 661 pod_workers.go:191] Error syncing pod 602e3f57-a665-4345-99f4-ac5f270847b4 ("dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-klp6x_kubernetes-dashboard(602e3f57-a665-4345-99f4-ac5f270847b4)"
Aug 31 23:17:38 old-k8s-version-777320 kubelet[661]: E0831 23:17:38.563544 661 pod_workers.go:191] Error syncing pod b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01 ("metrics-server-9975d5f86-dl7gj_kube-system(b9a02b0a-ad39-43ff-a1a3-c0caaab7bf01)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
==> kubernetes-dashboard [3a128b2ebef5226632792617aecdd7d9fa214ff983a449971d7ccdfab3a99f21] <==
2024/08/31 23:12:22 Using namespace: kubernetes-dashboard
2024/08/31 23:12:22 Using in-cluster config to connect to apiserver
2024/08/31 23:12:22 Using secret token for csrf signing
2024/08/31 23:12:22 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/08/31 23:12:22 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/08/31 23:12:22 Successful initial request to the apiserver, version: v1.20.0
2024/08/31 23:12:22 Generating JWE encryption key
2024/08/31 23:12:22 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/08/31 23:12:22 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/08/31 23:12:23 Initializing JWE encryption key from synchronized object
2024/08/31 23:12:23 Creating in-cluster Sidecar client
2024/08/31 23:12:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/31 23:12:23 Serving insecurely on HTTP port: 9090
2024/08/31 23:12:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/31 23:13:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/31 23:13:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/31 23:14:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/31 23:14:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/31 23:15:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/31 23:15:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/31 23:16:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/31 23:16:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/31 23:17:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/31 23:12:22 Starting overwatch
==> storage-provisioner [a7e7bee1e72395c1a5b201c2a16ae1e8c0725a75e13db42a8afd0bd7b61f1a6b] <==
I0831 23:12:00.661350 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0831 23:12:30.670251 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
==> storage-provisioner [f7e4d956562c970c31e64420c5803c72175a04dd6fcef52066a3ece0a6233f9f] <==
I0831 23:12:44.785999 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0831 23:12:44.815967 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0831 23:12:44.816350 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0831 23:13:02.337735 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0831 23:13:02.338138 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-777320_d0d3b22c-a7be-47e9-8c57-72e3629bccb2!
I0831 23:13:02.338838 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"cc8418f5-8aa8-4a46-a658-b7beb7fab7b8", APIVersion:"v1", ResourceVersion:"846", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-777320_d0d3b22c-a7be-47e9-8c57-72e3629bccb2 became leader
I0831 23:13:02.438379 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-777320_d0d3b22c-a7be-47e9-8c57-72e3629bccb2!
-- /stdout --
helpers_test.go:255: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-777320 -n old-k8s-version-777320
helpers_test.go:262: (dbg) Run: kubectl --context old-k8s-version-777320 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:273: non-running pods: metrics-server-9975d5f86-dl7gj
helpers_test.go:275: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:278: (dbg) Run: kubectl --context old-k8s-version-777320 describe pod metrics-server-9975d5f86-dl7gj
helpers_test.go:278: (dbg) Non-zero exit: kubectl --context old-k8s-version-777320 describe pod metrics-server-9975d5f86-dl7gj: exit status 1 (131.497391ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-dl7gj" not found
** /stderr **
helpers_test.go:280: kubectl --context old-k8s-version-777320 describe pod metrics-server-9975d5f86-dl7gj: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (373.41s)