=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-580201 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-580201 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m15.377401513s)
-- stdout --
* [old-k8s-version-580201] minikube v1.32.0 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=17991
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/17991-732709/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/17991-732709/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.28.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.4
* Using the docker driver based on existing profile
* Starting "old-k8s-version-580201" primary control-plane node in "old-k8s-version-580201" cluster
* Pulling base image v0.0.42-1710284843-18375 ...
* Restarting existing docker container for "old-k8s-version-580201" ...
* Preparing Kubernetes v1.20.0 on containerd 1.6.28 ...
* Verifying Kubernetes components...
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-580201 addons enable metrics-server
* Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
-- /stdout --
** stderr **
I0315 23:43:12.357946 934140 out.go:291] Setting OutFile to fd 1 ...
I0315 23:43:12.358174 934140 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0315 23:43:12.358200 934140 out.go:304] Setting ErrFile to fd 2...
I0315 23:43:12.358220 934140 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0315 23:43:12.358506 934140 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17991-732709/.minikube/bin
I0315 23:43:12.358923 934140 out.go:298] Setting JSON to false
I0315 23:43:12.360105 934140 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":15935,"bootTime":1710530258,"procs":217,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1055-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
I0315 23:43:12.360199 934140 start.go:139] virtualization:
I0315 23:43:12.363024 934140 out.go:177] * [old-k8s-version-580201] minikube v1.32.0 on Ubuntu 20.04 (arm64)
I0315 23:43:12.365287 934140 out.go:177] - MINIKUBE_LOCATION=17991
I0315 23:43:12.367378 934140 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0315 23:43:12.365378 934140 notify.go:220] Checking for updates...
I0315 23:43:12.370547 934140 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17991-732709/kubeconfig
I0315 23:43:12.372992 934140 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17991-732709/.minikube
I0315 23:43:12.376028 934140 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0315 23:43:12.378302 934140 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0315 23:43:12.380583 934140 config.go:182] Loaded profile config "old-k8s-version-580201": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0315 23:43:12.383287 934140 out.go:177] * Kubernetes 1.28.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.4
I0315 23:43:12.385248 934140 driver.go:392] Setting default libvirt URI to qemu:///system
I0315 23:43:12.407819 934140 docker.go:122] docker version: linux-25.0.4:Docker Engine - Community
I0315 23:43:12.407941 934140 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0315 23:43:12.478826 934140 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:55 OomKillDisable:true NGoroutines:71 SystemTime:2024-03-15 23:43:12.46551647 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215031808 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0315 23:43:12.478935 934140 docker.go:295] overlay module found
I0315 23:43:12.482781 934140 out.go:177] * Using the docker driver based on existing profile
I0315 23:43:12.485655 934140 start.go:297] selected driver: docker
I0315 23:43:12.485678 934140 start.go:901] validating driver "docker" against &{Name:old-k8s-version-580201 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-580201 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0315 23:43:12.485799 934140 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0315 23:43:12.486471 934140 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0315 23:43:12.546753 934140 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:55 OomKillDisable:true NGoroutines:71 SystemTime:2024-03-15 23:43:12.536935382 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215031808 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0315 23:43:12.547140 934140 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0315 23:43:12.547167 934140 cni.go:84] Creating CNI manager for ""
I0315 23:43:12.547175 934140 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0315 23:43:12.547212 934140 start.go:340] cluster config:
{Name:old-k8s-version-580201 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-580201 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0315 23:43:12.549352 934140 out.go:177] * Starting "old-k8s-version-580201" primary control-plane node in "old-k8s-version-580201" cluster
I0315 23:43:12.551490 934140 cache.go:121] Beginning downloading kic base image for docker with containerd
I0315 23:43:12.553412 934140 out.go:177] * Pulling base image v0.0.42-1710284843-18375 ...
I0315 23:43:12.555138 934140 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0315 23:43:12.555193 934140 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17991-732709/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0315 23:43:12.555219 934140 cache.go:56] Caching tarball of preloaded images
I0315 23:43:12.555243 934140 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f in local docker daemon
I0315 23:43:12.555318 934140 preload.go:173] Found /home/jenkins/minikube-integration/17991-732709/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0315 23:43:12.555329 934140 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0315 23:43:12.555441 934140 profile.go:142] Saving config to /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/old-k8s-version-580201/config.json ...
I0315 23:43:12.571563 934140 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f in local docker daemon, skipping pull
I0315 23:43:12.571591 934140 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f exists in daemon, skipping load
I0315 23:43:12.571612 934140 cache.go:194] Successfully downloaded all kic artifacts
I0315 23:43:12.571642 934140 start.go:360] acquireMachinesLock for old-k8s-version-580201: {Name:mk28da47a14d944ce7a71eceb193d5b3f648f970 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0315 23:43:12.571719 934140 start.go:364] duration metric: took 52.084µs to acquireMachinesLock for "old-k8s-version-580201"
I0315 23:43:12.571744 934140 start.go:96] Skipping create...Using existing machine configuration
I0315 23:43:12.571754 934140 fix.go:54] fixHost starting:
I0315 23:43:12.572027 934140 cli_runner.go:164] Run: docker container inspect old-k8s-version-580201 --format={{.State.Status}}
I0315 23:43:12.592784 934140 fix.go:112] recreateIfNeeded on old-k8s-version-580201: state=Stopped err=<nil>
W0315 23:43:12.592824 934140 fix.go:138] unexpected machine state, will restart: <nil>
I0315 23:43:12.595418 934140 out.go:177] * Restarting existing docker container for "old-k8s-version-580201" ...
I0315 23:43:12.597577 934140 cli_runner.go:164] Run: docker start old-k8s-version-580201
I0315 23:43:12.929665 934140 cli_runner.go:164] Run: docker container inspect old-k8s-version-580201 --format={{.State.Status}}
I0315 23:43:12.952323 934140 kic.go:430] container "old-k8s-version-580201" state is running.
I0315 23:43:12.954541 934140 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-580201
I0315 23:43:12.979987 934140 profile.go:142] Saving config to /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/old-k8s-version-580201/config.json ...
I0315 23:43:12.980223 934140 machine.go:94] provisionDockerMachine start ...
I0315 23:43:12.980354 934140 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-580201
I0315 23:43:13.003924 934140 main.go:141] libmachine: Using SSH client type: native
I0315 23:43:13.004269 934140 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e00] 0x3e4660 <nil> [] 0s} 127.0.0.1 33838 <nil> <nil>}
I0315 23:43:13.004289 934140 main.go:141] libmachine: About to run SSH command:
hostname
I0315 23:43:13.005387 934140 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:59816->127.0.0.1:33838: read: connection reset by peer
I0315 23:43:16.152559 934140 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-580201
I0315 23:43:16.152638 934140 ubuntu.go:169] provisioning hostname "old-k8s-version-580201"
I0315 23:43:16.152715 934140 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-580201
I0315 23:43:16.182405 934140 main.go:141] libmachine: Using SSH client type: native
I0315 23:43:16.182664 934140 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e00] 0x3e4660 <nil> [] 0s} 127.0.0.1 33838 <nil> <nil>}
I0315 23:43:16.182683 934140 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-580201 && echo "old-k8s-version-580201" | sudo tee /etc/hostname
I0315 23:43:16.339041 934140 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-580201
I0315 23:43:16.339130 934140 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-580201
I0315 23:43:16.357183 934140 main.go:141] libmachine: Using SSH client type: native
I0315 23:43:16.357430 934140 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e00] 0x3e4660 <nil> [] 0s} 127.0.0.1 33838 <nil> <nil>}
I0315 23:43:16.357455 934140 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-580201' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-580201/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-580201' | sudo tee -a /etc/hosts;
fi
fi
I0315 23:43:16.501325 934140 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0315 23:43:16.501427 934140 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17991-732709/.minikube CaCertPath:/home/jenkins/minikube-integration/17991-732709/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17991-732709/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17991-732709/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17991-732709/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17991-732709/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17991-732709/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17991-732709/.minikube}
I0315 23:43:16.501475 934140 ubuntu.go:177] setting up certificates
I0315 23:43:16.501509 934140 provision.go:84] configureAuth start
I0315 23:43:16.501604 934140 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-580201
I0315 23:43:16.517853 934140 provision.go:143] copyHostCerts
I0315 23:43:16.517921 934140 exec_runner.go:144] found /home/jenkins/minikube-integration/17991-732709/.minikube/ca.pem, removing ...
I0315 23:43:16.517939 934140 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17991-732709/.minikube/ca.pem
I0315 23:43:16.518019 934140 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17991-732709/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17991-732709/.minikube/ca.pem (1078 bytes)
I0315 23:43:16.518126 934140 exec_runner.go:144] found /home/jenkins/minikube-integration/17991-732709/.minikube/cert.pem, removing ...
I0315 23:43:16.518138 934140 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17991-732709/.minikube/cert.pem
I0315 23:43:16.518168 934140 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17991-732709/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17991-732709/.minikube/cert.pem (1123 bytes)
I0315 23:43:16.518229 934140 exec_runner.go:144] found /home/jenkins/minikube-integration/17991-732709/.minikube/key.pem, removing ...
I0315 23:43:16.518238 934140 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17991-732709/.minikube/key.pem
I0315 23:43:16.518303 934140 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17991-732709/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17991-732709/.minikube/key.pem (1675 bytes)
I0315 23:43:16.518371 934140 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17991-732709/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17991-732709/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17991-732709/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-580201 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-580201]
I0315 23:43:17.055865 934140 provision.go:177] copyRemoteCerts
I0315 23:43:17.055941 934140 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0315 23:43:17.055983 934140 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-580201
I0315 23:43:17.075715 934140 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33838 SSHKeyPath:/home/jenkins/minikube-integration/17991-732709/.minikube/machines/old-k8s-version-580201/id_rsa Username:docker}
I0315 23:43:17.178593 934140 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0315 23:43:17.207071 934140 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0315 23:43:17.231717 934140 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0315 23:43:17.257487 934140 provision.go:87] duration metric: took 755.94584ms to configureAuth
I0315 23:43:17.257516 934140 ubuntu.go:193] setting minikube options for container-runtime
I0315 23:43:17.257714 934140 config.go:182] Loaded profile config "old-k8s-version-580201": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0315 23:43:17.257722 934140 machine.go:97] duration metric: took 4.277483041s to provisionDockerMachine
I0315 23:43:17.257730 934140 start.go:293] postStartSetup for "old-k8s-version-580201" (driver="docker")
I0315 23:43:17.257740 934140 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0315 23:43:17.257787 934140 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0315 23:43:17.257827 934140 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-580201
I0315 23:43:17.274455 934140 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33838 SSHKeyPath:/home/jenkins/minikube-integration/17991-732709/.minikube/machines/old-k8s-version-580201/id_rsa Username:docker}
I0315 23:43:17.374166 934140 ssh_runner.go:195] Run: cat /etc/os-release
I0315 23:43:17.377612 934140 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0315 23:43:17.377651 934140 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0315 23:43:17.377663 934140 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0315 23:43:17.377670 934140 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0315 23:43:17.377681 934140 filesync.go:126] Scanning /home/jenkins/minikube-integration/17991-732709/.minikube/addons for local assets ...
I0315 23:43:17.377759 934140 filesync.go:126] Scanning /home/jenkins/minikube-integration/17991-732709/.minikube/files for local assets ...
I0315 23:43:17.377862 934140 filesync.go:149] local asset: /home/jenkins/minikube-integration/17991-732709/.minikube/files/etc/ssl/certs/7381162.pem -> 7381162.pem in /etc/ssl/certs
I0315 23:43:17.377973 934140 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0315 23:43:17.387103 934140 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/files/etc/ssl/certs/7381162.pem --> /etc/ssl/certs/7381162.pem (1708 bytes)
I0315 23:43:17.412608 934140 start.go:296] duration metric: took 154.863394ms for postStartSetup
I0315 23:43:17.412690 934140 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0315 23:43:17.412736 934140 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-580201
I0315 23:43:17.428458 934140 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33838 SSHKeyPath:/home/jenkins/minikube-integration/17991-732709/.minikube/machines/old-k8s-version-580201/id_rsa Username:docker}
I0315 23:43:17.530732 934140 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0315 23:43:17.536015 934140 fix.go:56] duration metric: took 4.96425127s for fixHost
I0315 23:43:17.536103 934140 start.go:83] releasing machines lock for "old-k8s-version-580201", held for 4.964366311s
I0315 23:43:17.536222 934140 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-580201
I0315 23:43:17.553922 934140 ssh_runner.go:195] Run: cat /version.json
I0315 23:43:17.553939 934140 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0315 23:43:17.553975 934140 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-580201
I0315 23:43:17.553982 934140 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-580201
I0315 23:43:17.585001 934140 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33838 SSHKeyPath:/home/jenkins/minikube-integration/17991-732709/.minikube/machines/old-k8s-version-580201/id_rsa Username:docker}
I0315 23:43:17.590899 934140 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33838 SSHKeyPath:/home/jenkins/minikube-integration/17991-732709/.minikube/machines/old-k8s-version-580201/id_rsa Username:docker}
I0315 23:43:17.696897 934140 ssh_runner.go:195] Run: systemctl --version
I0315 23:43:17.861417 934140 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0315 23:43:17.866266 934140 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0315 23:43:17.886087 934140 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0315 23:43:17.886183 934140 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0315 23:43:17.895469 934140 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0315 23:43:17.895498 934140 start.go:494] detecting cgroup driver to use...
I0315 23:43:17.895533 934140 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0315 23:43:17.895604 934140 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0315 23:43:17.910180 934140 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0315 23:43:17.923535 934140 docker.go:217] disabling cri-docker service (if available) ...
I0315 23:43:17.923608 934140 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0315 23:43:17.937222 934140 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0315 23:43:17.949314 934140 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0315 23:43:18.061999 934140 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0315 23:43:18.209903 934140 docker.go:233] disabling docker service ...
I0315 23:43:18.209971 934140 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0315 23:43:18.223862 934140 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0315 23:43:18.236539 934140 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0315 23:43:18.330023 934140 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0315 23:43:18.433449 934140 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0315 23:43:18.447499 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0315 23:43:18.465489 934140 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0315 23:43:18.477103 934140 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0315 23:43:18.491695 934140 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0315 23:43:18.491764 934140 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0315 23:43:18.503799 934140 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0315 23:43:18.517356 934140 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0315 23:43:18.530911 934140 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0315 23:43:18.546048 934140 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0315 23:43:18.558914 934140 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0315 23:43:18.570911 934140 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0315 23:43:18.581259 934140 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0315 23:43:18.597643 934140 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0315 23:43:18.711858 934140 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0315 23:43:18.954479 934140 start.go:541] Will wait 60s for socket path /run/containerd/containerd.sock
I0315 23:43:18.954587 934140 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0315 23:43:18.959046 934140 start.go:562] Will wait 60s for crictl version
I0315 23:43:18.959153 934140 ssh_runner.go:195] Run: which crictl
I0315 23:43:18.962860 934140 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0315 23:43:19.008347 934140 start.go:578] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.6.28
RuntimeApiVersion: v1
I0315 23:43:19.008474 934140 ssh_runner.go:195] Run: containerd --version
I0315 23:43:19.033605 934140 ssh_runner.go:195] Run: containerd --version
I0315 23:43:19.062769 934140 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.6.28 ...
I0315 23:43:19.064688 934140 cli_runner.go:164] Run: docker network inspect old-k8s-version-580201 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0315 23:43:19.080378 934140 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0315 23:43:19.089279 934140 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0315 23:43:19.103149 934140 kubeadm.go:877] updating cluster {Name:old-k8s-version-580201 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-580201 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0315 23:43:19.103283 934140 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0315 23:43:19.103349 934140 ssh_runner.go:195] Run: sudo crictl images --output json
I0315 23:43:19.158856 934140 containerd.go:612] all images are preloaded for containerd runtime.
I0315 23:43:19.158885 934140 containerd.go:519] Images already preloaded, skipping extraction
I0315 23:43:19.158945 934140 ssh_runner.go:195] Run: sudo crictl images --output json
I0315 23:43:19.207149 934140 containerd.go:612] all images are preloaded for containerd runtime.
I0315 23:43:19.207173 934140 cache_images.go:84] Images are preloaded, skipping loading
I0315 23:43:19.207189 934140 kubeadm.go:928] updating node { 192.168.76.2 8443 v1.20.0 containerd true true} ...
I0315 23:43:19.207314 934140 kubeadm.go:940] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-580201 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-580201 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0315 23:43:19.207385 934140 ssh_runner.go:195] Run: sudo crictl info
I0315 23:43:19.246868 934140 cni.go:84] Creating CNI manager for ""
I0315 23:43:19.246894 934140 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0315 23:43:19.246905 934140 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0315 23:43:19.246929 934140 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-580201 NodeName:old-k8s-version-580201 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0315 23:43:19.247084 934140 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-580201"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0315 23:43:19.247156 934140 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0315 23:43:19.256556 934140 binaries.go:44] Found k8s binaries, skipping transfer
I0315 23:43:19.256680 934140 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0315 23:43:19.265570 934140 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0315 23:43:19.284839 934140 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0315 23:43:19.313261 934140 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0315 23:43:19.335600 934140 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0315 23:43:19.340033 934140 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0315 23:43:19.351781 934140 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0315 23:43:19.457736 934140 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0315 23:43:19.475011 934140 certs.go:68] Setting up /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/old-k8s-version-580201 for IP: 192.168.76.2
I0315 23:43:19.475080 934140 certs.go:194] generating shared ca certs ...
I0315 23:43:19.475113 934140 certs.go:226] acquiring lock for ca certs: {Name:mk85379830d1b1fdedd16ced987b422a0f48ac0c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0315 23:43:19.475287 934140 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17991-732709/.minikube/ca.key
I0315 23:43:19.475378 934140 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17991-732709/.minikube/proxy-client-ca.key
I0315 23:43:19.475416 934140 certs.go:256] generating profile certs ...
I0315 23:43:19.475535 934140 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/old-k8s-version-580201/client.key
I0315 23:43:19.475646 934140 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/old-k8s-version-580201/apiserver.key.e9cf69c5
I0315 23:43:19.475730 934140 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/old-k8s-version-580201/proxy-client.key
I0315 23:43:19.475885 934140 certs.go:484] found cert: /home/jenkins/minikube-integration/17991-732709/.minikube/certs/738116.pem (1338 bytes)
W0315 23:43:19.475965 934140 certs.go:480] ignoring /home/jenkins/minikube-integration/17991-732709/.minikube/certs/738116_empty.pem, impossibly tiny 0 bytes
I0315 23:43:19.476000 934140 certs.go:484] found cert: /home/jenkins/minikube-integration/17991-732709/.minikube/certs/ca-key.pem (1679 bytes)
I0315 23:43:19.476058 934140 certs.go:484] found cert: /home/jenkins/minikube-integration/17991-732709/.minikube/certs/ca.pem (1078 bytes)
I0315 23:43:19.476120 934140 certs.go:484] found cert: /home/jenkins/minikube-integration/17991-732709/.minikube/certs/cert.pem (1123 bytes)
I0315 23:43:19.476161 934140 certs.go:484] found cert: /home/jenkins/minikube-integration/17991-732709/.minikube/certs/key.pem (1675 bytes)
I0315 23:43:19.476243 934140 certs.go:484] found cert: /home/jenkins/minikube-integration/17991-732709/.minikube/files/etc/ssl/certs/7381162.pem (1708 bytes)
I0315 23:43:19.477254 934140 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0315 23:43:19.508812 934140 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0315 23:43:19.541370 934140 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0315 23:43:19.572051 934140 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0315 23:43:19.628051 934140 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/old-k8s-version-580201/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0315 23:43:19.685637 934140 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/old-k8s-version-580201/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0315 23:43:19.724789 934140 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/old-k8s-version-580201/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0315 23:43:19.769522 934140 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/old-k8s-version-580201/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0315 23:43:19.799736 934140 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0315 23:43:19.827067 934140 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/certs/738116.pem --> /usr/share/ca-certificates/738116.pem (1338 bytes)
I0315 23:43:19.858339 934140 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/files/etc/ssl/certs/7381162.pem --> /usr/share/ca-certificates/7381162.pem (1708 bytes)
I0315 23:43:19.885803 934140 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0315 23:43:19.906164 934140 ssh_runner.go:195] Run: openssl version
I0315 23:43:19.912734 934140 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0315 23:43:19.923150 934140 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0315 23:43:19.926889 934140 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 15 22:57 /usr/share/ca-certificates/minikubeCA.pem
I0315 23:43:19.926957 934140 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0315 23:43:19.934667 934140 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0315 23:43:19.950106 934140 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/738116.pem && ln -fs /usr/share/ca-certificates/738116.pem /etc/ssl/certs/738116.pem"
I0315 23:43:19.961390 934140 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/738116.pem
I0315 23:43:19.965340 934140 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Mar 15 23:02 /usr/share/ca-certificates/738116.pem
I0315 23:43:19.965412 934140 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/738116.pem
I0315 23:43:19.972714 934140 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/738116.pem /etc/ssl/certs/51391683.0"
I0315 23:43:19.989980 934140 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7381162.pem && ln -fs /usr/share/ca-certificates/7381162.pem /etc/ssl/certs/7381162.pem"
I0315 23:43:20.005575 934140 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7381162.pem
I0315 23:43:20.011572 934140 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Mar 15 23:02 /usr/share/ca-certificates/7381162.pem
I0315 23:43:20.011671 934140 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7381162.pem
I0315 23:43:20.021630 934140 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/7381162.pem /etc/ssl/certs/3ec20f2e.0"
I0315 23:43:20.036369 934140 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0315 23:43:20.041934 934140 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0315 23:43:20.051500 934140 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0315 23:43:20.060013 934140 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0315 23:43:20.069151 934140 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0315 23:43:20.077608 934140 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0315 23:43:20.093280 934140 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0315 23:43:20.105752 934140 kubeadm.go:391] StartCluster: {Name:old-k8s-version-580201 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-580201 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0315 23:43:20.105887 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0315 23:43:20.105994 934140 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0315 23:43:20.167626 934140 cri.go:89] found id: "6711aefac62eb67e3b17a32bab9337210ab97ce4741f2339d6927f6f1ce15edd"
I0315 23:43:20.167683 934140 cri.go:89] found id: "c81c094a64078efb78debc64cc577a03a3baa73c3b81436436e8de89606c78f4"
I0315 23:43:20.167693 934140 cri.go:89] found id: "4476e3f7821c932adced40dcd348993b203a9f5597562662cb2680d470f82585"
I0315 23:43:20.167698 934140 cri.go:89] found id: "3bef0683c2135e44fe87e50155348f1121e398a3a298a9026272fef06d85f39c"
I0315 23:43:20.167703 934140 cri.go:89] found id: "0088d2446dda408eb46d068ce7b0a048c3e567c0d81c9d75219817d46640bb68"
I0315 23:43:20.167713 934140 cri.go:89] found id: "7c106e53b87dcc5de6dccc177c6e2532608dad6decd8dd578ca8fb725410a82d"
I0315 23:43:20.167742 934140 cri.go:89] found id: "e8c4821ea89657837e9b8bc47f8e119ae8d9f7f26c1e2ea8bbe98c2d0b8cc790"
I0315 23:43:20.167759 934140 cri.go:89] found id: "80be09ea64652be3631bf46d9388d9f25564d3039bd1e13cca1ae9b95db2188d"
I0315 23:43:20.167763 934140 cri.go:89] found id: "040b549f2a914173d3fe9c7a601c396eb6e5db6b59f39a67785e6760cf69ffa4"
I0315 23:43:20.167774 934140 cri.go:89] found id: ""
I0315 23:43:20.167850 934140 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0315 23:43:20.190781 934140 cri.go:116] JSON = null
W0315 23:43:20.190863 934140 kubeadm.go:398] unpause failed: list paused: list returned 0 containers, but ps returned 9
I0315 23:43:20.190946 934140 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0315 23:43:20.206661 934140 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0315 23:43:20.206689 934140 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0315 23:43:20.206699 934140 kubeadm.go:587] restartPrimaryControlPlane start ...
I0315 23:43:20.206815 934140 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0315 23:43:20.218137 934140 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0315 23:43:20.218756 934140 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-580201" does not appear in /home/jenkins/minikube-integration/17991-732709/kubeconfig
I0315 23:43:20.218931 934140 kubeconfig.go:62] /home/jenkins/minikube-integration/17991-732709/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-580201" cluster setting kubeconfig missing "old-k8s-version-580201" context setting]
I0315 23:43:20.219370 934140 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17991-732709/kubeconfig: {Name:mkc3e8052701302a012e2bd29e7293b3c06870a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0315 23:43:20.221274 934140 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0315 23:43:20.231613 934140 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.76.2
I0315 23:43:20.231648 934140 kubeadm.go:591] duration metric: took 24.943143ms to restartPrimaryControlPlane
I0315 23:43:20.231658 934140 kubeadm.go:393] duration metric: took 125.917282ms to StartCluster
I0315 23:43:20.231683 934140 settings.go:142] acquiring lock: {Name:mk5b01a17a7d8200e1460e5eef6a8fe139c2d1f1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0315 23:43:20.231768 934140 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17991-732709/kubeconfig
I0315 23:43:20.232487 934140 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17991-732709/kubeconfig: {Name:mkc3e8052701302a012e2bd29e7293b3c06870a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0315 23:43:20.232730 934140 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0315 23:43:20.235425 934140 out.go:177] * Verifying Kubernetes components...
I0315 23:43:20.233172 934140 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0315 23:43:20.233240 934140 config.go:182] Loaded profile config "old-k8s-version-580201": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0315 23:43:20.237673 934140 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0315 23:43:20.237771 934140 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-580201"
I0315 23:43:20.237799 934140 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-580201"
W0315 23:43:20.237809 934140 addons.go:243] addon storage-provisioner should already be in state true
I0315 23:43:20.237835 934140 host.go:66] Checking if "old-k8s-version-580201" exists ...
I0315 23:43:20.238323 934140 cli_runner.go:164] Run: docker container inspect old-k8s-version-580201 --format={{.State.Status}}
I0315 23:43:20.238514 934140 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-580201"
I0315 23:43:20.238546 934140 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-580201"
I0315 23:43:20.238854 934140 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-580201"
I0315 23:43:20.238887 934140 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-580201"
W0315 23:43:20.238896 934140 addons.go:243] addon metrics-server should already be in state true
I0315 23:43:20.238936 934140 host.go:66] Checking if "old-k8s-version-580201" exists ...
I0315 23:43:20.239351 934140 cli_runner.go:164] Run: docker container inspect old-k8s-version-580201 --format={{.State.Status}}
I0315 23:43:20.239587 934140 cli_runner.go:164] Run: docker container inspect old-k8s-version-580201 --format={{.State.Status}}
I0315 23:43:20.240155 934140 addons.go:69] Setting dashboard=true in profile "old-k8s-version-580201"
I0315 23:43:20.240195 934140 addons.go:234] Setting addon dashboard=true in "old-k8s-version-580201"
W0315 23:43:20.240203 934140 addons.go:243] addon dashboard should already be in state true
I0315 23:43:20.240228 934140 host.go:66] Checking if "old-k8s-version-580201" exists ...
I0315 23:43:20.240662 934140 cli_runner.go:164] Run: docker container inspect old-k8s-version-580201 --format={{.State.Status}}
I0315 23:43:20.334297 934140 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0315 23:43:20.337109 934140 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0315 23:43:20.337140 934140 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0315 23:43:20.337223 934140 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-580201
I0315 23:43:20.369121 934140 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0315 23:43:20.369090 934140 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-580201"
W0315 23:43:20.370852 934140 addons.go:243] addon default-storageclass should already be in state true
I0315 23:43:20.370886 934140 host.go:66] Checking if "old-k8s-version-580201" exists ...
I0315 23:43:20.371005 934140 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0315 23:43:20.371025 934140 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0315 23:43:20.371085 934140 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-580201
I0315 23:43:20.371344 934140 cli_runner.go:164] Run: docker container inspect old-k8s-version-580201 --format={{.State.Status}}
I0315 23:43:20.371732 934140 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0315 23:43:20.377176 934140 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0315 23:43:20.380941 934140 addons.go:426] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0315 23:43:20.380979 934140 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0315 23:43:20.381062 934140 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-580201
I0315 23:43:20.392711 934140 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33838 SSHKeyPath:/home/jenkins/minikube-integration/17991-732709/.minikube/machines/old-k8s-version-580201/id_rsa Username:docker}
I0315 23:43:20.439695 934140 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33838 SSHKeyPath:/home/jenkins/minikube-integration/17991-732709/.minikube/machines/old-k8s-version-580201/id_rsa Username:docker}
I0315 23:43:20.446539 934140 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33838 SSHKeyPath:/home/jenkins/minikube-integration/17991-732709/.minikube/machines/old-k8s-version-580201/id_rsa Username:docker}
I0315 23:43:20.454482 934140 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0315 23:43:20.454510 934140 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0315 23:43:20.454574 934140 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-580201
I0315 23:43:20.494687 934140 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33838 SSHKeyPath:/home/jenkins/minikube-integration/17991-732709/.minikube/machines/old-k8s-version-580201/id_rsa Username:docker}
I0315 23:43:20.545823 934140 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0315 23:43:20.645009 934140 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-580201" to be "Ready" ...
I0315 23:43:20.662216 934140 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0315 23:43:20.662238 934140 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0315 23:43:20.708466 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0315 23:43:20.727978 934140 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0315 23:43:20.728007 934140 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0315 23:43:20.754938 934140 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0315 23:43:20.754970 934140 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0315 23:43:20.778244 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0315 23:43:20.860915 934140 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0315 23:43:20.860956 934140 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0315 23:43:20.898853 934140 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0315 23:43:20.898874 934140 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0315 23:43:20.949944 934140 addons.go:426] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0315 23:43:20.950016 934140 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0315 23:43:21.032141 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0315 23:43:21.096649 934140 addons.go:426] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0315 23:43:21.096723 934140 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
W0315 23:43:21.172843 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:21.172884 934140 retry.go:31] will retry after 344.068342ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0315 23:43:21.182933 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:21.182964 934140 retry.go:31] will retry after 134.481633ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:21.196118 934140 addons.go:426] installing /etc/kubernetes/addons/dashboard-role.yaml
I0315 23:43:21.196151 934140 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0315 23:43:21.272553 934140 addons.go:426] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0315 23:43:21.272590 934140 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0315 23:43:21.318361 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0315 23:43:21.340282 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:21.340364 934140 retry.go:31] will retry after 362.388231ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:21.363429 934140 addons.go:426] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0315 23:43:21.363500 934140 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0315 23:43:21.422913 934140 addons.go:426] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0315 23:43:21.422987 934140 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0315 23:43:21.512669 934140 addons.go:426] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0315 23:43:21.512778 934140 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0315 23:43:21.517129 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0315 23:43:21.559331 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:21.559421 934140 retry.go:31] will retry after 499.292529ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:21.590873 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0315 23:43:21.703935 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0315 23:43:21.772182 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:21.772268 934140 retry.go:31] will retry after 516.64186ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0315 23:43:21.845561 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:21.845642 934140 retry.go:31] will retry after 374.207139ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0315 23:43:21.914049 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:21.914131 934140 retry.go:31] will retry after 359.24852ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:22.059393 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0315 23:43:22.179044 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:22.179128 934140 retry.go:31] will retry after 380.216345ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:22.220371 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0315 23:43:22.273852 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0315 23:43:22.289303 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0315 23:43:22.405700 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:22.405781 934140 retry.go:31] will retry after 518.481602ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0315 23:43:22.496285 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:22.496365 934140 retry.go:31] will retry after 580.653012ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0315 23:43:22.513295 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:22.513360 934140 retry.go:31] will retry after 476.641063ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:22.560516 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0315 23:43:22.646314 934140 node_ready.go:53] error getting node "old-k8s-version-580201": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-580201": dial tcp 192.168.76.2:8443: connect: connection refused
W0315 23:43:22.686515 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:22.686597 934140 retry.go:31] will retry after 982.088466ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:22.925131 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0315 23:43:22.990262 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0315 23:43:23.077196 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0315 23:43:23.149827 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:23.149910 934140 retry.go:31] will retry after 343.760641ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0315 23:43:23.281946 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:23.281975 934140 retry.go:31] will retry after 1.076345596s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0315 23:43:23.344540 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:23.344634 934140 retry.go:31] will retry after 465.549452ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:23.493860 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0315 23:43:23.598176 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:23.598207 934140 retry.go:31] will retry after 591.536206ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:23.669011 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0315 23:43:23.793199 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:23.793227 934140 retry.go:31] will retry after 1.230045874s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:23.810487 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0315 23:43:23.910904 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:23.910934 934140 retry.go:31] will retry after 1.489085257s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:24.190839 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0315 23:43:24.279189 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:24.279220 934140 retry.go:31] will retry after 1.120508914s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:24.358537 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0315 23:43:24.433916 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:24.433949 934140 retry.go:31] will retry after 758.351369ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:25.024225 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0315 23:43:25.110419 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:25.110467 934140 retry.go:31] will retry after 1.150680503s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:25.146096 934140 node_ready.go:53] error getting node "old-k8s-version-580201": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-580201": dial tcp 192.168.76.2:8443: connect: connection refused
I0315 23:43:25.193300 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0315 23:43:25.269617 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:25.269650 934140 retry.go:31] will retry after 2.42301935s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:25.400935 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0315 23:43:25.400929 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0315 23:43:25.508440 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:25.508472 934140 retry.go:31] will retry after 1.263236569s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0315 23:43:25.508496 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:25.508524 934140 retry.go:31] will retry after 1.484843027s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:26.261370 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0315 23:43:26.335079 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:26.335114 934140 retry.go:31] will retry after 1.877769713s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:26.771887 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0315 23:43:26.851244 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:26.851287 934140 retry.go:31] will retry after 3.249875679s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:26.993608 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0315 23:43:27.079433 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:27.079469 934140 retry.go:31] will retry after 3.536863441s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:27.645946 934140 node_ready.go:53] error getting node "old-k8s-version-580201": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-580201": dial tcp 192.168.76.2:8443: connect: connection refused
I0315 23:43:27.693274 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0315 23:43:27.769229 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:27.769268 934140 retry.go:31] will retry after 1.690190267s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:28.213369 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0315 23:43:28.314312 934140 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:28.314347 934140 retry.go:31] will retry after 4.605636649s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0315 23:43:29.459657 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0315 23:43:30.101356 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0315 23:43:30.616473 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0315 23:43:32.920181 934140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0315 23:43:36.657831 934140 node_ready.go:49] node "old-k8s-version-580201" has status "Ready":"True"
I0315 23:43:36.657862 934140 node_ready.go:38] duration metric: took 16.01282007s for node "old-k8s-version-580201" to be "Ready" ...
I0315 23:43:36.657875 934140 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0315 23:43:36.924674 934140 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-b2w6r" in "kube-system" namespace to be "Ready" ...
I0315 23:43:37.166898 934140 pod_ready.go:92] pod "coredns-74ff55c5b-b2w6r" in "kube-system" namespace has status "Ready":"True"
I0315 23:43:37.166972 934140 pod_ready.go:81] duration metric: took 242.207658ms for pod "coredns-74ff55c5b-b2w6r" in "kube-system" namespace to be "Ready" ...
I0315 23:43:37.166999 934140 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-580201" in "kube-system" namespace to be "Ready" ...
I0315 23:43:38.758600 934140 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.657196913s)
I0315 23:43:38.758724 934140 addons.go:470] Verifying addon metrics-server=true in "old-k8s-version-580201"
I0315 23:43:38.758682 934140 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (9.298993602s)
I0315 23:43:39.183490 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:43:39.314455 934140 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (8.697926967s)
I0315 23:43:39.316329 934140 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-580201 addons enable metrics-server
I0315 23:43:39.314617 934140 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (6.394404996s)
I0315 23:43:39.327856 934140 out.go:177] * Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
I0315 23:43:39.329726 934140 addons.go:505] duration metric: took 19.09654533s for enable addons: enabled=[metrics-server storage-provisioner dashboard default-storageclass]
I0315 23:43:41.674657 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:43:43.679650 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:43:46.172554 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:43:48.173447 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:43:50.174652 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:43:52.673839 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:43:55.173194 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:43:57.174445 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:43:59.673516 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:01.677483 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:04.176856 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:06.674562 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:09.189504 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:11.674902 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:14.172717 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:16.183520 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:18.673348 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:20.673698 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:22.673803 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:25.173937 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:27.673489 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:29.674663 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:31.675825 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:33.676104 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:36.174557 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:38.673411 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:41.173880 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:43.174058 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:45.185356 934140 pod_ready.go:102] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:47.173054 934140 pod_ready.go:92] pod "etcd-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"True"
I0315 23:44:47.173081 934140 pod_ready.go:81] duration metric: took 1m10.006062112s for pod "etcd-old-k8s-version-580201" in "kube-system" namespace to be "Ready" ...
I0315 23:44:47.173096 934140 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-580201" in "kube-system" namespace to be "Ready" ...
I0315 23:44:47.179221 934140 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"True"
I0315 23:44:47.179245 934140 pod_ready.go:81] duration metric: took 6.140075ms for pod "kube-apiserver-old-k8s-version-580201" in "kube-system" namespace to be "Ready" ...
I0315 23:44:47.179263 934140 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-580201" in "kube-system" namespace to be "Ready" ...
I0315 23:44:49.185909 934140 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:51.186402 934140 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:53.685681 934140 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:55.685814 934140 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:44:57.685909 934140 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:00.385407 934140 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"True"
I0315 23:45:00.385439 934140 pod_ready.go:81] duration metric: took 13.206166436s for pod "kube-controller-manager-old-k8s-version-580201" in "kube-system" namespace to be "Ready" ...
I0315 23:45:00.385453 934140 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-kh2s2" in "kube-system" namespace to be "Ready" ...
I0315 23:45:00.404275 934140 pod_ready.go:92] pod "kube-proxy-kh2s2" in "kube-system" namespace has status "Ready":"True"
I0315 23:45:00.404362 934140 pod_ready.go:81] duration metric: took 18.899056ms for pod "kube-proxy-kh2s2" in "kube-system" namespace to be "Ready" ...
I0315 23:45:00.404392 934140 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-580201" in "kube-system" namespace to be "Ready" ...
I0315 23:45:02.410981 934140 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-580201" in "kube-system" namespace has status "Ready":"True"
I0315 23:45:02.411004 934140 pod_ready.go:81] duration metric: took 2.006590952s for pod "kube-scheduler-old-k8s-version-580201" in "kube-system" namespace to be "Ready" ...
I0315 23:45:02.411016 934140 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace to be "Ready" ...
I0315 23:45:04.417050 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:06.917483 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:08.917997 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:11.416472 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:13.417434 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:15.922244 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:18.416725 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:20.421602 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:22.917647 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:25.418241 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:27.917418 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:29.917505 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:32.416635 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:34.417053 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:36.417111 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:38.917077 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:40.917588 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:43.417458 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:45.917948 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:47.918159 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:49.918587 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:52.417432 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:54.418275 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:56.917566 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:45:59.418555 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:01.917216 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:03.917649 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:05.917704 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:07.917813 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:10.420503 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:12.917581 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:15.417560 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:17.420862 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:19.918066 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:22.417614 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:24.418046 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:26.918770 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:29.422804 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:31.917756 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:33.918415 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:36.425521 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:38.916492 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:40.917748 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:43.417913 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:45.417962 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:47.979753 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:50.417782 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:52.927847 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:55.419039 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:57.917781 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:46:59.918191 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:02.417432 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:04.917267 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:06.918719 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:09.419893 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:11.917456 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:13.917629 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:15.917972 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:18.417261 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:20.919227 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:23.417855 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:25.917761 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:27.922579 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:30.417894 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:32.918616 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:35.416728 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:37.417404 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:39.918623 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:42.417840 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:44.916925 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:46.917535 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:49.422140 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:51.918165 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:54.417738 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:56.917477 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:47:58.925637 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:01.417191 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:03.918271 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:05.920047 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:08.418032 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:10.916943 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:12.917083 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:14.917703 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:16.918552 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:18.926006 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:21.435171 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:23.917011 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:25.920180 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:28.416836 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:30.418028 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:32.917930 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:35.417327 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:37.419881 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:39.916911 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:41.917428 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:43.926978 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:46.418144 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:48.918061 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:51.418660 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:53.918963 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:56.418870 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:58.918660 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:49:00.919360 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:49:02.418440 934140 pod_ready.go:81] duration metric: took 4m0.007410875s for pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace to be "Ready" ...
E0315 23:49:02.418461 934140 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0315 23:49:02.418469 934140 pod_ready.go:38] duration metric: took 5m25.760583995s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0315 23:49:02.418483 934140 api_server.go:52] waiting for apiserver process to appear ...
I0315 23:49:02.418512 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0315 23:49:02.418573 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0315 23:49:02.487905 934140 cri.go:89] found id: "0b82f42fc451d7affa0d14e641d6e50757f32f06a52f51b1b4c2a10e06459069"
I0315 23:49:02.487974 934140 cri.go:89] found id: "e8c4821ea89657837e9b8bc47f8e119ae8d9f7f26c1e2ea8bbe98c2d0b8cc790"
I0315 23:49:02.487994 934140 cri.go:89] found id: ""
I0315 23:49:02.488016 934140 logs.go:276] 2 containers: [0b82f42fc451d7affa0d14e641d6e50757f32f06a52f51b1b4c2a10e06459069 e8c4821ea89657837e9b8bc47f8e119ae8d9f7f26c1e2ea8bbe98c2d0b8cc790]
I0315 23:49:02.488104 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.492364 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.496245 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0315 23:49:02.496312 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0315 23:49:02.548566 934140 cri.go:89] found id: "32e2364d0f85d10892426c4892f412de9be4c7914009845e1e0c665542d1ffa9"
I0315 23:49:02.548586 934140 cri.go:89] found id: "7c106e53b87dcc5de6dccc177c6e2532608dad6decd8dd578ca8fb725410a82d"
I0315 23:49:02.548591 934140 cri.go:89] found id: ""
I0315 23:49:02.548599 934140 logs.go:276] 2 containers: [32e2364d0f85d10892426c4892f412de9be4c7914009845e1e0c665542d1ffa9 7c106e53b87dcc5de6dccc177c6e2532608dad6decd8dd578ca8fb725410a82d]
I0315 23:49:02.548653 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.552653 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.557670 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0315 23:49:02.557785 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0315 23:49:02.623493 934140 cri.go:89] found id: "e24480384e8b14f9cc8f6a77e4db38f4b774a420ea71bccd932190dc49e972e6"
I0315 23:49:02.623561 934140 cri.go:89] found id: "6711aefac62eb67e3b17a32bab9337210ab97ce4741f2339d6927f6f1ce15edd"
I0315 23:49:02.623584 934140 cri.go:89] found id: ""
I0315 23:49:02.623609 934140 logs.go:276] 2 containers: [e24480384e8b14f9cc8f6a77e4db38f4b774a420ea71bccd932190dc49e972e6 6711aefac62eb67e3b17a32bab9337210ab97ce4741f2339d6927f6f1ce15edd]
I0315 23:49:02.623693 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.628507 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.632691 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0315 23:49:02.632837 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0315 23:49:02.720660 934140 cri.go:89] found id: "a3f302b11bfa0e70126388c182f4d8009d91933a51ee175c23839f45d8da3577"
I0315 23:49:02.720743 934140 cri.go:89] found id: "80be09ea64652be3631bf46d9388d9f25564d3039bd1e13cca1ae9b95db2188d"
I0315 23:49:02.720763 934140 cri.go:89] found id: ""
I0315 23:49:02.720788 934140 logs.go:276] 2 containers: [a3f302b11bfa0e70126388c182f4d8009d91933a51ee175c23839f45d8da3577 80be09ea64652be3631bf46d9388d9f25564d3039bd1e13cca1ae9b95db2188d]
I0315 23:49:02.720882 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.726121 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.731617 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0315 23:49:02.731760 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0315 23:49:02.801913 934140 cri.go:89] found id: "f2d97e620a060322b239d2751d8d93b2656fd7741e45af5aca547f61e04fc64a"
I0315 23:49:02.802003 934140 cri.go:89] found id: "4476e3f7821c932adced40dcd348993b203a9f5597562662cb2680d470f82585"
I0315 23:49:02.802028 934140 cri.go:89] found id: ""
I0315 23:49:02.802055 934140 logs.go:276] 2 containers: [f2d97e620a060322b239d2751d8d93b2656fd7741e45af5aca547f61e04fc64a 4476e3f7821c932adced40dcd348993b203a9f5597562662cb2680d470f82585]
I0315 23:49:02.802176 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.807390 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.812475 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0315 23:49:02.812679 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0315 23:49:02.878160 934140 cri.go:89] found id: "5da4950534a0bd1eda271710cc179a06c37b8638bc1f4c14254faa5a17c34416"
I0315 23:49:02.878229 934140 cri.go:89] found id: "040b549f2a914173d3fe9c7a601c396eb6e5db6b59f39a67785e6760cf69ffa4"
I0315 23:49:02.878269 934140 cri.go:89] found id: ""
I0315 23:49:02.878294 934140 logs.go:276] 2 containers: [5da4950534a0bd1eda271710cc179a06c37b8638bc1f4c14254faa5a17c34416 040b549f2a914173d3fe9c7a601c396eb6e5db6b59f39a67785e6760cf69ffa4]
I0315 23:49:02.878407 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.883653 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.888612 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0315 23:49:02.888753 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0315 23:49:02.944141 934140 cri.go:89] found id: "528a22f565f78d4f3c888ca0711b45b7aac306832106588270edd1a5a169cc67"
I0315 23:49:02.944166 934140 cri.go:89] found id: "0088d2446dda408eb46d068ce7b0a048c3e567c0d81c9d75219817d46640bb68"
I0315 23:49:02.944171 934140 cri.go:89] found id: ""
I0315 23:49:02.944178 934140 logs.go:276] 2 containers: [528a22f565f78d4f3c888ca0711b45b7aac306832106588270edd1a5a169cc67 0088d2446dda408eb46d068ce7b0a048c3e567c0d81c9d75219817d46640bb68]
I0315 23:49:02.944238 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.948680 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.953303 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0315 23:49:02.953443 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0315 23:49:03.010717 934140 cri.go:89] found id: "869cb514e87f1834ff32f1380bc3338f18531c3749ff6e334089ed165274a9e3"
I0315 23:49:03.010793 934140 cri.go:89] found id: "f90ea0d50a8b7e01ed1e789326a149ebf034033fc89b9abb9b5dba3f1984efb4"
I0315 23:49:03.010811 934140 cri.go:89] found id: ""
I0315 23:49:03.010837 934140 logs.go:276] 2 containers: [869cb514e87f1834ff32f1380bc3338f18531c3749ff6e334089ed165274a9e3 f90ea0d50a8b7e01ed1e789326a149ebf034033fc89b9abb9b5dba3f1984efb4]
I0315 23:49:03.010944 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:03.016133 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:03.020852 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0315 23:49:03.021016 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0315 23:49:03.075862 934140 cri.go:89] found id: "60b9aafb04ea8824fed3cfba5719a397905e02658b9036d814c69569019d92c9"
I0315 23:49:03.075935 934140 cri.go:89] found id: ""
I0315 23:49:03.075958 934140 logs.go:276] 1 containers: [60b9aafb04ea8824fed3cfba5719a397905e02658b9036d814c69569019d92c9]
I0315 23:49:03.076050 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:03.081137 934140 logs.go:123] Gathering logs for kubernetes-dashboard [60b9aafb04ea8824fed3cfba5719a397905e02658b9036d814c69569019d92c9] ...
I0315 23:49:03.081212 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 60b9aafb04ea8824fed3cfba5719a397905e02658b9036d814c69569019d92c9"
I0315 23:49:03.235809 934140 logs.go:123] Gathering logs for describe nodes ...
I0315 23:49:03.235885 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0315 23:49:03.423715 934140 logs.go:123] Gathering logs for kube-apiserver [0b82f42fc451d7affa0d14e641d6e50757f32f06a52f51b1b4c2a10e06459069] ...
I0315 23:49:03.423878 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0b82f42fc451d7affa0d14e641d6e50757f32f06a52f51b1b4c2a10e06459069"
I0315 23:49:03.517719 934140 logs.go:123] Gathering logs for kube-apiserver [e8c4821ea89657837e9b8bc47f8e119ae8d9f7f26c1e2ea8bbe98c2d0b8cc790] ...
I0315 23:49:03.517796 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e8c4821ea89657837e9b8bc47f8e119ae8d9f7f26c1e2ea8bbe98c2d0b8cc790"
I0315 23:49:03.587880 934140 logs.go:123] Gathering logs for kube-scheduler [a3f302b11bfa0e70126388c182f4d8009d91933a51ee175c23839f45d8da3577] ...
I0315 23:49:03.587917 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a3f302b11bfa0e70126388c182f4d8009d91933a51ee175c23839f45d8da3577"
I0315 23:49:03.636419 934140 logs.go:123] Gathering logs for kube-proxy [f2d97e620a060322b239d2751d8d93b2656fd7741e45af5aca547f61e04fc64a] ...
I0315 23:49:03.636449 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f2d97e620a060322b239d2751d8d93b2656fd7741e45af5aca547f61e04fc64a"
I0315 23:49:03.687222 934140 logs.go:123] Gathering logs for storage-provisioner [869cb514e87f1834ff32f1380bc3338f18531c3749ff6e334089ed165274a9e3] ...
I0315 23:49:03.687246 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 869cb514e87f1834ff32f1380bc3338f18531c3749ff6e334089ed165274a9e3"
I0315 23:49:03.734173 934140 logs.go:123] Gathering logs for storage-provisioner [f90ea0d50a8b7e01ed1e789326a149ebf034033fc89b9abb9b5dba3f1984efb4] ...
I0315 23:49:03.734202 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f90ea0d50a8b7e01ed1e789326a149ebf034033fc89b9abb9b5dba3f1984efb4"
I0315 23:49:03.783432 934140 logs.go:123] Gathering logs for dmesg ...
I0315 23:49:03.783458 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0315 23:49:03.803258 934140 logs.go:123] Gathering logs for etcd [7c106e53b87dcc5de6dccc177c6e2532608dad6decd8dd578ca8fb725410a82d] ...
I0315 23:49:03.803287 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7c106e53b87dcc5de6dccc177c6e2532608dad6decd8dd578ca8fb725410a82d"
I0315 23:49:03.875204 934140 logs.go:123] Gathering logs for coredns [e24480384e8b14f9cc8f6a77e4db38f4b774a420ea71bccd932190dc49e972e6] ...
I0315 23:49:03.875236 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e24480384e8b14f9cc8f6a77e4db38f4b774a420ea71bccd932190dc49e972e6"
I0315 23:49:03.932360 934140 logs.go:123] Gathering logs for coredns [6711aefac62eb67e3b17a32bab9337210ab97ce4741f2339d6927f6f1ce15edd] ...
I0315 23:49:03.932389 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6711aefac62eb67e3b17a32bab9337210ab97ce4741f2339d6927f6f1ce15edd"
I0315 23:49:03.996519 934140 logs.go:123] Gathering logs for kube-scheduler [80be09ea64652be3631bf46d9388d9f25564d3039bd1e13cca1ae9b95db2188d] ...
I0315 23:49:03.996549 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 80be09ea64652be3631bf46d9388d9f25564d3039bd1e13cca1ae9b95db2188d"
I0315 23:49:04.062936 934140 logs.go:123] Gathering logs for kube-proxy [4476e3f7821c932adced40dcd348993b203a9f5597562662cb2680d470f82585] ...
I0315 23:49:04.062969 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4476e3f7821c932adced40dcd348993b203a9f5597562662cb2680d470f82585"
I0315 23:49:04.167304 934140 logs.go:123] Gathering logs for kube-controller-manager [040b549f2a914173d3fe9c7a601c396eb6e5db6b59f39a67785e6760cf69ffa4] ...
I0315 23:49:04.167342 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 040b549f2a914173d3fe9c7a601c396eb6e5db6b59f39a67785e6760cf69ffa4"
I0315 23:49:04.258444 934140 logs.go:123] Gathering logs for etcd [32e2364d0f85d10892426c4892f412de9be4c7914009845e1e0c665542d1ffa9] ...
I0315 23:49:04.258481 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 32e2364d0f85d10892426c4892f412de9be4c7914009845e1e0c665542d1ffa9"
I0315 23:49:04.324554 934140 logs.go:123] Gathering logs for kindnet [528a22f565f78d4f3c888ca0711b45b7aac306832106588270edd1a5a169cc67] ...
I0315 23:49:04.324582 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 528a22f565f78d4f3c888ca0711b45b7aac306832106588270edd1a5a169cc67"
I0315 23:49:04.408777 934140 logs.go:123] Gathering logs for kindnet [0088d2446dda408eb46d068ce7b0a048c3e567c0d81c9d75219817d46640bb68] ...
I0315 23:49:04.408885 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0088d2446dda408eb46d068ce7b0a048c3e567c0d81c9d75219817d46640bb68"
I0315 23:49:04.470848 934140 logs.go:123] Gathering logs for containerd ...
I0315 23:49:04.470929 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0315 23:49:04.546018 934140 logs.go:123] Gathering logs for container status ...
I0315 23:49:04.546067 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0315 23:49:04.628452 934140 logs.go:123] Gathering logs for kubelet ...
I0315 23:49:04.628617 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0315 23:49:04.697950 934140 logs.go:138] Found kubelet problem: Mar 15 23:43:38 old-k8s-version-580201 kubelet[660]: E0315 23:43:38.168211 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0315 23:49:04.698160 934140 logs.go:138] Found kubelet problem: Mar 15 23:43:38 old-k8s-version-580201 kubelet[660]: E0315 23:43:38.447627 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.702879 934140 logs.go:138] Found kubelet problem: Mar 15 23:43:49 old-k8s-version-580201 kubelet[660]: E0315 23:43:49.078921 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0315 23:49:04.705358 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:02 old-k8s-version-580201 kubelet[660]: E0315 23:44:02.514144 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.705744 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:03 old-k8s-version-580201 kubelet[660]: E0315 23:44:03.525249 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.705939 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:04 old-k8s-version-580201 kubelet[660]: E0315 23:44:04.083066 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.706262 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:07 old-k8s-version-580201 kubelet[660]: E0315 23:44:07.796587 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.707036 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:09 old-k8s-version-580201 kubelet[660]: E0315 23:44:09.558017 660 pod_workers.go:191] Error syncing pod e3b514d8-a999-4528-985b-580b384ab0fe ("storage-provisioner_kube-system(e3b514d8-a999-4528-985b-580b384ab0fe)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(e3b514d8-a999-4528-985b-580b384ab0fe)"
W0315 23:49:04.709760 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:16 old-k8s-version-580201 kubelet[660]: E0315 23:44:16.114358 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0315 23:49:04.710693 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:19 old-k8s-version-580201 kubelet[660]: E0315 23:44:19.582433 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.711147 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:27 old-k8s-version-580201 kubelet[660]: E0315 23:44:27.796953 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.711340 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:31 old-k8s-version-580201 kubelet[660]: E0315 23:44:31.071314 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.711926 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:40 old-k8s-version-580201 kubelet[660]: E0315 23:44:40.627438 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.712111 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:46 old-k8s-version-580201 kubelet[660]: E0315 23:44:46.073377 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.712434 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:47 old-k8s-version-580201 kubelet[660]: E0315 23:44:47.797074 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.712759 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:58 old-k8s-version-580201 kubelet[660]: E0315 23:44:58.071365 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.715199 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:01 old-k8s-version-580201 kubelet[660]: E0315 23:45:01.080381 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0315 23:49:04.715532 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:10 old-k8s-version-580201 kubelet[660]: E0315 23:45:10.070158 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.715721 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:14 old-k8s-version-580201 kubelet[660]: E0315 23:45:14.080146 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.716316 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:24 old-k8s-version-580201 kubelet[660]: E0315 23:45:24.722441 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.716501 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:27 old-k8s-version-580201 kubelet[660]: E0315 23:45:27.070513 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.716889 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:27 old-k8s-version-580201 kubelet[660]: E0315 23:45:27.796618 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.717140 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:39 old-k8s-version-580201 kubelet[660]: E0315 23:45:39.072878 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.717470 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:43 old-k8s-version-580201 kubelet[660]: E0315 23:45:43.071627 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.717655 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:50 old-k8s-version-580201 kubelet[660]: E0315 23:45:50.076912 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.717981 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:54 old-k8s-version-580201 kubelet[660]: E0315 23:45:54.070693 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.718174 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:04 old-k8s-version-580201 kubelet[660]: E0315 23:46:04.070561 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.718498 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:08 old-k8s-version-580201 kubelet[660]: E0315 23:46:08.071900 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.718680 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:15 old-k8s-version-580201 kubelet[660]: E0315 23:46:15.073502 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.719004 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:19 old-k8s-version-580201 kubelet[660]: E0315 23:46:19.071478 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.721522 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:27 old-k8s-version-580201 kubelet[660]: E0315 23:46:27.079768 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0315 23:49:04.721858 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:31 old-k8s-version-580201 kubelet[660]: E0315 23:46:31.070173 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.722047 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:38 old-k8s-version-580201 kubelet[660]: E0315 23:46:38.072174 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.722379 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:43 old-k8s-version-580201 kubelet[660]: E0315 23:46:43.072871 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.722564 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:51 old-k8s-version-580201 kubelet[660]: E0315 23:46:51.072184 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.723144 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:56 old-k8s-version-580201 kubelet[660]: E0315 23:46:56.925610 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.723475 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:57 old-k8s-version-580201 kubelet[660]: E0315 23:46:57.929174 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.723659 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:03 old-k8s-version-580201 kubelet[660]: E0315 23:47:03.071171 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.723983 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:09 old-k8s-version-580201 kubelet[660]: E0315 23:47:09.073488 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.724166 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:14 old-k8s-version-580201 kubelet[660]: E0315 23:47:14.071340 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.724492 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:24 old-k8s-version-580201 kubelet[660]: E0315 23:47:24.071090 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.724677 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:25 old-k8s-version-580201 kubelet[660]: E0315 23:47:25.071677 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.729910 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:35 old-k8s-version-580201 kubelet[660]: E0315 23:47:35.071989 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.730126 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:36 old-k8s-version-580201 kubelet[660]: E0315 23:47:36.077771 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.730463 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:47 old-k8s-version-580201 kubelet[660]: E0315 23:47:47.070572 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.730661 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:49 old-k8s-version-580201 kubelet[660]: E0315 23:47:49.071077 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.731037 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:59 old-k8s-version-580201 kubelet[660]: E0315 23:47:59.070094 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.731227 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:04 old-k8s-version-580201 kubelet[660]: E0315 23:48:04.070705 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.731570 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:14 old-k8s-version-580201 kubelet[660]: E0315 23:48:14.072003 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.731755 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:15 old-k8s-version-580201 kubelet[660]: E0315 23:48:15.072752 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.731938 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:28 old-k8s-version-580201 kubelet[660]: E0315 23:48:28.075534 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.732271 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:28 old-k8s-version-580201 kubelet[660]: E0315 23:48:28.076533 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.732459 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:39 old-k8s-version-580201 kubelet[660]: E0315 23:48:39.070552 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.736641 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:40 old-k8s-version-580201 kubelet[660]: E0315 23:48:40.070289 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.737020 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: E0315 23:48:51.070831 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.737207 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: E0315 23:48:51.071399 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.737537 934140 logs.go:138] Found kubelet problem: Mar 15 23:49:02 old-k8s-version-580201 kubelet[660]: E0315 23:49:02.070699 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.737722 934140 logs.go:138] Found kubelet problem: Mar 15 23:49:04 old-k8s-version-580201 kubelet[660]: E0315 23:49:04.070710 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0315 23:49:04.737736 934140 logs.go:123] Gathering logs for kube-controller-manager [5da4950534a0bd1eda271710cc179a06c37b8638bc1f4c14254faa5a17c34416] ...
I0315 23:49:04.737752 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5da4950534a0bd1eda271710cc179a06c37b8638bc1f4c14254faa5a17c34416"
I0315 23:49:04.827631 934140 out.go:304] Setting ErrFile to fd 2...
I0315 23:49:04.827665 934140 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0315 23:49:04.827722 934140 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0315 23:49:04.827738 934140 out.go:239] Mar 15 23:48:40 old-k8s-version-580201 kubelet[660]: E0315 23:48:40.070289 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
Mar 15 23:48:40 old-k8s-version-580201 kubelet[660]: E0315 23:48:40.070289 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.827751 934140 out.go:239] Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: E0315 23:48:51.070831 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: E0315 23:48:51.070831 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.827764 934140 out.go:239] Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: E0315 23:48:51.071399 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: E0315 23:48:51.071399 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.827774 934140 out.go:239] Mar 15 23:49:02 old-k8s-version-580201 kubelet[660]: E0315 23:49:02.070699 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
Mar 15 23:49:02 old-k8s-version-580201 kubelet[660]: E0315 23:49:02.070699 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.827789 934140 out.go:239] Mar 15 23:49:04 old-k8s-version-580201 kubelet[660]: E0315 23:49:04.070710 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 15 23:49:04 old-k8s-version-580201 kubelet[660]: E0315 23:49:04.070710 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0315 23:49:04.827795 934140 out.go:304] Setting ErrFile to fd 2...
I0315 23:49:04.827804 934140 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0315 23:49:14.829795 934140 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0315 23:49:14.843750 934140 api_server.go:72] duration metric: took 5m54.610976225s to wait for apiserver process to appear ...
I0315 23:49:14.843776 934140 api_server.go:88] waiting for apiserver healthz status ...
I0315 23:49:14.843811 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0315 23:49:14.843875 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0315 23:49:14.890715 934140 cri.go:89] found id: "0b82f42fc451d7affa0d14e641d6e50757f32f06a52f51b1b4c2a10e06459069"
I0315 23:49:14.890736 934140 cri.go:89] found id: "e8c4821ea89657837e9b8bc47f8e119ae8d9f7f26c1e2ea8bbe98c2d0b8cc790"
I0315 23:49:14.890741 934140 cri.go:89] found id: ""
I0315 23:49:14.890750 934140 logs.go:276] 2 containers: [0b82f42fc451d7affa0d14e641d6e50757f32f06a52f51b1b4c2a10e06459069 e8c4821ea89657837e9b8bc47f8e119ae8d9f7f26c1e2ea8bbe98c2d0b8cc790]
I0315 23:49:14.890803 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:14.894707 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:14.898265 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0315 23:49:14.898339 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0315 23:49:14.937502 934140 cri.go:89] found id: "32e2364d0f85d10892426c4892f412de9be4c7914009845e1e0c665542d1ffa9"
I0315 23:49:14.937528 934140 cri.go:89] found id: "7c106e53b87dcc5de6dccc177c6e2532608dad6decd8dd578ca8fb725410a82d"
I0315 23:49:14.937534 934140 cri.go:89] found id: ""
I0315 23:49:14.937542 934140 logs.go:276] 2 containers: [32e2364d0f85d10892426c4892f412de9be4c7914009845e1e0c665542d1ffa9 7c106e53b87dcc5de6dccc177c6e2532608dad6decd8dd578ca8fb725410a82d]
I0315 23:49:14.937596 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:14.941228 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:14.944562 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0315 23:49:14.944655 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0315 23:49:14.991443 934140 cri.go:89] found id: "e24480384e8b14f9cc8f6a77e4db38f4b774a420ea71bccd932190dc49e972e6"
I0315 23:49:14.991467 934140 cri.go:89] found id: "6711aefac62eb67e3b17a32bab9337210ab97ce4741f2339d6927f6f1ce15edd"
I0315 23:49:14.991472 934140 cri.go:89] found id: ""
I0315 23:49:14.991479 934140 logs.go:276] 2 containers: [e24480384e8b14f9cc8f6a77e4db38f4b774a420ea71bccd932190dc49e972e6 6711aefac62eb67e3b17a32bab9337210ab97ce4741f2339d6927f6f1ce15edd]
I0315 23:49:14.991538 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:14.995787 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.001414 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0315 23:49:15.001503 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0315 23:49:15.108240 934140 cri.go:89] found id: "a3f302b11bfa0e70126388c182f4d8009d91933a51ee175c23839f45d8da3577"
I0315 23:49:15.108397 934140 cri.go:89] found id: "80be09ea64652be3631bf46d9388d9f25564d3039bd1e13cca1ae9b95db2188d"
I0315 23:49:15.108418 934140 cri.go:89] found id: ""
I0315 23:49:15.108446 934140 logs.go:276] 2 containers: [a3f302b11bfa0e70126388c182f4d8009d91933a51ee175c23839f45d8da3577 80be09ea64652be3631bf46d9388d9f25564d3039bd1e13cca1ae9b95db2188d]
I0315 23:49:15.108539 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.114311 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.119399 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0315 23:49:15.119554 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0315 23:49:15.203878 934140 cri.go:89] found id: "f2d97e620a060322b239d2751d8d93b2656fd7741e45af5aca547f61e04fc64a"
I0315 23:49:15.203973 934140 cri.go:89] found id: "4476e3f7821c932adced40dcd348993b203a9f5597562662cb2680d470f82585"
I0315 23:49:15.203994 934140 cri.go:89] found id: ""
I0315 23:49:15.204025 934140 logs.go:276] 2 containers: [f2d97e620a060322b239d2751d8d93b2656fd7741e45af5aca547f61e04fc64a 4476e3f7821c932adced40dcd348993b203a9f5597562662cb2680d470f82585]
I0315 23:49:15.204112 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.208520 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.214358 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0315 23:49:15.214484 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0315 23:49:15.316420 934140 cri.go:89] found id: "5da4950534a0bd1eda271710cc179a06c37b8638bc1f4c14254faa5a17c34416"
I0315 23:49:15.316485 934140 cri.go:89] found id: "040b549f2a914173d3fe9c7a601c396eb6e5db6b59f39a67785e6760cf69ffa4"
I0315 23:49:15.316507 934140 cri.go:89] found id: ""
I0315 23:49:15.316533 934140 logs.go:276] 2 containers: [5da4950534a0bd1eda271710cc179a06c37b8638bc1f4c14254faa5a17c34416 040b549f2a914173d3fe9c7a601c396eb6e5db6b59f39a67785e6760cf69ffa4]
I0315 23:49:15.316621 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.323723 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.330633 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0315 23:49:15.330758 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0315 23:49:15.388935 934140 cri.go:89] found id: "528a22f565f78d4f3c888ca0711b45b7aac306832106588270edd1a5a169cc67"
I0315 23:49:15.389004 934140 cri.go:89] found id: "0088d2446dda408eb46d068ce7b0a048c3e567c0d81c9d75219817d46640bb68"
I0315 23:49:15.389023 934140 cri.go:89] found id: ""
I0315 23:49:15.389048 934140 logs.go:276] 2 containers: [528a22f565f78d4f3c888ca0711b45b7aac306832106588270edd1a5a169cc67 0088d2446dda408eb46d068ce7b0a048c3e567c0d81c9d75219817d46640bb68]
I0315 23:49:15.389123 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.395695 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.400909 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0315 23:49:15.401030 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0315 23:49:15.460045 934140 cri.go:89] found id: "60b9aafb04ea8824fed3cfba5719a397905e02658b9036d814c69569019d92c9"
I0315 23:49:15.460128 934140 cri.go:89] found id: ""
I0315 23:49:15.460154 934140 logs.go:276] 1 containers: [60b9aafb04ea8824fed3cfba5719a397905e02658b9036d814c69569019d92c9]
I0315 23:49:15.460253 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.464309 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0315 23:49:15.464436 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0315 23:49:15.532315 934140 cri.go:89] found id: "869cb514e87f1834ff32f1380bc3338f18531c3749ff6e334089ed165274a9e3"
I0315 23:49:15.532375 934140 cri.go:89] found id: "f90ea0d50a8b7e01ed1e789326a149ebf034033fc89b9abb9b5dba3f1984efb4"
I0315 23:49:15.532404 934140 cri.go:89] found id: ""
I0315 23:49:15.532427 934140 logs.go:276] 2 containers: [869cb514e87f1834ff32f1380bc3338f18531c3749ff6e334089ed165274a9e3 f90ea0d50a8b7e01ed1e789326a149ebf034033fc89b9abb9b5dba3f1984efb4]
I0315 23:49:15.532507 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.538281 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.543876 934140 logs.go:123] Gathering logs for kube-scheduler [a3f302b11bfa0e70126388c182f4d8009d91933a51ee175c23839f45d8da3577] ...
I0315 23:49:15.543942 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a3f302b11bfa0e70126388c182f4d8009d91933a51ee175c23839f45d8da3577"
I0315 23:49:15.608099 934140 logs.go:123] Gathering logs for kube-controller-manager [040b549f2a914173d3fe9c7a601c396eb6e5db6b59f39a67785e6760cf69ffa4] ...
I0315 23:49:15.608183 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 040b549f2a914173d3fe9c7a601c396eb6e5db6b59f39a67785e6760cf69ffa4"
I0315 23:49:15.719052 934140 logs.go:123] Gathering logs for kubernetes-dashboard [60b9aafb04ea8824fed3cfba5719a397905e02658b9036d814c69569019d92c9] ...
I0315 23:49:15.723250 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 60b9aafb04ea8824fed3cfba5719a397905e02658b9036d814c69569019d92c9"
I0315 23:49:15.813102 934140 logs.go:123] Gathering logs for container status ...
I0315 23:49:15.813177 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0315 23:49:15.924909 934140 logs.go:123] Gathering logs for dmesg ...
I0315 23:49:15.925000 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0315 23:49:15.952998 934140 logs.go:123] Gathering logs for coredns [6711aefac62eb67e3b17a32bab9337210ab97ce4741f2339d6927f6f1ce15edd] ...
I0315 23:49:15.953081 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6711aefac62eb67e3b17a32bab9337210ab97ce4741f2339d6927f6f1ce15edd"
I0315 23:49:16.026425 934140 logs.go:123] Gathering logs for kindnet [0088d2446dda408eb46d068ce7b0a048c3e567c0d81c9d75219817d46640bb68] ...
I0315 23:49:16.026501 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0088d2446dda408eb46d068ce7b0a048c3e567c0d81c9d75219817d46640bb68"
I0315 23:49:16.124560 934140 logs.go:123] Gathering logs for storage-provisioner [f90ea0d50a8b7e01ed1e789326a149ebf034033fc89b9abb9b5dba3f1984efb4] ...
I0315 23:49:16.124649 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f90ea0d50a8b7e01ed1e789326a149ebf034033fc89b9abb9b5dba3f1984efb4"
I0315 23:49:16.223473 934140 logs.go:123] Gathering logs for containerd ...
I0315 23:49:16.223543 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0315 23:49:16.298945 934140 logs.go:123] Gathering logs for describe nodes ...
I0315 23:49:16.299023 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0315 23:49:16.511301 934140 logs.go:123] Gathering logs for etcd [32e2364d0f85d10892426c4892f412de9be4c7914009845e1e0c665542d1ffa9] ...
I0315 23:49:16.511460 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 32e2364d0f85d10892426c4892f412de9be4c7914009845e1e0c665542d1ffa9"
I0315 23:49:16.607019 934140 logs.go:123] Gathering logs for kube-scheduler [80be09ea64652be3631bf46d9388d9f25564d3039bd1e13cca1ae9b95db2188d] ...
I0315 23:49:16.607184 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 80be09ea64652be3631bf46d9388d9f25564d3039bd1e13cca1ae9b95db2188d"
I0315 23:49:16.684433 934140 logs.go:123] Gathering logs for kube-proxy [4476e3f7821c932adced40dcd348993b203a9f5597562662cb2680d470f82585] ...
I0315 23:49:16.684523 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4476e3f7821c932adced40dcd348993b203a9f5597562662cb2680d470f82585"
I0315 23:49:16.760973 934140 logs.go:123] Gathering logs for kube-controller-manager [5da4950534a0bd1eda271710cc179a06c37b8638bc1f4c14254faa5a17c34416] ...
I0315 23:49:16.761045 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5da4950534a0bd1eda271710cc179a06c37b8638bc1f4c14254faa5a17c34416"
I0315 23:49:16.868424 934140 logs.go:123] Gathering logs for kindnet [528a22f565f78d4f3c888ca0711b45b7aac306832106588270edd1a5a169cc67] ...
I0315 23:49:16.868506 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 528a22f565f78d4f3c888ca0711b45b7aac306832106588270edd1a5a169cc67"
I0315 23:49:16.959549 934140 logs.go:123] Gathering logs for storage-provisioner [869cb514e87f1834ff32f1380bc3338f18531c3749ff6e334089ed165274a9e3] ...
I0315 23:49:16.959628 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 869cb514e87f1834ff32f1380bc3338f18531c3749ff6e334089ed165274a9e3"
I0315 23:49:17.021960 934140 logs.go:123] Gathering logs for kube-apiserver [0b82f42fc451d7affa0d14e641d6e50757f32f06a52f51b1b4c2a10e06459069] ...
I0315 23:49:17.022043 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0b82f42fc451d7affa0d14e641d6e50757f32f06a52f51b1b4c2a10e06459069"
I0315 23:49:17.143351 934140 logs.go:123] Gathering logs for etcd [7c106e53b87dcc5de6dccc177c6e2532608dad6decd8dd578ca8fb725410a82d] ...
I0315 23:49:17.143429 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7c106e53b87dcc5de6dccc177c6e2532608dad6decd8dd578ca8fb725410a82d"
I0315 23:49:17.235131 934140 logs.go:123] Gathering logs for coredns [e24480384e8b14f9cc8f6a77e4db38f4b774a420ea71bccd932190dc49e972e6] ...
I0315 23:49:17.235226 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e24480384e8b14f9cc8f6a77e4db38f4b774a420ea71bccd932190dc49e972e6"
I0315 23:49:17.316052 934140 logs.go:123] Gathering logs for kube-proxy [f2d97e620a060322b239d2751d8d93b2656fd7741e45af5aca547f61e04fc64a] ...
I0315 23:49:17.316147 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f2d97e620a060322b239d2751d8d93b2656fd7741e45af5aca547f61e04fc64a"
I0315 23:49:17.406200 934140 logs.go:123] Gathering logs for kubelet ...
I0315 23:49:17.406303 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0315 23:49:17.491045 934140 logs.go:138] Found kubelet problem: Mar 15 23:43:38 old-k8s-version-580201 kubelet[660]: E0315 23:43:38.168211 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0315 23:49:17.491337 934140 logs.go:138] Found kubelet problem: Mar 15 23:43:38 old-k8s-version-580201 kubelet[660]: E0315 23:43:38.447627 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.494185 934140 logs.go:138] Found kubelet problem: Mar 15 23:43:49 old-k8s-version-580201 kubelet[660]: E0315 23:43:49.078921 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0315 23:49:17.496810 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:02 old-k8s-version-580201 kubelet[660]: E0315 23:44:02.514144 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.497215 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:03 old-k8s-version-580201 kubelet[660]: E0315 23:44:03.525249 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.497439 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:04 old-k8s-version-580201 kubelet[660]: E0315 23:44:04.083066 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.497801 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:07 old-k8s-version-580201 kubelet[660]: E0315 23:44:07.796587 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.498636 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:09 old-k8s-version-580201 kubelet[660]: E0315 23:44:09.558017 660 pod_workers.go:191] Error syncing pod e3b514d8-a999-4528-985b-580b384ab0fe ("storage-provisioner_kube-system(e3b514d8-a999-4528-985b-580b384ab0fe)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(e3b514d8-a999-4528-985b-580b384ab0fe)"
W0315 23:49:17.501466 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:16 old-k8s-version-580201 kubelet[660]: E0315 23:44:16.114358 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0315 23:49:17.502548 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:19 old-k8s-version-580201 kubelet[660]: E0315 23:44:19.582433 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.503041 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:27 old-k8s-version-580201 kubelet[660]: E0315 23:44:27.796953 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.503254 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:31 old-k8s-version-580201 kubelet[660]: E0315 23:44:31.071314 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.503867 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:40 old-k8s-version-580201 kubelet[660]: E0315 23:44:40.627438 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.504078 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:46 old-k8s-version-580201 kubelet[660]: E0315 23:44:46.073377 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.504443 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:47 old-k8s-version-580201 kubelet[660]: E0315 23:44:47.797074 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.504806 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:58 old-k8s-version-580201 kubelet[660]: E0315 23:44:58.071365 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.507268 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:01 old-k8s-version-580201 kubelet[660]: E0315 23:45:01.080381 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0315 23:49:17.507628 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:10 old-k8s-version-580201 kubelet[660]: E0315 23:45:10.070158 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.507905 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:14 old-k8s-version-580201 kubelet[660]: E0315 23:45:14.080146 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.508546 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:24 old-k8s-version-580201 kubelet[660]: E0315 23:45:24.722441 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.508767 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:27 old-k8s-version-580201 kubelet[660]: E0315 23:45:27.070513 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.509231 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:27 old-k8s-version-580201 kubelet[660]: E0315 23:45:27.796618 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.509456 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:39 old-k8s-version-580201 kubelet[660]: E0315 23:45:39.072878 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.509808 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:43 old-k8s-version-580201 kubelet[660]: E0315 23:45:43.071627 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.510053 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:50 old-k8s-version-580201 kubelet[660]: E0315 23:45:50.076912 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.510379 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:54 old-k8s-version-580201 kubelet[660]: E0315 23:45:54.070693 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.510562 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:04 old-k8s-version-580201 kubelet[660]: E0315 23:46:04.070561 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.510883 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:08 old-k8s-version-580201 kubelet[660]: E0315 23:46:08.071900 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.511063 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:15 old-k8s-version-580201 kubelet[660]: E0315 23:46:15.073502 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.511393 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:19 old-k8s-version-580201 kubelet[660]: E0315 23:46:19.071478 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.513802 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:27 old-k8s-version-580201 kubelet[660]: E0315 23:46:27.079768 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0315 23:49:17.514122 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:31 old-k8s-version-580201 kubelet[660]: E0315 23:46:31.070173 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.514305 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:38 old-k8s-version-580201 kubelet[660]: E0315 23:46:38.072174 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.514626 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:43 old-k8s-version-580201 kubelet[660]: E0315 23:46:43.072871 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.514807 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:51 old-k8s-version-580201 kubelet[660]: E0315 23:46:51.072184 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.515385 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:56 old-k8s-version-580201 kubelet[660]: E0315 23:46:56.925610 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.515702 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:57 old-k8s-version-580201 kubelet[660]: E0315 23:46:57.929174 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.515882 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:03 old-k8s-version-580201 kubelet[660]: E0315 23:47:03.071171 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.516199 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:09 old-k8s-version-580201 kubelet[660]: E0315 23:47:09.073488 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.516379 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:14 old-k8s-version-580201 kubelet[660]: E0315 23:47:14.071340 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.516695 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:24 old-k8s-version-580201 kubelet[660]: E0315 23:47:24.071090 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.516951 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:25 old-k8s-version-580201 kubelet[660]: E0315 23:47:25.071677 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.517307 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:35 old-k8s-version-580201 kubelet[660]: E0315 23:47:35.071989 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.517518 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:36 old-k8s-version-580201 kubelet[660]: E0315 23:47:36.077771 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.517876 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:47 old-k8s-version-580201 kubelet[660]: E0315 23:47:47.070572 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.518089 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:49 old-k8s-version-580201 kubelet[660]: E0315 23:47:49.071077 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.518450 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:59 old-k8s-version-580201 kubelet[660]: E0315 23:47:59.070094 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.518659 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:04 old-k8s-version-580201 kubelet[660]: E0315 23:48:04.070705 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.519011 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:14 old-k8s-version-580201 kubelet[660]: E0315 23:48:14.072003 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.519236 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:15 old-k8s-version-580201 kubelet[660]: E0315 23:48:15.072752 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.519458 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:28 old-k8s-version-580201 kubelet[660]: E0315 23:48:28.075534 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.519808 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:28 old-k8s-version-580201 kubelet[660]: E0315 23:48:28.076533 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.520022 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:39 old-k8s-version-580201 kubelet[660]: E0315 23:48:39.070552 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.520385 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:40 old-k8s-version-580201 kubelet[660]: E0315 23:48:40.070289 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.520742 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: E0315 23:48:51.070831 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.520957 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: E0315 23:48:51.071399 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.521309 934140 logs.go:138] Found kubelet problem: Mar 15 23:49:02 old-k8s-version-580201 kubelet[660]: E0315 23:49:02.070699 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.521519 934140 logs.go:138] Found kubelet problem: Mar 15 23:49:04 old-k8s-version-580201 kubelet[660]: E0315 23:49:04.070710 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.521871 934140 logs.go:138] Found kubelet problem: Mar 15 23:49:13 old-k8s-version-580201 kubelet[660]: E0315 23:49:13.070137 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
I0315 23:49:17.521900 934140 logs.go:123] Gathering logs for kube-apiserver [e8c4821ea89657837e9b8bc47f8e119ae8d9f7f26c1e2ea8bbe98c2d0b8cc790] ...
I0315 23:49:17.521932 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e8c4821ea89657837e9b8bc47f8e119ae8d9f7f26c1e2ea8bbe98c2d0b8cc790"
I0315 23:49:17.632961 934140 out.go:304] Setting ErrFile to fd 2...
I0315 23:49:17.633036 934140 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0315 23:49:17.633127 934140 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0315 23:49:17.633177 934140 out.go:239] Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: E0315 23:48:51.070831 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: E0315 23:48:51.070831 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.633237 934140 out.go:239] Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: E0315 23:48:51.071399 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: E0315 23:48:51.071399 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.633277 934140 out.go:239] Mar 15 23:49:02 old-k8s-version-580201 kubelet[660]: E0315 23:49:02.070699 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
Mar 15 23:49:02 old-k8s-version-580201 kubelet[660]: E0315 23:49:02.070699 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.633316 934140 out.go:239] Mar 15 23:49:04 old-k8s-version-580201 kubelet[660]: E0315 23:49:04.070710 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 15 23:49:04 old-k8s-version-580201 kubelet[660]: E0315 23:49:04.070710 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.633368 934140 out.go:239] Mar 15 23:49:13 old-k8s-version-580201 kubelet[660]: E0315 23:49:13.070137 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
Mar 15 23:49:13 old-k8s-version-580201 kubelet[660]: E0315 23:49:13.070137 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
I0315 23:49:17.633406 934140 out.go:304] Setting ErrFile to fd 2...
I0315 23:49:17.633444 934140 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0315 23:49:27.634092 934140 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0315 23:49:27.645240 934140 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0315 23:49:27.647700 934140 out.go:177]
W0315 23:49:27.650408 934140 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0315 23:49:27.650447 934140 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0315 23:49:27.650465 934140 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0315 23:49:27.650470 934140 out.go:239] *
*
W0315 23:49:27.651433 934140 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0315 23:49:27.654895 934140 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-580201 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-580201
helpers_test.go:235: (dbg) docker inspect old-k8s-version-580201:
-- stdout --
[
{
"Id": "253e6795a31e2b7c463a9193981b0588b68f4fc0df5d5639b939df3cef552879",
"Created": "2024-03-15T23:40:00.588623671Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 934328,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-03-15T23:43:12.919553058Z",
"FinishedAt": "2024-03-15T23:43:11.750686176Z"
},
"Image": "sha256:db62270b4bb0cfcde696782f7a6322baca275275e31814ce9fd8998407bf461e",
"ResolvConfPath": "/var/lib/docker/containers/253e6795a31e2b7c463a9193981b0588b68f4fc0df5d5639b939df3cef552879/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/253e6795a31e2b7c463a9193981b0588b68f4fc0df5d5639b939df3cef552879/hostname",
"HostsPath": "/var/lib/docker/containers/253e6795a31e2b7c463a9193981b0588b68f4fc0df5d5639b939df3cef552879/hosts",
"LogPath": "/var/lib/docker/containers/253e6795a31e2b7c463a9193981b0588b68f4fc0df5d5639b939df3cef552879/253e6795a31e2b7c463a9193981b0588b68f4fc0df5d5639b939df3cef552879-json.log",
"Name": "/old-k8s-version-580201",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-580201:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-580201",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/665e907a5d78d9db8cf8b9892a6446fcb8345a15000c4b4e694b9308e2c76485-init/diff:/var/lib/docker/overlay2/61fc4ad9e03df436d35baf5bcc90edf44e3d508099068850c7bbec275716af1b/diff",
"MergedDir": "/var/lib/docker/overlay2/665e907a5d78d9db8cf8b9892a6446fcb8345a15000c4b4e694b9308e2c76485/merged",
"UpperDir": "/var/lib/docker/overlay2/665e907a5d78d9db8cf8b9892a6446fcb8345a15000c4b4e694b9308e2c76485/diff",
"WorkDir": "/var/lib/docker/overlay2/665e907a5d78d9db8cf8b9892a6446fcb8345a15000c4b4e694b9308e2c76485/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-580201",
"Source": "/var/lib/docker/volumes/old-k8s-version-580201/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-580201",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-580201",
"name.minikube.sigs.k8s.io": "old-k8s-version-580201",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "4c33cbfa478b1a2f2f8f49be6266175b1e72bcf2a38261140374e7cc77d07e5a",
"SandboxKey": "/var/run/docker/netns/4c33cbfa478b",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33838"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33837"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33834"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33836"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33835"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-580201": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": [
"253e6795a31e",
"old-k8s-version-580201"
],
"MacAddress": "02:42:c0:a8:4c:02",
"NetworkID": "9d3a5a44a92dcab389d2bbcd737aa8ed9f75752ec9cf857cc02b17f374f6c132",
"EndpointID": "ebb7b698e34a96d8552119b977dd5967becd648a6214192a548a52b30229f564",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DriverOpts": null,
"DNSNames": [
"old-k8s-version-580201",
"253e6795a31e"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-580201 -n old-k8s-version-580201
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-580201 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-580201 logs -n 25: (2.251568695s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| start | -p cert-expiration-125283 | cert-expiration-125283 | jenkins | v1.32.0 | 15 Mar 24 23:38 UTC | 15 Mar 24 23:39 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-env-260614 | force-systemd-env-260614 | jenkins | v1.32.0 | 15 Mar 24 23:39 UTC | 15 Mar 24 23:39 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-env-260614 | force-systemd-env-260614 | jenkins | v1.32.0 | 15 Mar 24 23:39 UTC | 15 Mar 24 23:39 UTC |
| start | -p cert-options-195598 | cert-options-195598 | jenkins | v1.32.0 | 15 Mar 24 23:39 UTC | 15 Mar 24 23:39 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-195598 ssh | cert-options-195598 | jenkins | v1.32.0 | 15 Mar 24 23:39 UTC | 15 Mar 24 23:39 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-195598 -- sudo | cert-options-195598 | jenkins | v1.32.0 | 15 Mar 24 23:39 UTC | 15 Mar 24 23:39 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-195598 | cert-options-195598 | jenkins | v1.32.0 | 15 Mar 24 23:39 UTC | 15 Mar 24 23:39 UTC |
| start | -p old-k8s-version-580201 | old-k8s-version-580201 | jenkins | v1.32.0 | 15 Mar 24 23:39 UTC | 15 Mar 24 23:42 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-125283 | cert-expiration-125283 | jenkins | v1.32.0 | 15 Mar 24 23:42 UTC | 15 Mar 24 23:42 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-125283 | cert-expiration-125283 | jenkins | v1.32.0 | 15 Mar 24 23:42 UTC | 15 Mar 24 23:42 UTC |
| start | -p no-preload-362936 | no-preload-362936 | jenkins | v1.32.0 | 15 Mar 24 23:42 UTC | 15 Mar 24 23:43 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| addons | enable metrics-server -p old-k8s-version-580201 | old-k8s-version-580201 | jenkins | v1.32.0 | 15 Mar 24 23:42 UTC | 15 Mar 24 23:42 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-580201 | old-k8s-version-580201 | jenkins | v1.32.0 | 15 Mar 24 23:42 UTC | 15 Mar 24 23:43 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-580201 | old-k8s-version-580201 | jenkins | v1.32.0 | 15 Mar 24 23:43 UTC | 15 Mar 24 23:43 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-580201 | old-k8s-version-580201 | jenkins | v1.32.0 | 15 Mar 24 23:43 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-362936 | no-preload-362936 | jenkins | v1.32.0 | 15 Mar 24 23:43 UTC | 15 Mar 24 23:43 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-362936 | no-preload-362936 | jenkins | v1.32.0 | 15 Mar 24 23:43 UTC | 15 Mar 24 23:44 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-362936 | no-preload-362936 | jenkins | v1.32.0 | 15 Mar 24 23:44 UTC | 15 Mar 24 23:44 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-362936 | no-preload-362936 | jenkins | v1.32.0 | 15 Mar 24 23:44 UTC | 15 Mar 24 23:48 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| image | no-preload-362936 image list | no-preload-362936 | jenkins | v1.32.0 | 15 Mar 24 23:48 UTC | 15 Mar 24 23:48 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-362936 | no-preload-362936 | jenkins | v1.32.0 | 15 Mar 24 23:48 UTC | 15 Mar 24 23:48 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-362936 | no-preload-362936 | jenkins | v1.32.0 | 15 Mar 24 23:48 UTC | 15 Mar 24 23:48 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-362936 | no-preload-362936 | jenkins | v1.32.0 | 15 Mar 24 23:48 UTC | 15 Mar 24 23:48 UTC |
| delete | -p no-preload-362936 | no-preload-362936 | jenkins | v1.32.0 | 15 Mar 24 23:48 UTC | 15 Mar 24 23:48 UTC |
| start | -p embed-certs-264151 | embed-certs-264151 | jenkins | v1.32.0 | 15 Mar 24 23:48 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/03/15 23:48:48
Running on machine: ip-172-31-30-239
Binary: Built with gc go1.22.1 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0315 23:48:48.933997 943965 out.go:291] Setting OutFile to fd 1 ...
I0315 23:48:48.934130 943965 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0315 23:48:48.934140 943965 out.go:304] Setting ErrFile to fd 2...
I0315 23:48:48.934145 943965 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0315 23:48:48.934412 943965 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17991-732709/.minikube/bin
I0315 23:48:48.934809 943965 out.go:298] Setting JSON to false
I0315 23:48:48.935883 943965 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":16271,"bootTime":1710530258,"procs":236,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1055-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
I0315 23:48:48.935955 943965 start.go:139] virtualization:
I0315 23:48:48.938973 943965 out.go:177] * [embed-certs-264151] minikube v1.32.0 on Ubuntu 20.04 (arm64)
I0315 23:48:48.942408 943965 out.go:177] - MINIKUBE_LOCATION=17991
I0315 23:48:48.944510 943965 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0315 23:48:48.942494 943965 notify.go:220] Checking for updates...
I0315 23:48:48.949494 943965 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17991-732709/kubeconfig
I0315 23:48:48.954167 943965 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17991-732709/.minikube
I0315 23:48:48.956323 943965 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0315 23:48:48.959309 943965 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0315 23:48:48.962238 943965 config.go:182] Loaded profile config "old-k8s-version-580201": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0315 23:48:48.962349 943965 driver.go:392] Setting default libvirt URI to qemu:///system
I0315 23:48:48.984942 943965 docker.go:122] docker version: linux-25.0.4:Docker Engine - Community
I0315 23:48:48.985067 943965 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0315 23:48:49.078186 943965 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:56 SystemTime:2024-03-15 23:48:49.068393492 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215031808 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0315 23:48:49.078294 943965 docker.go:295] overlay module found
I0315 23:48:49.080398 943965 out.go:177] * Using the docker driver based on user configuration
I0315 23:48:49.082354 943965 start.go:297] selected driver: docker
I0315 23:48:49.082375 943965 start.go:901] validating driver "docker" against <nil>
I0315 23:48:49.082391 943965 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0315 23:48:49.083000 943965 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0315 23:48:49.174704 943965 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:56 SystemTime:2024-03-15 23:48:49.165157594 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215031808 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0315 23:48:49.174877 943965 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0315 23:48:49.175107 943965 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0315 23:48:49.177665 943965 out.go:177] * Using Docker driver with root privileges
I0315 23:48:49.179724 943965 cni.go:84] Creating CNI manager for ""
I0315 23:48:49.179748 943965 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0315 23:48:49.179762 943965 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0315 23:48:49.179843 943965 start.go:340] cluster config:
{Name:embed-certs-264151 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-264151 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Stati
cIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0315 23:48:49.182826 943965 out.go:177] * Starting "embed-certs-264151" primary control-plane node in "embed-certs-264151" cluster
I0315 23:48:49.185162 943965 cache.go:121] Beginning downloading kic base image for docker with containerd
I0315 23:48:49.187190 943965 out.go:177] * Pulling base image v0.0.42-1710284843-18375 ...
I0315 23:48:49.188936 943965 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime containerd
I0315 23:48:49.189000 943965 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17991-732709/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-containerd-overlay2-arm64.tar.lz4
I0315 23:48:49.189013 943965 cache.go:56] Caching tarball of preloaded images
I0315 23:48:49.189023 943965 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f in local docker daemon
I0315 23:48:49.189115 943965 preload.go:173] Found /home/jenkins/minikube-integration/17991-732709/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0315 23:48:49.189126 943965 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on containerd
I0315 23:48:49.189229 943965 profile.go:142] Saving config to /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/config.json ...
I0315 23:48:49.189253 943965 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/config.json: {Name:mk2a5b557d7158daa6f401b5d2c184066b9f24b8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0315 23:48:49.204763 943965 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f in local docker daemon, skipping pull
I0315 23:48:49.204788 943965 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f exists in daemon, skipping load
I0315 23:48:49.204826 943965 cache.go:194] Successfully downloaded all kic artifacts
I0315 23:48:49.204855 943965 start.go:360] acquireMachinesLock for embed-certs-264151: {Name:mk94bbd3a2d62bca4534ca91b1ad61af87f16134 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0315 23:48:49.204960 943965 start.go:364] duration metric: took 87.809µs to acquireMachinesLock for "embed-certs-264151"
I0315 23:48:49.204986 943965 start.go:93] Provisioning new machine with config: &{Name:embed-certs-264151 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-264151 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableM
etrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0315 23:48:49.205080 943965 start.go:125] createHost starting for "" (driver="docker")
I0315 23:48:48.918061 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:51.418660 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:49.208012 943965 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0315 23:48:49.208265 943965 start.go:159] libmachine.API.Create for "embed-certs-264151" (driver="docker")
I0315 23:48:49.208293 943965 client.go:168] LocalClient.Create starting
I0315 23:48:49.208371 943965 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17991-732709/.minikube/certs/ca.pem
I0315 23:48:49.208403 943965 main.go:141] libmachine: Decoding PEM data...
I0315 23:48:49.208416 943965 main.go:141] libmachine: Parsing certificate...
I0315 23:48:49.208466 943965 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17991-732709/.minikube/certs/cert.pem
I0315 23:48:49.208482 943965 main.go:141] libmachine: Decoding PEM data...
I0315 23:48:49.208491 943965 main.go:141] libmachine: Parsing certificate...
I0315 23:48:49.208974 943965 cli_runner.go:164] Run: docker network inspect embed-certs-264151 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0315 23:48:49.225336 943965 cli_runner.go:211] docker network inspect embed-certs-264151 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0315 23:48:49.225425 943965 network_create.go:281] running [docker network inspect embed-certs-264151] to gather additional debugging logs...
I0315 23:48:49.225448 943965 cli_runner.go:164] Run: docker network inspect embed-certs-264151
W0315 23:48:49.242241 943965 cli_runner.go:211] docker network inspect embed-certs-264151 returned with exit code 1
I0315 23:48:49.242289 943965 network_create.go:284] error running [docker network inspect embed-certs-264151]: docker network inspect embed-certs-264151: exit status 1
stdout:
[]
stderr:
Error response from daemon: network embed-certs-264151 not found
I0315 23:48:49.242303 943965 network_create.go:286] output of [docker network inspect embed-certs-264151]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network embed-certs-264151 not found
** /stderr **
I0315 23:48:49.242398 943965 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0315 23:48:49.259485 943965 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-cfce1467727a IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:81:cc:9b:33} reservation:<nil>}
I0315 23:48:49.259965 943965 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-150a94d17448 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:74:22:8f:21} reservation:<nil>}
I0315 23:48:49.260369 943965 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-4da6b9dcc83a IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:28:9c:96:d8} reservation:<nil>}
I0315 23:48:49.260722 943965 network.go:211] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName:br-9d3a5a44a92d IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:75:2e:1b:72} reservation:<nil>}
I0315 23:48:49.261358 943965 network.go:206] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40025cdb70}
I0315 23:48:49.261391 943965 network_create.go:124] attempt to create docker network embed-certs-264151 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 1500 ...
I0315 23:48:49.261458 943965 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-264151 embed-certs-264151
I0315 23:48:49.327818 943965 network_create.go:108] docker network embed-certs-264151 192.168.85.0/24 created
I0315 23:48:49.327852 943965 kic.go:121] calculated static IP "192.168.85.2" for the "embed-certs-264151" container
I0315 23:48:49.327940 943965 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0315 23:48:49.343683 943965 cli_runner.go:164] Run: docker volume create embed-certs-264151 --label name.minikube.sigs.k8s.io=embed-certs-264151 --label created_by.minikube.sigs.k8s.io=true
I0315 23:48:49.360146 943965 oci.go:103] Successfully created a docker volume embed-certs-264151
I0315 23:48:49.360244 943965 cli_runner.go:164] Run: docker run --rm --name embed-certs-264151-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-264151 --entrypoint /usr/bin/test -v embed-certs-264151:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f -d /var/lib
I0315 23:48:50.045689 943965 oci.go:107] Successfully prepared a docker volume embed-certs-264151
I0315 23:48:50.045767 943965 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime containerd
I0315 23:48:50.045795 943965 kic.go:194] Starting extracting preloaded images to volume ...
I0315 23:48:50.045894 943965 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17991-732709/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-264151:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f -I lz4 -xf /preloaded.tar -C /extractDir
I0315 23:48:53.918963 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:56.418870 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:55.134417 943965 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17991-732709/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-264151:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f -I lz4 -xf /preloaded.tar -C /extractDir: (5.088472721s)
I0315 23:48:55.134461 943965 kic.go:203] duration metric: took 5.088662279s to extract preloaded images to volume ...
W0315 23:48:55.134631 943965 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0315 23:48:55.134735 943965 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0315 23:48:55.191761 943965 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-264151 --name embed-certs-264151 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-264151 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-264151 --network embed-certs-264151 --ip 192.168.85.2 --volume embed-certs-264151:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f
I0315 23:48:55.554862 943965 cli_runner.go:164] Run: docker container inspect embed-certs-264151 --format={{.State.Running}}
I0315 23:48:55.581635 943965 cli_runner.go:164] Run: docker container inspect embed-certs-264151 --format={{.State.Status}}
I0315 23:48:55.602694 943965 cli_runner.go:164] Run: docker exec embed-certs-264151 stat /var/lib/dpkg/alternatives/iptables
I0315 23:48:55.669937 943965 oci.go:144] the created container "embed-certs-264151" has a running status.
I0315 23:48:55.669979 943965 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/17991-732709/.minikube/machines/embed-certs-264151/id_rsa...
I0315 23:48:56.792177 943965 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/17991-732709/.minikube/machines/embed-certs-264151/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0315 23:48:56.822506 943965 cli_runner.go:164] Run: docker container inspect embed-certs-264151 --format={{.State.Status}}
I0315 23:48:56.839589 943965 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0315 23:48:56.839609 943965 kic_runner.go:114] Args: [docker exec --privileged embed-certs-264151 chown docker:docker /home/docker/.ssh/authorized_keys]
I0315 23:48:56.911221 943965 cli_runner.go:164] Run: docker container inspect embed-certs-264151 --format={{.State.Status}}
I0315 23:48:56.946089 943965 machine.go:94] provisionDockerMachine start ...
I0315 23:48:56.946191 943965 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-264151
I0315 23:48:56.966489 943965 main.go:141] libmachine: Using SSH client type: native
I0315 23:48:56.966790 943965 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e00] 0x3e4660 <nil> [] 0s} 127.0.0.1 33848 <nil> <nil>}
I0315 23:48:56.966808 943965 main.go:141] libmachine: About to run SSH command:
hostname
I0315 23:48:57.120788 943965 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-264151
I0315 23:48:57.120852 943965 ubuntu.go:169] provisioning hostname "embed-certs-264151"
I0315 23:48:57.120938 943965 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-264151
I0315 23:48:57.150510 943965 main.go:141] libmachine: Using SSH client type: native
I0315 23:48:57.150756 943965 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e00] 0x3e4660 <nil> [] 0s} 127.0.0.1 33848 <nil> <nil>}
I0315 23:48:57.150773 943965 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-264151 && echo "embed-certs-264151" | sudo tee /etc/hostname
I0315 23:48:57.306013 943965 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-264151
I0315 23:48:57.306127 943965 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-264151
I0315 23:48:57.321901 943965 main.go:141] libmachine: Using SSH client type: native
I0315 23:48:57.322163 943965 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e00] 0x3e4660 <nil> [] 0s} 127.0.0.1 33848 <nil> <nil>}
I0315 23:48:57.322186 943965 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-264151' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-264151/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-264151' | sudo tee -a /etc/hosts;
fi
fi
I0315 23:48:57.469080 943965 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0315 23:48:57.469151 943965 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17991-732709/.minikube CaCertPath:/home/jenkins/minikube-integration/17991-732709/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17991-732709/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17991-732709/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17991-732709/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17991-732709/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17991-732709/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17991-732709/.minikube}
I0315 23:48:57.469205 943965 ubuntu.go:177] setting up certificates
I0315 23:48:57.469232 943965 provision.go:84] configureAuth start
I0315 23:48:57.469295 943965 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-264151
I0315 23:48:57.486060 943965 provision.go:143] copyHostCerts
I0315 23:48:57.486122 943965 exec_runner.go:144] found /home/jenkins/minikube-integration/17991-732709/.minikube/ca.pem, removing ...
I0315 23:48:57.486139 943965 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17991-732709/.minikube/ca.pem
I0315 23:48:57.486220 943965 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17991-732709/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17991-732709/.minikube/ca.pem (1078 bytes)
I0315 23:48:57.486317 943965 exec_runner.go:144] found /home/jenkins/minikube-integration/17991-732709/.minikube/cert.pem, removing ...
I0315 23:48:57.486328 943965 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17991-732709/.minikube/cert.pem
I0315 23:48:57.486358 943965 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17991-732709/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17991-732709/.minikube/cert.pem (1123 bytes)
I0315 23:48:57.486417 943965 exec_runner.go:144] found /home/jenkins/minikube-integration/17991-732709/.minikube/key.pem, removing ...
I0315 23:48:57.486427 943965 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17991-732709/.minikube/key.pem
I0315 23:48:57.486454 943965 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17991-732709/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17991-732709/.minikube/key.pem (1675 bytes)
I0315 23:48:57.486507 943965 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17991-732709/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17991-732709/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17991-732709/.minikube/certs/ca-key.pem org=jenkins.embed-certs-264151 san=[127.0.0.1 192.168.85.2 embed-certs-264151 localhost minikube]
I0315 23:48:58.109752 943965 provision.go:177] copyRemoteCerts
I0315 23:48:58.109828 943965 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0315 23:48:58.109877 943965 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-264151
I0315 23:48:58.136247 943965 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33848 SSHKeyPath:/home/jenkins/minikube-integration/17991-732709/.minikube/machines/embed-certs-264151/id_rsa Username:docker}
I0315 23:48:58.238118 943965 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0315 23:48:58.264528 943965 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0315 23:48:58.292584 943965 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0315 23:48:58.318490 943965 provision.go:87] duration metric: took 849.241558ms to configureAuth
I0315 23:48:58.318572 943965 ubuntu.go:193] setting minikube options for container-runtime
I0315 23:48:58.318799 943965 config.go:182] Loaded profile config "embed-certs-264151": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.4
I0315 23:48:58.318816 943965 machine.go:97] duration metric: took 1.372703075s to provisionDockerMachine
I0315 23:48:58.318824 943965 client.go:171] duration metric: took 9.110526019s to LocalClient.Create
I0315 23:48:58.318854 943965 start.go:167] duration metric: took 9.110588376s to libmachine.API.Create "embed-certs-264151"
I0315 23:48:58.318869 943965 start.go:293] postStartSetup for "embed-certs-264151" (driver="docker")
I0315 23:48:58.318879 943965 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0315 23:48:58.318954 943965 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0315 23:48:58.318995 943965 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-264151
I0315 23:48:58.340163 943965 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33848 SSHKeyPath:/home/jenkins/minikube-integration/17991-732709/.minikube/machines/embed-certs-264151/id_rsa Username:docker}
I0315 23:48:58.442779 943965 ssh_runner.go:195] Run: cat /etc/os-release
I0315 23:48:58.446195 943965 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0315 23:48:58.446235 943965 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0315 23:48:58.446246 943965 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0315 23:48:58.446253 943965 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0315 23:48:58.446264 943965 filesync.go:126] Scanning /home/jenkins/minikube-integration/17991-732709/.minikube/addons for local assets ...
I0315 23:48:58.446328 943965 filesync.go:126] Scanning /home/jenkins/minikube-integration/17991-732709/.minikube/files for local assets ...
I0315 23:48:58.446414 943965 filesync.go:149] local asset: /home/jenkins/minikube-integration/17991-732709/.minikube/files/etc/ssl/certs/7381162.pem -> 7381162.pem in /etc/ssl/certs
I0315 23:48:58.446523 943965 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0315 23:48:58.456216 943965 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/files/etc/ssl/certs/7381162.pem --> /etc/ssl/certs/7381162.pem (1708 bytes)
I0315 23:48:58.481718 943965 start.go:296] duration metric: took 162.833841ms for postStartSetup
I0315 23:48:58.482086 943965 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-264151
I0315 23:48:58.497489 943965 profile.go:142] Saving config to /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/config.json ...
I0315 23:48:58.497770 943965 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0315 23:48:58.497824 943965 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-264151
I0315 23:48:58.516063 943965 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33848 SSHKeyPath:/home/jenkins/minikube-integration/17991-732709/.minikube/machines/embed-certs-264151/id_rsa Username:docker}
I0315 23:48:58.618475 943965 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0315 23:48:58.623204 943965 start.go:128] duration metric: took 9.418104912s to createHost
I0315 23:48:58.623226 943965 start.go:83] releasing machines lock for "embed-certs-264151", held for 9.418258113s
I0315 23:48:58.623300 943965 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-264151
I0315 23:48:58.641172 943965 ssh_runner.go:195] Run: cat /version.json
I0315 23:48:58.641209 943965 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0315 23:48:58.641234 943965 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-264151
I0315 23:48:58.641254 943965 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-264151
I0315 23:48:58.660384 943965 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33848 SSHKeyPath:/home/jenkins/minikube-integration/17991-732709/.minikube/machines/embed-certs-264151/id_rsa Username:docker}
I0315 23:48:58.669131 943965 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33848 SSHKeyPath:/home/jenkins/minikube-integration/17991-732709/.minikube/machines/embed-certs-264151/id_rsa Username:docker}
I0315 23:48:58.885980 943965 ssh_runner.go:195] Run: systemctl --version
I0315 23:48:58.890418 943965 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0315 23:48:58.894834 943965 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0315 23:48:58.924497 943965 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0315 23:48:58.924579 943965 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0315 23:48:58.958840 943965 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0315 23:48:58.958870 943965 start.go:494] detecting cgroup driver to use...
I0315 23:48:58.958903 943965 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0315 23:48:58.958955 943965 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0315 23:48:58.971695 943965 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0315 23:48:58.983950 943965 docker.go:217] disabling cri-docker service (if available) ...
I0315 23:48:58.984033 943965 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0315 23:48:58.999236 943965 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0315 23:48:59.016988 943965 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0315 23:48:59.116631 943965 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0315 23:48:59.248949 943965 docker.go:233] disabling docker service ...
I0315 23:48:59.249057 943965 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0315 23:48:59.271441 943965 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0315 23:48:59.284115 943965 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0315 23:48:59.383159 943965 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0315 23:48:59.481059 943965 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0315 23:48:59.493488 943965 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0315 23:48:59.512002 943965 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0315 23:48:59.523353 943965 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0315 23:48:59.536124 943965 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0315 23:48:59.536251 943965 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0315 23:48:59.549098 943965 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0315 23:48:59.560413 943965 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0315 23:48:59.571444 943965 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0315 23:48:59.582493 943965 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0315 23:48:59.592718 943965 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0315 23:48:59.603606 943965 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0315 23:48:59.612592 943965 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0315 23:48:59.621573 943965 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0315 23:48:59.716066 943965 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0315 23:48:59.857020 943965 start.go:541] Will wait 60s for socket path /run/containerd/containerd.sock
I0315 23:48:59.857185 943965 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0315 23:48:59.861152 943965 start.go:562] Will wait 60s for crictl version
I0315 23:48:59.861284 943965 ssh_runner.go:195] Run: which crictl
I0315 23:48:59.864883 943965 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0315 23:48:59.903702 943965 start.go:578] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.6.28
RuntimeApiVersion: v1
I0315 23:48:59.903802 943965 ssh_runner.go:195] Run: containerd --version
I0315 23:48:59.929028 943965 ssh_runner.go:195] Run: containerd --version
I0315 23:48:59.955722 943965 out.go:177] * Preparing Kubernetes v1.28.4 on containerd 1.6.28 ...
I0315 23:48:58.918660 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:49:00.919360 934140 pod_ready.go:102] pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace has status "Ready":"False"
I0315 23:48:59.957732 943965 cli_runner.go:164] Run: docker network inspect embed-certs-264151 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0315 23:48:59.976921 943965 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0315 23:48:59.980715 943965 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0315 23:48:59.992417 943965 kubeadm.go:877] updating cluster {Name:embed-certs-264151 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-264151 Namespace:default APIServerHAVIP: APIServerName:minikubeCA AP
IServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:
false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0315 23:48:59.992546 943965 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime containerd
I0315 23:48:59.992613 943965 ssh_runner.go:195] Run: sudo crictl images --output json
I0315 23:49:00.324225 943965 containerd.go:612] all images are preloaded for containerd runtime.
I0315 23:49:00.333497 943965 containerd.go:519] Images already preloaded, skipping extraction
I0315 23:49:00.334240 943965 ssh_runner.go:195] Run: sudo crictl images --output json
I0315 23:49:00.406737 943965 containerd.go:612] all images are preloaded for containerd runtime.
I0315 23:49:00.406767 943965 cache_images.go:84] Images are preloaded, skipping loading
I0315 23:49:00.406775 943965 kubeadm.go:928] updating node { 192.168.85.2 8443 v1.28.4 containerd true true} ...
I0315 23:49:00.406894 943965 kubeadm.go:940] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=embed-certs-264151 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:embed-certs-264151 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0315 23:49:00.406974 943965 ssh_runner.go:195] Run: sudo crictl info
I0315 23:49:00.457196 943965 cni.go:84] Creating CNI manager for ""
I0315 23:49:00.457224 943965 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0315 23:49:00.457234 943965 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0315 23:49:00.457260 943965 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-264151 NodeName:embed-certs-264151 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0315 23:49:00.457420 943965 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "embed-certs-264151"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0315 23:49:00.457499 943965 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0315 23:49:00.469355 943965 binaries.go:44] Found k8s binaries, skipping transfer
I0315 23:49:00.469435 943965 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0315 23:49:00.480926 943965 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (322 bytes)
I0315 23:49:00.503682 943965 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0315 23:49:00.526118 943965 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2172 bytes)
I0315 23:49:00.549470 943965 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0315 23:49:00.553516 943965 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0315 23:49:00.567004 943965 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0315 23:49:00.664954 943965 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0315 23:49:00.686330 943965 certs.go:68] Setting up /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151 for IP: 192.168.85.2
I0315 23:49:00.686350 943965 certs.go:194] generating shared ca certs ...
I0315 23:49:00.686393 943965 certs.go:226] acquiring lock for ca certs: {Name:mk85379830d1b1fdedd16ced987b422a0f48ac0c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0315 23:49:00.686554 943965 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17991-732709/.minikube/ca.key
I0315 23:49:00.686624 943965 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17991-732709/.minikube/proxy-client-ca.key
I0315 23:49:00.686639 943965 certs.go:256] generating profile certs ...
I0315 23:49:00.686714 943965 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/client.key
I0315 23:49:00.686732 943965 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/client.crt with IP's: []
I0315 23:49:00.993213 943965 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/client.crt ...
I0315 23:49:00.993247 943965 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/client.crt: {Name:mk38077a9fa8d7463a62d5913f596d68331f9b23 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0315 23:49:00.994040 943965 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/client.key ...
I0315 23:49:00.994060 943965 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/client.key: {Name:mk0427d194e8019b632c7e12a8db30a9ae06a2fc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0315 23:49:00.994177 943965 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/apiserver.key.44dd03e5
I0315 23:49:00.994198 943965 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/apiserver.crt.44dd03e5 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.85.2]
I0315 23:49:02.180037 943965 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/apiserver.crt.44dd03e5 ...
I0315 23:49:02.180069 943965 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/apiserver.crt.44dd03e5: {Name:mk2e11f5f597fc2750fa76f26502ecfbaed07be9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0315 23:49:02.180266 943965 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/apiserver.key.44dd03e5 ...
I0315 23:49:02.180281 943965 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/apiserver.key.44dd03e5: {Name:mkc8b1657342b3c4a44f4dc5f304cff069cc63c2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0315 23:49:02.180368 943965 certs.go:381] copying /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/apiserver.crt.44dd03e5 -> /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/apiserver.crt
I0315 23:49:02.180451 943965 certs.go:385] copying /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/apiserver.key.44dd03e5 -> /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/apiserver.key
I0315 23:49:02.180513 943965 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/proxy-client.key
I0315 23:49:02.180533 943965 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/proxy-client.crt with IP's: []
I0315 23:49:03.858153 943965 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/proxy-client.crt ...
I0315 23:49:03.858258 943965 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/proxy-client.crt: {Name:mk6f01b5ff8085e2a9bdab99682d26a75d4cc2d1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0315 23:49:03.858666 943965 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/proxy-client.key ...
I0315 23:49:03.858706 943965 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/proxy-client.key: {Name:mk45b712470c2ab61af579ba8e22fd80bac5175b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0315 23:49:03.860062 943965 certs.go:484] found cert: /home/jenkins/minikube-integration/17991-732709/.minikube/certs/738116.pem (1338 bytes)
W0315 23:49:03.860194 943965 certs.go:480] ignoring /home/jenkins/minikube-integration/17991-732709/.minikube/certs/738116_empty.pem, impossibly tiny 0 bytes
I0315 23:49:03.860239 943965 certs.go:484] found cert: /home/jenkins/minikube-integration/17991-732709/.minikube/certs/ca-key.pem (1679 bytes)
I0315 23:49:03.860398 943965 certs.go:484] found cert: /home/jenkins/minikube-integration/17991-732709/.minikube/certs/ca.pem (1078 bytes)
I0315 23:49:03.860511 943965 certs.go:484] found cert: /home/jenkins/minikube-integration/17991-732709/.minikube/certs/cert.pem (1123 bytes)
I0315 23:49:03.860570 943965 certs.go:484] found cert: /home/jenkins/minikube-integration/17991-732709/.minikube/certs/key.pem (1675 bytes)
I0315 23:49:03.860720 943965 certs.go:484] found cert: /home/jenkins/minikube-integration/17991-732709/.minikube/files/etc/ssl/certs/7381162.pem (1708 bytes)
I0315 23:49:03.861980 943965 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0315 23:49:03.914790 943965 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0315 23:49:02.418440 934140 pod_ready.go:81] duration metric: took 4m0.007410875s for pod "metrics-server-9975d5f86-ltkj7" in "kube-system" namespace to be "Ready" ...
E0315 23:49:02.418461 934140 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0315 23:49:02.418469 934140 pod_ready.go:38] duration metric: took 5m25.760583995s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0315 23:49:02.418483 934140 api_server.go:52] waiting for apiserver process to appear ...
I0315 23:49:02.418512 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0315 23:49:02.418573 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0315 23:49:02.487905 934140 cri.go:89] found id: "0b82f42fc451d7affa0d14e641d6e50757f32f06a52f51b1b4c2a10e06459069"
I0315 23:49:02.487974 934140 cri.go:89] found id: "e8c4821ea89657837e9b8bc47f8e119ae8d9f7f26c1e2ea8bbe98c2d0b8cc790"
I0315 23:49:02.487994 934140 cri.go:89] found id: ""
I0315 23:49:02.488016 934140 logs.go:276] 2 containers: [0b82f42fc451d7affa0d14e641d6e50757f32f06a52f51b1b4c2a10e06459069 e8c4821ea89657837e9b8bc47f8e119ae8d9f7f26c1e2ea8bbe98c2d0b8cc790]
I0315 23:49:02.488104 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.492364 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.496245 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0315 23:49:02.496312 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0315 23:49:02.548566 934140 cri.go:89] found id: "32e2364d0f85d10892426c4892f412de9be4c7914009845e1e0c665542d1ffa9"
I0315 23:49:02.548586 934140 cri.go:89] found id: "7c106e53b87dcc5de6dccc177c6e2532608dad6decd8dd578ca8fb725410a82d"
I0315 23:49:02.548591 934140 cri.go:89] found id: ""
I0315 23:49:02.548599 934140 logs.go:276] 2 containers: [32e2364d0f85d10892426c4892f412de9be4c7914009845e1e0c665542d1ffa9 7c106e53b87dcc5de6dccc177c6e2532608dad6decd8dd578ca8fb725410a82d]
I0315 23:49:02.548653 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.552653 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.557670 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0315 23:49:02.557785 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0315 23:49:02.623493 934140 cri.go:89] found id: "e24480384e8b14f9cc8f6a77e4db38f4b774a420ea71bccd932190dc49e972e6"
I0315 23:49:02.623561 934140 cri.go:89] found id: "6711aefac62eb67e3b17a32bab9337210ab97ce4741f2339d6927f6f1ce15edd"
I0315 23:49:02.623584 934140 cri.go:89] found id: ""
I0315 23:49:02.623609 934140 logs.go:276] 2 containers: [e24480384e8b14f9cc8f6a77e4db38f4b774a420ea71bccd932190dc49e972e6 6711aefac62eb67e3b17a32bab9337210ab97ce4741f2339d6927f6f1ce15edd]
I0315 23:49:02.623693 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.628507 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.632691 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0315 23:49:02.632837 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0315 23:49:02.720660 934140 cri.go:89] found id: "a3f302b11bfa0e70126388c182f4d8009d91933a51ee175c23839f45d8da3577"
I0315 23:49:02.720743 934140 cri.go:89] found id: "80be09ea64652be3631bf46d9388d9f25564d3039bd1e13cca1ae9b95db2188d"
I0315 23:49:02.720763 934140 cri.go:89] found id: ""
I0315 23:49:02.720788 934140 logs.go:276] 2 containers: [a3f302b11bfa0e70126388c182f4d8009d91933a51ee175c23839f45d8da3577 80be09ea64652be3631bf46d9388d9f25564d3039bd1e13cca1ae9b95db2188d]
I0315 23:49:02.720882 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.726121 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.731617 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0315 23:49:02.731760 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0315 23:49:02.801913 934140 cri.go:89] found id: "f2d97e620a060322b239d2751d8d93b2656fd7741e45af5aca547f61e04fc64a"
I0315 23:49:02.802003 934140 cri.go:89] found id: "4476e3f7821c932adced40dcd348993b203a9f5597562662cb2680d470f82585"
I0315 23:49:02.802028 934140 cri.go:89] found id: ""
I0315 23:49:02.802055 934140 logs.go:276] 2 containers: [f2d97e620a060322b239d2751d8d93b2656fd7741e45af5aca547f61e04fc64a 4476e3f7821c932adced40dcd348993b203a9f5597562662cb2680d470f82585]
I0315 23:49:02.802176 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.807390 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.812475 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0315 23:49:02.812679 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0315 23:49:02.878160 934140 cri.go:89] found id: "5da4950534a0bd1eda271710cc179a06c37b8638bc1f4c14254faa5a17c34416"
I0315 23:49:02.878229 934140 cri.go:89] found id: "040b549f2a914173d3fe9c7a601c396eb6e5db6b59f39a67785e6760cf69ffa4"
I0315 23:49:02.878269 934140 cri.go:89] found id: ""
I0315 23:49:02.878294 934140 logs.go:276] 2 containers: [5da4950534a0bd1eda271710cc179a06c37b8638bc1f4c14254faa5a17c34416 040b549f2a914173d3fe9c7a601c396eb6e5db6b59f39a67785e6760cf69ffa4]
I0315 23:49:02.878407 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.883653 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.888612 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0315 23:49:02.888753 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0315 23:49:02.944141 934140 cri.go:89] found id: "528a22f565f78d4f3c888ca0711b45b7aac306832106588270edd1a5a169cc67"
I0315 23:49:02.944166 934140 cri.go:89] found id: "0088d2446dda408eb46d068ce7b0a048c3e567c0d81c9d75219817d46640bb68"
I0315 23:49:02.944171 934140 cri.go:89] found id: ""
I0315 23:49:02.944178 934140 logs.go:276] 2 containers: [528a22f565f78d4f3c888ca0711b45b7aac306832106588270edd1a5a169cc67 0088d2446dda408eb46d068ce7b0a048c3e567c0d81c9d75219817d46640bb68]
I0315 23:49:02.944238 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.948680 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:02.953303 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0315 23:49:02.953443 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0315 23:49:03.010717 934140 cri.go:89] found id: "869cb514e87f1834ff32f1380bc3338f18531c3749ff6e334089ed165274a9e3"
I0315 23:49:03.010793 934140 cri.go:89] found id: "f90ea0d50a8b7e01ed1e789326a149ebf034033fc89b9abb9b5dba3f1984efb4"
I0315 23:49:03.010811 934140 cri.go:89] found id: ""
I0315 23:49:03.010837 934140 logs.go:276] 2 containers: [869cb514e87f1834ff32f1380bc3338f18531c3749ff6e334089ed165274a9e3 f90ea0d50a8b7e01ed1e789326a149ebf034033fc89b9abb9b5dba3f1984efb4]
I0315 23:49:03.010944 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:03.016133 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:03.020852 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0315 23:49:03.021016 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0315 23:49:03.075862 934140 cri.go:89] found id: "60b9aafb04ea8824fed3cfba5719a397905e02658b9036d814c69569019d92c9"
I0315 23:49:03.075935 934140 cri.go:89] found id: ""
I0315 23:49:03.075958 934140 logs.go:276] 1 containers: [60b9aafb04ea8824fed3cfba5719a397905e02658b9036d814c69569019d92c9]
I0315 23:49:03.076050 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:03.081137 934140 logs.go:123] Gathering logs for kubernetes-dashboard [60b9aafb04ea8824fed3cfba5719a397905e02658b9036d814c69569019d92c9] ...
I0315 23:49:03.081212 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 60b9aafb04ea8824fed3cfba5719a397905e02658b9036d814c69569019d92c9"
I0315 23:49:03.235809 934140 logs.go:123] Gathering logs for describe nodes ...
I0315 23:49:03.235885 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0315 23:49:03.423715 934140 logs.go:123] Gathering logs for kube-apiserver [0b82f42fc451d7affa0d14e641d6e50757f32f06a52f51b1b4c2a10e06459069] ...
I0315 23:49:03.423878 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0b82f42fc451d7affa0d14e641d6e50757f32f06a52f51b1b4c2a10e06459069"
I0315 23:49:03.517719 934140 logs.go:123] Gathering logs for kube-apiserver [e8c4821ea89657837e9b8bc47f8e119ae8d9f7f26c1e2ea8bbe98c2d0b8cc790] ...
I0315 23:49:03.517796 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e8c4821ea89657837e9b8bc47f8e119ae8d9f7f26c1e2ea8bbe98c2d0b8cc790"
I0315 23:49:03.587880 934140 logs.go:123] Gathering logs for kube-scheduler [a3f302b11bfa0e70126388c182f4d8009d91933a51ee175c23839f45d8da3577] ...
I0315 23:49:03.587917 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a3f302b11bfa0e70126388c182f4d8009d91933a51ee175c23839f45d8da3577"
I0315 23:49:03.636419 934140 logs.go:123] Gathering logs for kube-proxy [f2d97e620a060322b239d2751d8d93b2656fd7741e45af5aca547f61e04fc64a] ...
I0315 23:49:03.636449 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f2d97e620a060322b239d2751d8d93b2656fd7741e45af5aca547f61e04fc64a"
I0315 23:49:03.687222 934140 logs.go:123] Gathering logs for storage-provisioner [869cb514e87f1834ff32f1380bc3338f18531c3749ff6e334089ed165274a9e3] ...
I0315 23:49:03.687246 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 869cb514e87f1834ff32f1380bc3338f18531c3749ff6e334089ed165274a9e3"
I0315 23:49:03.734173 934140 logs.go:123] Gathering logs for storage-provisioner [f90ea0d50a8b7e01ed1e789326a149ebf034033fc89b9abb9b5dba3f1984efb4] ...
I0315 23:49:03.734202 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f90ea0d50a8b7e01ed1e789326a149ebf034033fc89b9abb9b5dba3f1984efb4"
I0315 23:49:03.783432 934140 logs.go:123] Gathering logs for dmesg ...
I0315 23:49:03.783458 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0315 23:49:03.803258 934140 logs.go:123] Gathering logs for etcd [7c106e53b87dcc5de6dccc177c6e2532608dad6decd8dd578ca8fb725410a82d] ...
I0315 23:49:03.803287 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7c106e53b87dcc5de6dccc177c6e2532608dad6decd8dd578ca8fb725410a82d"
I0315 23:49:03.875204 934140 logs.go:123] Gathering logs for coredns [e24480384e8b14f9cc8f6a77e4db38f4b774a420ea71bccd932190dc49e972e6] ...
I0315 23:49:03.875236 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e24480384e8b14f9cc8f6a77e4db38f4b774a420ea71bccd932190dc49e972e6"
I0315 23:49:03.932360 934140 logs.go:123] Gathering logs for coredns [6711aefac62eb67e3b17a32bab9337210ab97ce4741f2339d6927f6f1ce15edd] ...
I0315 23:49:03.932389 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6711aefac62eb67e3b17a32bab9337210ab97ce4741f2339d6927f6f1ce15edd"
I0315 23:49:03.996519 934140 logs.go:123] Gathering logs for kube-scheduler [80be09ea64652be3631bf46d9388d9f25564d3039bd1e13cca1ae9b95db2188d] ...
I0315 23:49:03.996549 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 80be09ea64652be3631bf46d9388d9f25564d3039bd1e13cca1ae9b95db2188d"
I0315 23:49:04.062936 934140 logs.go:123] Gathering logs for kube-proxy [4476e3f7821c932adced40dcd348993b203a9f5597562662cb2680d470f82585] ...
I0315 23:49:04.062969 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4476e3f7821c932adced40dcd348993b203a9f5597562662cb2680d470f82585"
I0315 23:49:04.167304 934140 logs.go:123] Gathering logs for kube-controller-manager [040b549f2a914173d3fe9c7a601c396eb6e5db6b59f39a67785e6760cf69ffa4] ...
I0315 23:49:04.167342 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 040b549f2a914173d3fe9c7a601c396eb6e5db6b59f39a67785e6760cf69ffa4"
I0315 23:49:04.258444 934140 logs.go:123] Gathering logs for etcd [32e2364d0f85d10892426c4892f412de9be4c7914009845e1e0c665542d1ffa9] ...
I0315 23:49:04.258481 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 32e2364d0f85d10892426c4892f412de9be4c7914009845e1e0c665542d1ffa9"
I0315 23:49:04.324554 934140 logs.go:123] Gathering logs for kindnet [528a22f565f78d4f3c888ca0711b45b7aac306832106588270edd1a5a169cc67] ...
I0315 23:49:04.324582 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 528a22f565f78d4f3c888ca0711b45b7aac306832106588270edd1a5a169cc67"
I0315 23:49:04.408777 934140 logs.go:123] Gathering logs for kindnet [0088d2446dda408eb46d068ce7b0a048c3e567c0d81c9d75219817d46640bb68] ...
I0315 23:49:04.408885 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0088d2446dda408eb46d068ce7b0a048c3e567c0d81c9d75219817d46640bb68"
I0315 23:49:04.470848 934140 logs.go:123] Gathering logs for containerd ...
I0315 23:49:04.470929 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0315 23:49:04.546018 934140 logs.go:123] Gathering logs for container status ...
I0315 23:49:04.546067 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0315 23:49:04.628452 934140 logs.go:123] Gathering logs for kubelet ...
I0315 23:49:04.628617 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0315 23:49:04.697950 934140 logs.go:138] Found kubelet problem: Mar 15 23:43:38 old-k8s-version-580201 kubelet[660]: E0315 23:43:38.168211 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0315 23:49:04.698160 934140 logs.go:138] Found kubelet problem: Mar 15 23:43:38 old-k8s-version-580201 kubelet[660]: E0315 23:43:38.447627 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.702879 934140 logs.go:138] Found kubelet problem: Mar 15 23:43:49 old-k8s-version-580201 kubelet[660]: E0315 23:43:49.078921 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0315 23:49:04.705358 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:02 old-k8s-version-580201 kubelet[660]: E0315 23:44:02.514144 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.705744 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:03 old-k8s-version-580201 kubelet[660]: E0315 23:44:03.525249 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.705939 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:04 old-k8s-version-580201 kubelet[660]: E0315 23:44:04.083066 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.706262 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:07 old-k8s-version-580201 kubelet[660]: E0315 23:44:07.796587 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.707036 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:09 old-k8s-version-580201 kubelet[660]: E0315 23:44:09.558017 660 pod_workers.go:191] Error syncing pod e3b514d8-a999-4528-985b-580b384ab0fe ("storage-provisioner_kube-system(e3b514d8-a999-4528-985b-580b384ab0fe)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(e3b514d8-a999-4528-985b-580b384ab0fe)"
W0315 23:49:04.709760 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:16 old-k8s-version-580201 kubelet[660]: E0315 23:44:16.114358 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0315 23:49:04.710693 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:19 old-k8s-version-580201 kubelet[660]: E0315 23:44:19.582433 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.711147 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:27 old-k8s-version-580201 kubelet[660]: E0315 23:44:27.796953 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.711340 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:31 old-k8s-version-580201 kubelet[660]: E0315 23:44:31.071314 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.711926 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:40 old-k8s-version-580201 kubelet[660]: E0315 23:44:40.627438 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.712111 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:46 old-k8s-version-580201 kubelet[660]: E0315 23:44:46.073377 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.712434 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:47 old-k8s-version-580201 kubelet[660]: E0315 23:44:47.797074 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.712759 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:58 old-k8s-version-580201 kubelet[660]: E0315 23:44:58.071365 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.715199 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:01 old-k8s-version-580201 kubelet[660]: E0315 23:45:01.080381 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0315 23:49:04.715532 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:10 old-k8s-version-580201 kubelet[660]: E0315 23:45:10.070158 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.715721 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:14 old-k8s-version-580201 kubelet[660]: E0315 23:45:14.080146 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.716316 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:24 old-k8s-version-580201 kubelet[660]: E0315 23:45:24.722441 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.716501 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:27 old-k8s-version-580201 kubelet[660]: E0315 23:45:27.070513 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.716889 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:27 old-k8s-version-580201 kubelet[660]: E0315 23:45:27.796618 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.717140 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:39 old-k8s-version-580201 kubelet[660]: E0315 23:45:39.072878 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.717470 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:43 old-k8s-version-580201 kubelet[660]: E0315 23:45:43.071627 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.717655 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:50 old-k8s-version-580201 kubelet[660]: E0315 23:45:50.076912 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.717981 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:54 old-k8s-version-580201 kubelet[660]: E0315 23:45:54.070693 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.718174 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:04 old-k8s-version-580201 kubelet[660]: E0315 23:46:04.070561 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.718498 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:08 old-k8s-version-580201 kubelet[660]: E0315 23:46:08.071900 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.718680 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:15 old-k8s-version-580201 kubelet[660]: E0315 23:46:15.073502 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.719004 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:19 old-k8s-version-580201 kubelet[660]: E0315 23:46:19.071478 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.721522 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:27 old-k8s-version-580201 kubelet[660]: E0315 23:46:27.079768 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0315 23:49:04.721858 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:31 old-k8s-version-580201 kubelet[660]: E0315 23:46:31.070173 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.722047 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:38 old-k8s-version-580201 kubelet[660]: E0315 23:46:38.072174 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.722379 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:43 old-k8s-version-580201 kubelet[660]: E0315 23:46:43.072871 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.722564 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:51 old-k8s-version-580201 kubelet[660]: E0315 23:46:51.072184 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.723144 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:56 old-k8s-version-580201 kubelet[660]: E0315 23:46:56.925610 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.723475 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:57 old-k8s-version-580201 kubelet[660]: E0315 23:46:57.929174 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.723659 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:03 old-k8s-version-580201 kubelet[660]: E0315 23:47:03.071171 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.723983 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:09 old-k8s-version-580201 kubelet[660]: E0315 23:47:09.073488 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.724166 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:14 old-k8s-version-580201 kubelet[660]: E0315 23:47:14.071340 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.724492 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:24 old-k8s-version-580201 kubelet[660]: E0315 23:47:24.071090 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.724677 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:25 old-k8s-version-580201 kubelet[660]: E0315 23:47:25.071677 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.729910 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:35 old-k8s-version-580201 kubelet[660]: E0315 23:47:35.071989 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.730126 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:36 old-k8s-version-580201 kubelet[660]: E0315 23:47:36.077771 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.730463 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:47 old-k8s-version-580201 kubelet[660]: E0315 23:47:47.070572 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.730661 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:49 old-k8s-version-580201 kubelet[660]: E0315 23:47:49.071077 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.731037 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:59 old-k8s-version-580201 kubelet[660]: E0315 23:47:59.070094 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.731227 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:04 old-k8s-version-580201 kubelet[660]: E0315 23:48:04.070705 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.731570 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:14 old-k8s-version-580201 kubelet[660]: E0315 23:48:14.072003 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.731755 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:15 old-k8s-version-580201 kubelet[660]: E0315 23:48:15.072752 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.731938 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:28 old-k8s-version-580201 kubelet[660]: E0315 23:48:28.075534 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.732271 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:28 old-k8s-version-580201 kubelet[660]: E0315 23:48:28.076533 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.732459 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:39 old-k8s-version-580201 kubelet[660]: E0315 23:48:39.070552 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.736641 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:40 old-k8s-version-580201 kubelet[660]: E0315 23:48:40.070289 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.737020 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: E0315 23:48:51.070831 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.737207 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: E0315 23:48:51.071399 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.737537 934140 logs.go:138] Found kubelet problem: Mar 15 23:49:02 old-k8s-version-580201 kubelet[660]: E0315 23:49:02.070699 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.737722 934140 logs.go:138] Found kubelet problem: Mar 15 23:49:04 old-k8s-version-580201 kubelet[660]: E0315 23:49:04.070710 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0315 23:49:04.737736 934140 logs.go:123] Gathering logs for kube-controller-manager [5da4950534a0bd1eda271710cc179a06c37b8638bc1f4c14254faa5a17c34416] ...
I0315 23:49:04.737752 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5da4950534a0bd1eda271710cc179a06c37b8638bc1f4c14254faa5a17c34416"
I0315 23:49:04.827631 934140 out.go:304] Setting ErrFile to fd 2...
I0315 23:49:04.827665 934140 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0315 23:49:04.827722 934140 out.go:239] X Problems detected in kubelet:
W0315 23:49:04.827738 934140 out.go:239] Mar 15 23:48:40 old-k8s-version-580201 kubelet[660]: E0315 23:48:40.070289 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.827751 934140 out.go:239] Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: E0315 23:48:51.070831 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.827764 934140 out.go:239] Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: E0315 23:48:51.071399 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:04.827774 934140 out.go:239] Mar 15 23:49:02 old-k8s-version-580201 kubelet[660]: E0315 23:49:02.070699 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:04.827789 934140 out.go:239] Mar 15 23:49:04 old-k8s-version-580201 kubelet[660]: E0315 23:49:04.070710 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0315 23:49:04.827795 934140 out.go:304] Setting ErrFile to fd 2...
I0315 23:49:04.827804 934140 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0315 23:49:03.956588 943965 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0315 23:49:03.998561 943965 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0315 23:49:04.044357 943965 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
I0315 23:49:04.088917 943965 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0315 23:49:04.120768 943965 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0315 23:49:04.148079 943965 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/profiles/embed-certs-264151/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0315 23:49:04.179198 943965 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/certs/738116.pem --> /usr/share/ca-certificates/738116.pem (1338 bytes)
I0315 23:49:04.207144 943965 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/files/etc/ssl/certs/7381162.pem --> /usr/share/ca-certificates/7381162.pem (1708 bytes)
I0315 23:49:04.266818 943965 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17991-732709/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0315 23:49:04.298109 943965 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0315 23:49:04.324838 943965 ssh_runner.go:195] Run: openssl version
I0315 23:49:04.331459 943965 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/738116.pem && ln -fs /usr/share/ca-certificates/738116.pem /etc/ssl/certs/738116.pem"
I0315 23:49:04.343386 943965 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/738116.pem
I0315 23:49:04.350058 943965 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Mar 15 23:02 /usr/share/ca-certificates/738116.pem
I0315 23:49:04.350173 943965 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/738116.pem
I0315 23:49:04.358138 943965 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/738116.pem /etc/ssl/certs/51391683.0"
I0315 23:49:04.371002 943965 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7381162.pem && ln -fs /usr/share/ca-certificates/7381162.pem /etc/ssl/certs/7381162.pem"
I0315 23:49:04.382085 943965 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7381162.pem
I0315 23:49:04.386134 943965 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Mar 15 23:02 /usr/share/ca-certificates/7381162.pem
I0315 23:49:04.386256 943965 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7381162.pem
I0315 23:49:04.397694 943965 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/7381162.pem /etc/ssl/certs/3ec20f2e.0"
I0315 23:49:04.413686 943965 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0315 23:49:04.426658 943965 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0315 23:49:04.430801 943965 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 15 22:57 /usr/share/ca-certificates/minikubeCA.pem
I0315 23:49:04.430920 943965 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0315 23:49:04.438562 943965 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0315 23:49:04.451923 943965 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0315 23:49:04.455911 943965 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0315 23:49:04.456036 943965 kubeadm.go:391] StartCluster: {Name:embed-certs-264151 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-264151 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fal
se CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0315 23:49:04.456192 943965 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0315 23:49:04.456291 943965 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0315 23:49:04.528786 943965 cri.go:89] found id: ""
I0315 23:49:04.528923 943965 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0315 23:49:04.545565 943965 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0315 23:49:04.558663 943965 kubeadm.go:213] ignoring SystemVerification for kubeadm because of docker driver
I0315 23:49:04.558728 943965 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0315 23:49:04.572268 943965 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0315 23:49:04.572291 943965 kubeadm.go:156] found existing configuration files:
I0315 23:49:04.572344 943965 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0315 23:49:04.583458 943965 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0315 23:49:04.583526 943965 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0315 23:49:04.594059 943965 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0315 23:49:04.606059 943965 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0315 23:49:04.606145 943965 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0315 23:49:04.619607 943965 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0315 23:49:04.632923 943965 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0315 23:49:04.632989 943965 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0315 23:49:04.644621 943965 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0315 23:49:04.660322 943965 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0315 23:49:04.660393 943965 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0315 23:49:04.674805 943965 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0315 23:49:04.818986 943965 kubeadm.go:309] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1055-aws\n", err: exit status 1
I0315 23:49:04.914510 943965 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0315 23:49:14.829795 934140 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0315 23:49:14.843750 934140 api_server.go:72] duration metric: took 5m54.610976225s to wait for apiserver process to appear ...
I0315 23:49:14.843776 934140 api_server.go:88] waiting for apiserver healthz status ...
I0315 23:49:14.843811 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0315 23:49:14.843875 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0315 23:49:14.890715 934140 cri.go:89] found id: "0b82f42fc451d7affa0d14e641d6e50757f32f06a52f51b1b4c2a10e06459069"
I0315 23:49:14.890736 934140 cri.go:89] found id: "e8c4821ea89657837e9b8bc47f8e119ae8d9f7f26c1e2ea8bbe98c2d0b8cc790"
I0315 23:49:14.890741 934140 cri.go:89] found id: ""
I0315 23:49:14.890750 934140 logs.go:276] 2 containers: [0b82f42fc451d7affa0d14e641d6e50757f32f06a52f51b1b4c2a10e06459069 e8c4821ea89657837e9b8bc47f8e119ae8d9f7f26c1e2ea8bbe98c2d0b8cc790]
I0315 23:49:14.890803 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:14.894707 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:14.898265 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0315 23:49:14.898339 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0315 23:49:14.937502 934140 cri.go:89] found id: "32e2364d0f85d10892426c4892f412de9be4c7914009845e1e0c665542d1ffa9"
I0315 23:49:14.937528 934140 cri.go:89] found id: "7c106e53b87dcc5de6dccc177c6e2532608dad6decd8dd578ca8fb725410a82d"
I0315 23:49:14.937534 934140 cri.go:89] found id: ""
I0315 23:49:14.937542 934140 logs.go:276] 2 containers: [32e2364d0f85d10892426c4892f412de9be4c7914009845e1e0c665542d1ffa9 7c106e53b87dcc5de6dccc177c6e2532608dad6decd8dd578ca8fb725410a82d]
I0315 23:49:14.937596 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:14.941228 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:14.944562 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0315 23:49:14.944655 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0315 23:49:14.991443 934140 cri.go:89] found id: "e24480384e8b14f9cc8f6a77e4db38f4b774a420ea71bccd932190dc49e972e6"
I0315 23:49:14.991467 934140 cri.go:89] found id: "6711aefac62eb67e3b17a32bab9337210ab97ce4741f2339d6927f6f1ce15edd"
I0315 23:49:14.991472 934140 cri.go:89] found id: ""
I0315 23:49:14.991479 934140 logs.go:276] 2 containers: [e24480384e8b14f9cc8f6a77e4db38f4b774a420ea71bccd932190dc49e972e6 6711aefac62eb67e3b17a32bab9337210ab97ce4741f2339d6927f6f1ce15edd]
I0315 23:49:14.991538 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:14.995787 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.001414 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0315 23:49:15.001503 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0315 23:49:15.108240 934140 cri.go:89] found id: "a3f302b11bfa0e70126388c182f4d8009d91933a51ee175c23839f45d8da3577"
I0315 23:49:15.108397 934140 cri.go:89] found id: "80be09ea64652be3631bf46d9388d9f25564d3039bd1e13cca1ae9b95db2188d"
I0315 23:49:15.108418 934140 cri.go:89] found id: ""
I0315 23:49:15.108446 934140 logs.go:276] 2 containers: [a3f302b11bfa0e70126388c182f4d8009d91933a51ee175c23839f45d8da3577 80be09ea64652be3631bf46d9388d9f25564d3039bd1e13cca1ae9b95db2188d]
I0315 23:49:15.108539 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.114311 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.119399 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0315 23:49:15.119554 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0315 23:49:15.203878 934140 cri.go:89] found id: "f2d97e620a060322b239d2751d8d93b2656fd7741e45af5aca547f61e04fc64a"
I0315 23:49:15.203973 934140 cri.go:89] found id: "4476e3f7821c932adced40dcd348993b203a9f5597562662cb2680d470f82585"
I0315 23:49:15.203994 934140 cri.go:89] found id: ""
I0315 23:49:15.204025 934140 logs.go:276] 2 containers: [f2d97e620a060322b239d2751d8d93b2656fd7741e45af5aca547f61e04fc64a 4476e3f7821c932adced40dcd348993b203a9f5597562662cb2680d470f82585]
I0315 23:49:15.204112 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.208520 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.214358 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0315 23:49:15.214484 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0315 23:49:15.316420 934140 cri.go:89] found id: "5da4950534a0bd1eda271710cc179a06c37b8638bc1f4c14254faa5a17c34416"
I0315 23:49:15.316485 934140 cri.go:89] found id: "040b549f2a914173d3fe9c7a601c396eb6e5db6b59f39a67785e6760cf69ffa4"
I0315 23:49:15.316507 934140 cri.go:89] found id: ""
I0315 23:49:15.316533 934140 logs.go:276] 2 containers: [5da4950534a0bd1eda271710cc179a06c37b8638bc1f4c14254faa5a17c34416 040b549f2a914173d3fe9c7a601c396eb6e5db6b59f39a67785e6760cf69ffa4]
I0315 23:49:15.316621 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.323723 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.330633 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0315 23:49:15.330758 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0315 23:49:15.388935 934140 cri.go:89] found id: "528a22f565f78d4f3c888ca0711b45b7aac306832106588270edd1a5a169cc67"
I0315 23:49:15.389004 934140 cri.go:89] found id: "0088d2446dda408eb46d068ce7b0a048c3e567c0d81c9d75219817d46640bb68"
I0315 23:49:15.389023 934140 cri.go:89] found id: ""
I0315 23:49:15.389048 934140 logs.go:276] 2 containers: [528a22f565f78d4f3c888ca0711b45b7aac306832106588270edd1a5a169cc67 0088d2446dda408eb46d068ce7b0a048c3e567c0d81c9d75219817d46640bb68]
I0315 23:49:15.389123 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.395695 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.400909 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0315 23:49:15.401030 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0315 23:49:15.460045 934140 cri.go:89] found id: "60b9aafb04ea8824fed3cfba5719a397905e02658b9036d814c69569019d92c9"
I0315 23:49:15.460128 934140 cri.go:89] found id: ""
I0315 23:49:15.460154 934140 logs.go:276] 1 containers: [60b9aafb04ea8824fed3cfba5719a397905e02658b9036d814c69569019d92c9]
I0315 23:49:15.460253 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.464309 934140 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0315 23:49:15.464436 934140 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0315 23:49:15.532315 934140 cri.go:89] found id: "869cb514e87f1834ff32f1380bc3338f18531c3749ff6e334089ed165274a9e3"
I0315 23:49:15.532375 934140 cri.go:89] found id: "f90ea0d50a8b7e01ed1e789326a149ebf034033fc89b9abb9b5dba3f1984efb4"
I0315 23:49:15.532404 934140 cri.go:89] found id: ""
I0315 23:49:15.532427 934140 logs.go:276] 2 containers: [869cb514e87f1834ff32f1380bc3338f18531c3749ff6e334089ed165274a9e3 f90ea0d50a8b7e01ed1e789326a149ebf034033fc89b9abb9b5dba3f1984efb4]
I0315 23:49:15.532507 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.538281 934140 ssh_runner.go:195] Run: which crictl
I0315 23:49:15.543876 934140 logs.go:123] Gathering logs for kube-scheduler [a3f302b11bfa0e70126388c182f4d8009d91933a51ee175c23839f45d8da3577] ...
I0315 23:49:15.543942 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a3f302b11bfa0e70126388c182f4d8009d91933a51ee175c23839f45d8da3577"
I0315 23:49:15.608099 934140 logs.go:123] Gathering logs for kube-controller-manager [040b549f2a914173d3fe9c7a601c396eb6e5db6b59f39a67785e6760cf69ffa4] ...
I0315 23:49:15.608183 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 040b549f2a914173d3fe9c7a601c396eb6e5db6b59f39a67785e6760cf69ffa4"
I0315 23:49:15.719052 934140 logs.go:123] Gathering logs for kubernetes-dashboard [60b9aafb04ea8824fed3cfba5719a397905e02658b9036d814c69569019d92c9] ...
I0315 23:49:15.723250 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 60b9aafb04ea8824fed3cfba5719a397905e02658b9036d814c69569019d92c9"
I0315 23:49:15.813102 934140 logs.go:123] Gathering logs for container status ...
I0315 23:49:15.813177 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0315 23:49:15.924909 934140 logs.go:123] Gathering logs for dmesg ...
I0315 23:49:15.925000 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0315 23:49:15.952998 934140 logs.go:123] Gathering logs for coredns [6711aefac62eb67e3b17a32bab9337210ab97ce4741f2339d6927f6f1ce15edd] ...
I0315 23:49:15.953081 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6711aefac62eb67e3b17a32bab9337210ab97ce4741f2339d6927f6f1ce15edd"
I0315 23:49:16.026425 934140 logs.go:123] Gathering logs for kindnet [0088d2446dda408eb46d068ce7b0a048c3e567c0d81c9d75219817d46640bb68] ...
I0315 23:49:16.026501 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0088d2446dda408eb46d068ce7b0a048c3e567c0d81c9d75219817d46640bb68"
I0315 23:49:16.124560 934140 logs.go:123] Gathering logs for storage-provisioner [f90ea0d50a8b7e01ed1e789326a149ebf034033fc89b9abb9b5dba3f1984efb4] ...
I0315 23:49:16.124649 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f90ea0d50a8b7e01ed1e789326a149ebf034033fc89b9abb9b5dba3f1984efb4"
I0315 23:49:16.223473 934140 logs.go:123] Gathering logs for containerd ...
I0315 23:49:16.223543 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0315 23:49:16.298945 934140 logs.go:123] Gathering logs for describe nodes ...
I0315 23:49:16.299023 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0315 23:49:16.511301 934140 logs.go:123] Gathering logs for etcd [32e2364d0f85d10892426c4892f412de9be4c7914009845e1e0c665542d1ffa9] ...
I0315 23:49:16.511460 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 32e2364d0f85d10892426c4892f412de9be4c7914009845e1e0c665542d1ffa9"
I0315 23:49:16.607019 934140 logs.go:123] Gathering logs for kube-scheduler [80be09ea64652be3631bf46d9388d9f25564d3039bd1e13cca1ae9b95db2188d] ...
I0315 23:49:16.607184 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 80be09ea64652be3631bf46d9388d9f25564d3039bd1e13cca1ae9b95db2188d"
I0315 23:49:16.684433 934140 logs.go:123] Gathering logs for kube-proxy [4476e3f7821c932adced40dcd348993b203a9f5597562662cb2680d470f82585] ...
I0315 23:49:16.684523 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4476e3f7821c932adced40dcd348993b203a9f5597562662cb2680d470f82585"
I0315 23:49:16.760973 934140 logs.go:123] Gathering logs for kube-controller-manager [5da4950534a0bd1eda271710cc179a06c37b8638bc1f4c14254faa5a17c34416] ...
I0315 23:49:16.761045 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5da4950534a0bd1eda271710cc179a06c37b8638bc1f4c14254faa5a17c34416"
I0315 23:49:16.868424 934140 logs.go:123] Gathering logs for kindnet [528a22f565f78d4f3c888ca0711b45b7aac306832106588270edd1a5a169cc67] ...
I0315 23:49:16.868506 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 528a22f565f78d4f3c888ca0711b45b7aac306832106588270edd1a5a169cc67"
I0315 23:49:16.959549 934140 logs.go:123] Gathering logs for storage-provisioner [869cb514e87f1834ff32f1380bc3338f18531c3749ff6e334089ed165274a9e3] ...
I0315 23:49:16.959628 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 869cb514e87f1834ff32f1380bc3338f18531c3749ff6e334089ed165274a9e3"
I0315 23:49:17.021960 934140 logs.go:123] Gathering logs for kube-apiserver [0b82f42fc451d7affa0d14e641d6e50757f32f06a52f51b1b4c2a10e06459069] ...
I0315 23:49:17.022043 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0b82f42fc451d7affa0d14e641d6e50757f32f06a52f51b1b4c2a10e06459069"
I0315 23:49:17.143351 934140 logs.go:123] Gathering logs for etcd [7c106e53b87dcc5de6dccc177c6e2532608dad6decd8dd578ca8fb725410a82d] ...
I0315 23:49:17.143429 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7c106e53b87dcc5de6dccc177c6e2532608dad6decd8dd578ca8fb725410a82d"
I0315 23:49:17.235131 934140 logs.go:123] Gathering logs for coredns [e24480384e8b14f9cc8f6a77e4db38f4b774a420ea71bccd932190dc49e972e6] ...
I0315 23:49:17.235226 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e24480384e8b14f9cc8f6a77e4db38f4b774a420ea71bccd932190dc49e972e6"
I0315 23:49:17.316052 934140 logs.go:123] Gathering logs for kube-proxy [f2d97e620a060322b239d2751d8d93b2656fd7741e45af5aca547f61e04fc64a] ...
I0315 23:49:17.316147 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f2d97e620a060322b239d2751d8d93b2656fd7741e45af5aca547f61e04fc64a"
I0315 23:49:17.406200 934140 logs.go:123] Gathering logs for kubelet ...
I0315 23:49:17.406303 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0315 23:49:17.491045 934140 logs.go:138] Found kubelet problem: Mar 15 23:43:38 old-k8s-version-580201 kubelet[660]: E0315 23:43:38.168211 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0315 23:49:17.491337 934140 logs.go:138] Found kubelet problem: Mar 15 23:43:38 old-k8s-version-580201 kubelet[660]: E0315 23:43:38.447627 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.494185 934140 logs.go:138] Found kubelet problem: Mar 15 23:43:49 old-k8s-version-580201 kubelet[660]: E0315 23:43:49.078921 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0315 23:49:17.496810 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:02 old-k8s-version-580201 kubelet[660]: E0315 23:44:02.514144 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.497215 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:03 old-k8s-version-580201 kubelet[660]: E0315 23:44:03.525249 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.497439 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:04 old-k8s-version-580201 kubelet[660]: E0315 23:44:04.083066 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.497801 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:07 old-k8s-version-580201 kubelet[660]: E0315 23:44:07.796587 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.498636 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:09 old-k8s-version-580201 kubelet[660]: E0315 23:44:09.558017 660 pod_workers.go:191] Error syncing pod e3b514d8-a999-4528-985b-580b384ab0fe ("storage-provisioner_kube-system(e3b514d8-a999-4528-985b-580b384ab0fe)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(e3b514d8-a999-4528-985b-580b384ab0fe)"
W0315 23:49:17.501466 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:16 old-k8s-version-580201 kubelet[660]: E0315 23:44:16.114358 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0315 23:49:17.502548 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:19 old-k8s-version-580201 kubelet[660]: E0315 23:44:19.582433 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.503041 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:27 old-k8s-version-580201 kubelet[660]: E0315 23:44:27.796953 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.503254 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:31 old-k8s-version-580201 kubelet[660]: E0315 23:44:31.071314 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.503867 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:40 old-k8s-version-580201 kubelet[660]: E0315 23:44:40.627438 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.504078 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:46 old-k8s-version-580201 kubelet[660]: E0315 23:44:46.073377 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.504443 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:47 old-k8s-version-580201 kubelet[660]: E0315 23:44:47.797074 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.504806 934140 logs.go:138] Found kubelet problem: Mar 15 23:44:58 old-k8s-version-580201 kubelet[660]: E0315 23:44:58.071365 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.507268 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:01 old-k8s-version-580201 kubelet[660]: E0315 23:45:01.080381 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0315 23:49:17.507628 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:10 old-k8s-version-580201 kubelet[660]: E0315 23:45:10.070158 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.507905 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:14 old-k8s-version-580201 kubelet[660]: E0315 23:45:14.080146 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.508546 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:24 old-k8s-version-580201 kubelet[660]: E0315 23:45:24.722441 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.508767 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:27 old-k8s-version-580201 kubelet[660]: E0315 23:45:27.070513 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.509231 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:27 old-k8s-version-580201 kubelet[660]: E0315 23:45:27.796618 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.509456 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:39 old-k8s-version-580201 kubelet[660]: E0315 23:45:39.072878 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.509808 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:43 old-k8s-version-580201 kubelet[660]: E0315 23:45:43.071627 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.510053 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:50 old-k8s-version-580201 kubelet[660]: E0315 23:45:50.076912 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.510379 934140 logs.go:138] Found kubelet problem: Mar 15 23:45:54 old-k8s-version-580201 kubelet[660]: E0315 23:45:54.070693 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.510562 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:04 old-k8s-version-580201 kubelet[660]: E0315 23:46:04.070561 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.510883 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:08 old-k8s-version-580201 kubelet[660]: E0315 23:46:08.071900 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.511063 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:15 old-k8s-version-580201 kubelet[660]: E0315 23:46:15.073502 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.511393 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:19 old-k8s-version-580201 kubelet[660]: E0315 23:46:19.071478 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.513802 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:27 old-k8s-version-580201 kubelet[660]: E0315 23:46:27.079768 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0315 23:49:17.514122 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:31 old-k8s-version-580201 kubelet[660]: E0315 23:46:31.070173 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.514305 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:38 old-k8s-version-580201 kubelet[660]: E0315 23:46:38.072174 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.514626 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:43 old-k8s-version-580201 kubelet[660]: E0315 23:46:43.072871 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.514807 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:51 old-k8s-version-580201 kubelet[660]: E0315 23:46:51.072184 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.515385 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:56 old-k8s-version-580201 kubelet[660]: E0315 23:46:56.925610 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.515702 934140 logs.go:138] Found kubelet problem: Mar 15 23:46:57 old-k8s-version-580201 kubelet[660]: E0315 23:46:57.929174 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.515882 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:03 old-k8s-version-580201 kubelet[660]: E0315 23:47:03.071171 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.516199 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:09 old-k8s-version-580201 kubelet[660]: E0315 23:47:09.073488 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.516379 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:14 old-k8s-version-580201 kubelet[660]: E0315 23:47:14.071340 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.516695 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:24 old-k8s-version-580201 kubelet[660]: E0315 23:47:24.071090 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.516951 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:25 old-k8s-version-580201 kubelet[660]: E0315 23:47:25.071677 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.517307 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:35 old-k8s-version-580201 kubelet[660]: E0315 23:47:35.071989 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.517518 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:36 old-k8s-version-580201 kubelet[660]: E0315 23:47:36.077771 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.517876 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:47 old-k8s-version-580201 kubelet[660]: E0315 23:47:47.070572 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.518089 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:49 old-k8s-version-580201 kubelet[660]: E0315 23:47:49.071077 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.518450 934140 logs.go:138] Found kubelet problem: Mar 15 23:47:59 old-k8s-version-580201 kubelet[660]: E0315 23:47:59.070094 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.518659 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:04 old-k8s-version-580201 kubelet[660]: E0315 23:48:04.070705 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.519011 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:14 old-k8s-version-580201 kubelet[660]: E0315 23:48:14.072003 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.519236 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:15 old-k8s-version-580201 kubelet[660]: E0315 23:48:15.072752 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.519458 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:28 old-k8s-version-580201 kubelet[660]: E0315 23:48:28.075534 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.519808 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:28 old-k8s-version-580201 kubelet[660]: E0315 23:48:28.076533 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.520022 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:39 old-k8s-version-580201 kubelet[660]: E0315 23:48:39.070552 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.520385 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:40 old-k8s-version-580201 kubelet[660]: E0315 23:48:40.070289 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.520742 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: E0315 23:48:51.070831 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.520957 934140 logs.go:138] Found kubelet problem: Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: E0315 23:48:51.071399 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.521309 934140 logs.go:138] Found kubelet problem: Mar 15 23:49:02 old-k8s-version-580201 kubelet[660]: E0315 23:49:02.070699 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.521519 934140 logs.go:138] Found kubelet problem: Mar 15 23:49:04 old-k8s-version-580201 kubelet[660]: E0315 23:49:04.070710 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.521871 934140 logs.go:138] Found kubelet problem: Mar 15 23:49:13 old-k8s-version-580201 kubelet[660]: E0315 23:49:13.070137 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
I0315 23:49:17.521900 934140 logs.go:123] Gathering logs for kube-apiserver [e8c4821ea89657837e9b8bc47f8e119ae8d9f7f26c1e2ea8bbe98c2d0b8cc790] ...
I0315 23:49:17.521932 934140 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e8c4821ea89657837e9b8bc47f8e119ae8d9f7f26c1e2ea8bbe98c2d0b8cc790"
I0315 23:49:17.632961 934140 out.go:304] Setting ErrFile to fd 2...
I0315 23:49:17.633036 934140 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0315 23:49:17.633127 934140 out.go:239] X Problems detected in kubelet:
W0315 23:49:17.633177 934140 out.go:239] Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: E0315 23:48:51.070831 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.633237 934140 out.go:239] Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: E0315 23:48:51.071399 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.633277 934140 out.go:239] Mar 15 23:49:02 old-k8s-version-580201 kubelet[660]: E0315 23:49:02.070699 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
W0315 23:49:17.633316 934140 out.go:239] Mar 15 23:49:04 old-k8s-version-580201 kubelet[660]: E0315 23:49:04.070710 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0315 23:49:17.633368 934140 out.go:239] Mar 15 23:49:13 old-k8s-version-580201 kubelet[660]: E0315 23:49:13.070137 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
I0315 23:49:17.633406 934140 out.go:304] Setting ErrFile to fd 2...
I0315 23:49:17.633444 934140 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0315 23:49:24.035308 943965 kubeadm.go:309] [init] Using Kubernetes version: v1.28.4
I0315 23:49:24.035378 943965 kubeadm.go:309] [preflight] Running pre-flight checks
I0315 23:49:24.035469 943965 kubeadm.go:309] [preflight] The system verification failed. Printing the output from the verification:
I0315 23:49:24.035661 943965 kubeadm.go:309] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1055-aws[0m
I0315 23:49:24.035720 943965 kubeadm.go:309] [0;37mOS[0m: [0;32mLinux[0m
I0315 23:49:24.035803 943965 kubeadm.go:309] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0315 23:49:24.035863 943965 kubeadm.go:309] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0315 23:49:24.035919 943965 kubeadm.go:309] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0315 23:49:24.035970 943965 kubeadm.go:309] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0315 23:49:24.036023 943965 kubeadm.go:309] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0315 23:49:24.036077 943965 kubeadm.go:309] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0315 23:49:24.036127 943965 kubeadm.go:309] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0315 23:49:24.036186 943965 kubeadm.go:309] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0315 23:49:24.036237 943965 kubeadm.go:309] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0315 23:49:24.036317 943965 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0315 23:49:24.036411 943965 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0315 23:49:24.036502 943965 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0315 23:49:24.036565 943965 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0315 23:49:24.039128 943965 out.go:204] - Generating certificates and keys ...
I0315 23:49:24.039228 943965 kubeadm.go:309] [certs] Using existing ca certificate authority
I0315 23:49:24.039296 943965 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0315 23:49:24.039372 943965 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0315 23:49:24.039433 943965 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0315 23:49:24.039502 943965 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0315 23:49:24.039554 943965 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0315 23:49:24.039608 943965 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0315 23:49:24.039727 943965 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [embed-certs-264151 localhost] and IPs [192.168.85.2 127.0.0.1 ::1]
I0315 23:49:24.039780 943965 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0315 23:49:24.039897 943965 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [embed-certs-264151 localhost] and IPs [192.168.85.2 127.0.0.1 ::1]
I0315 23:49:24.039971 943965 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0315 23:49:24.040035 943965 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0315 23:49:24.040081 943965 kubeadm.go:309] [certs] Generating "sa" key and public key
I0315 23:49:24.040138 943965 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0315 23:49:24.040190 943965 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0315 23:49:24.040243 943965 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0315 23:49:24.040308 943965 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0315 23:49:24.040370 943965 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0315 23:49:24.040452 943965 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0315 23:49:24.040522 943965 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0315 23:49:24.042587 943965 out.go:204] - Booting up control plane ...
I0315 23:49:24.042736 943965 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0315 23:49:24.042849 943965 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0315 23:49:24.042939 943965 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0315 23:49:24.043067 943965 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0315 23:49:24.043174 943965 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0315 23:49:24.043224 943965 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0315 23:49:24.043432 943965 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0315 23:49:24.043526 943965 kubeadm.go:309] [apiclient] All control plane components are healthy after 9.002812 seconds
I0315 23:49:24.043659 943965 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0315 23:49:24.043797 943965 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0315 23:49:24.043865 943965 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0315 23:49:24.044064 943965 kubeadm.go:309] [mark-control-plane] Marking the node embed-certs-264151 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0315 23:49:24.044127 943965 kubeadm.go:309] [bootstrap-token] Using token: bkzq7r.3mp4bez7s66uyl2o
I0315 23:49:24.046637 943965 out.go:204] - Configuring RBAC rules ...
I0315 23:49:24.046773 943965 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0315 23:49:24.046871 943965 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0315 23:49:24.047022 943965 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0315 23:49:24.047159 943965 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0315 23:49:24.047281 943965 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0315 23:49:24.047437 943965 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0315 23:49:24.047563 943965 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0315 23:49:24.047611 943965 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0315 23:49:24.047663 943965 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0315 23:49:24.047669 943965 kubeadm.go:309]
I0315 23:49:24.047731 943965 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0315 23:49:24.047743 943965 kubeadm.go:309]
I0315 23:49:24.047825 943965 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0315 23:49:24.047835 943965 kubeadm.go:309]
I0315 23:49:24.047861 943965 kubeadm.go:309] mkdir -p $HOME/.kube
I0315 23:49:24.047925 943965 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0315 23:49:24.047981 943965 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0315 23:49:24.047989 943965 kubeadm.go:309]
I0315 23:49:24.048061 943965 kubeadm.go:309] Alternatively, if you are the root user, you can run:
I0315 23:49:24.048070 943965 kubeadm.go:309]
I0315 23:49:24.048120 943965 kubeadm.go:309] export KUBECONFIG=/etc/kubernetes/admin.conf
I0315 23:49:24.048129 943965 kubeadm.go:309]
I0315 23:49:24.048184 943965 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0315 23:49:24.048267 943965 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0315 23:49:24.048342 943965 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0315 23:49:24.048349 943965 kubeadm.go:309]
I0315 23:49:24.048438 943965 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0315 23:49:24.048525 943965 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0315 23:49:24.048540 943965 kubeadm.go:309]
I0315 23:49:24.048629 943965 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token bkzq7r.3mp4bez7s66uyl2o \
I0315 23:49:24.048741 943965 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:eff1439c6fecd2e7185a0124e10a6c23f7f31a3b91db415624cb44cc86b75799 \
I0315 23:49:24.048768 943965 kubeadm.go:309] --control-plane
I0315 23:49:24.048777 943965 kubeadm.go:309]
I0315 23:49:24.048918 943965 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0315 23:49:24.048926 943965 kubeadm.go:309]
I0315 23:49:24.049012 943965 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token bkzq7r.3mp4bez7s66uyl2o \
I0315 23:49:24.049133 943965 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:eff1439c6fecd2e7185a0124e10a6c23f7f31a3b91db415624cb44cc86b75799
I0315 23:49:24.049153 943965 cni.go:84] Creating CNI manager for ""
I0315 23:49:24.049169 943965 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0315 23:49:24.051783 943965 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0315 23:49:27.634092 934140 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0315 23:49:27.645240 934140 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0315 23:49:27.647700 934140 out.go:177]
W0315 23:49:27.650408 934140 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0315 23:49:27.650447 934140 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0315 23:49:27.650465 934140 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0315 23:49:27.650470 934140 out.go:239] *
W0315 23:49:27.651433 934140 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0315 23:49:27.654895 934140 out.go:177]
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
4a7e5f9424b77 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 a2c23e374166b dashboard-metrics-scraper-8d5bb5db8-6d64l
869cb514e87f1 ba04bb24b9575 5 minutes ago Running storage-provisioner 3 247a20822ad5a storage-provisioner
60b9aafb04ea8 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 56f90304239cc kubernetes-dashboard-cd95d586-nltpw
1e531cf0103b3 1611cd07b61d5 5 minutes ago Running busybox 1 02b46eeca523c busybox
f90ea0d50a8b7 ba04bb24b9575 5 minutes ago Exited storage-provisioner 2 247a20822ad5a storage-provisioner
f2d97e620a060 25a5233254979 5 minutes ago Running kube-proxy 1 956e73f9c2e22 kube-proxy-kh2s2
e24480384e8b1 db91994f4ee8f 5 minutes ago Running coredns 1 2be96800313e2 coredns-74ff55c5b-b2w6r
528a22f565f78 4740c1948d3fc 5 minutes ago Running kindnet-cni 1 23e1449359c39 kindnet-rdg2l
a3f302b11bfa0 e7605f88f17d6 6 minutes ago Running kube-scheduler 1 37b3839cb73f7 kube-scheduler-old-k8s-version-580201
5da4950534a0b 1df8a2b116bd1 6 minutes ago Running kube-controller-manager 1 ca6226e0dc74f kube-controller-manager-old-k8s-version-580201
0b82f42fc451d 2c08bbbc02d3a 6 minutes ago Running kube-apiserver 1 3aa465feb6d70 kube-apiserver-old-k8s-version-580201
32e2364d0f85d 05b738aa1bc63 6 minutes ago Running etcd 1 3322f115c3d2d etcd-old-k8s-version-580201
f8d6a65de4566 1611cd07b61d5 6 minutes ago Exited busybox 0 e46a6be2c748f busybox
6711aefac62eb db91994f4ee8f 7 minutes ago Exited coredns 0 02704b90db241 coredns-74ff55c5b-b2w6r
4476e3f7821c9 25a5233254979 8 minutes ago Exited kube-proxy 0 d5b29f0474647 kube-proxy-kh2s2
0088d2446dda4 4740c1948d3fc 8 minutes ago Exited kindnet-cni 0 59c80ef9dbb62 kindnet-rdg2l
7c106e53b87dc 05b738aa1bc63 8 minutes ago Exited etcd 0 b67d7f6c16ab0 etcd-old-k8s-version-580201
e8c4821ea8965 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 e3dd7f2e0bca6 kube-apiserver-old-k8s-version-580201
80be09ea64652 e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 a24938a71c87b kube-scheduler-old-k8s-version-580201
040b549f2a914 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 df2cbac39e1f4 kube-controller-manager-old-k8s-version-580201
==> containerd <==
Mar 15 23:45:24 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:45:24.109005036Z" level=info msg="CreateContainer within sandbox \"a2c23e374166bf9414253186ca0136dbeb7696dba9b4147fe061e5864209dfff\" for &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:4,} returns container id \"c02e16da95e4c102e12d4643b31c6ee5cb190fafcc26c11639e581f121294bf1\""
Mar 15 23:45:24 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:45:24.109840025Z" level=info msg="StartContainer for \"c02e16da95e4c102e12d4643b31c6ee5cb190fafcc26c11639e581f121294bf1\""
Mar 15 23:45:24 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:45:24.192415426Z" level=info msg="StartContainer for \"c02e16da95e4c102e12d4643b31c6ee5cb190fafcc26c11639e581f121294bf1\" returns successfully"
Mar 15 23:45:24 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:45:24.228391771Z" level=info msg="shim disconnected" id=c02e16da95e4c102e12d4643b31c6ee5cb190fafcc26c11639e581f121294bf1
Mar 15 23:45:24 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:45:24.228451478Z" level=warning msg="cleaning up after shim disconnected" id=c02e16da95e4c102e12d4643b31c6ee5cb190fafcc26c11639e581f121294bf1 namespace=k8s.io
Mar 15 23:45:24 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:45:24.228463186Z" level=info msg="cleaning up dead shim"
Mar 15 23:45:24 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:45:24.242089048Z" level=warning msg="cleanup warnings time=\"2024-03-15T23:45:24Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2935 runtime=io.containerd.runc.v2\n"
Mar 15 23:45:24 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:45:24.744237418Z" level=info msg="RemoveContainer for \"00d81cbdb526d6ef64b857c4b5979b98e5ecaef581bb0f7e0af51e5fe7fbe2c9\""
Mar 15 23:45:24 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:45:24.753233785Z" level=info msg="RemoveContainer for \"00d81cbdb526d6ef64b857c4b5979b98e5ecaef581bb0f7e0af51e5fe7fbe2c9\" returns successfully"
Mar 15 23:46:27 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:46:27.071185466Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 15 23:46:27 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:46:27.077486350Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Mar 15 23:46:27 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:46:27.079160076Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Mar 15 23:46:56 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:46:56.079054356Z" level=info msg="CreateContainer within sandbox \"a2c23e374166bf9414253186ca0136dbeb7696dba9b4147fe061e5864209dfff\" for container &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:5,}"
Mar 15 23:46:56 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:46:56.094902656Z" level=info msg="CreateContainer within sandbox \"a2c23e374166bf9414253186ca0136dbeb7696dba9b4147fe061e5864209dfff\" for &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:5,} returns container id \"4a7e5f9424b7712949764289ab40cc210430d22371e7c4e934c894a8cc7d333c\""
Mar 15 23:46:56 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:46:56.095698310Z" level=info msg="StartContainer for \"4a7e5f9424b7712949764289ab40cc210430d22371e7c4e934c894a8cc7d333c\""
Mar 15 23:46:56 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:46:56.176647859Z" level=info msg="StartContainer for \"4a7e5f9424b7712949764289ab40cc210430d22371e7c4e934c894a8cc7d333c\" returns successfully"
Mar 15 23:46:56 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:46:56.199548932Z" level=info msg="shim disconnected" id=4a7e5f9424b7712949764289ab40cc210430d22371e7c4e934c894a8cc7d333c
Mar 15 23:46:56 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:46:56.199615679Z" level=warning msg="cleaning up after shim disconnected" id=4a7e5f9424b7712949764289ab40cc210430d22371e7c4e934c894a8cc7d333c namespace=k8s.io
Mar 15 23:46:56 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:46:56.199627609Z" level=info msg="cleaning up dead shim"
Mar 15 23:46:56 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:46:56.208406144Z" level=warning msg="cleanup warnings time=\"2024-03-15T23:46:56Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=3189 runtime=io.containerd.runc.v2\n"
Mar 15 23:46:56 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:46:56.927154443Z" level=info msg="RemoveContainer for \"c02e16da95e4c102e12d4643b31c6ee5cb190fafcc26c11639e581f121294bf1\""
Mar 15 23:46:56 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:46:56.935288852Z" level=info msg="RemoveContainer for \"c02e16da95e4c102e12d4643b31c6ee5cb190fafcc26c11639e581f121294bf1\" returns successfully"
Mar 15 23:49:18 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:49:18.073170111Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 15 23:49:18 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:49:18.083341855Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Mar 15 23:49:18 old-k8s-version-580201 containerd[566]: time="2024-03-15T23:49:18.085049271Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
==> coredns [6711aefac62eb67e3b17a32bab9337210ab97ce4741f2339d6927f6f1ce15edd] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:47195 - 24710 "HINFO IN 6460417997267085998.1788064873871236633. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.020740303s
==> coredns [e24480384e8b14f9cc8f6a77e4db38f4b774a420ea71bccd932190dc49e972e6] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:39857 - 37298 "HINFO IN 8033740983373960011.2722102976608910821. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.039454733s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I0315 23:44:08.476910 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-03-15 23:43:38.476327488 +0000 UTC m=+0.057627501) (total time: 30.000487621s):
Trace[2019727887]: [30.000487621s] [30.000487621s] END
E0315 23:44:08.476945 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0315 23:44:08.477410 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-03-15 23:43:38.476873729 +0000 UTC m=+0.058173742) (total time: 30.000513877s):
Trace[939984059]: [30.000513877s] [30.000513877s] END
E0315 23:44:08.477426 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0315 23:44:08.477617 1 trace.go:116] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-03-15 23:43:38.477132077 +0000 UTC m=+0.058432090) (total time: 30.000472836s):
Trace[911902081]: [30.000472836s] [30.000472836s] END
E0315 23:44:08.477631 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> describe nodes <==
Name: old-k8s-version-580201
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-580201
kubernetes.io/os=linux
minikube.k8s.io/commit=c798c049fb6528bb550c261d9b232f816eafc04e
minikube.k8s.io/name=old-k8s-version-580201
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_03_15T23_40_39_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Fri, 15 Mar 2024 23:40:36 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-580201
AcquireTime: <unset>
RenewTime: Fri, 15 Mar 2024 23:49:19 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Fri, 15 Mar 2024 23:44:37 +0000 Fri, 15 Mar 2024 23:40:30 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Fri, 15 Mar 2024 23:44:37 +0000 Fri, 15 Mar 2024 23:40:30 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Fri, 15 Mar 2024 23:44:37 +0000 Fri, 15 Mar 2024 23:40:30 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Fri, 15 Mar 2024 23:44:37 +0000 Fri, 15 Mar 2024 23:40:54 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-580201
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022492Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022492Ki
pods: 110
System Info:
Machine ID: 0c318b915eed4c4f98cc236a868b1c30
System UUID: 1892a194-4e0f-4b5f-bcde-209d70c98303
Boot ID: 524d25c0-1c94-4215-b4ce-3c6db5902c1e
Kernel Version: 5.15.0-1055-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.6.28
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m40s
kube-system coredns-74ff55c5b-b2w6r 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m35s
kube-system etcd-old-k8s-version-580201 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m42s
kube-system kindnet-rdg2l 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 8m35s
kube-system kube-apiserver-old-k8s-version-580201 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m42s
kube-system kube-controller-manager-old-k8s-version-580201 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m42s
kube-system kube-proxy-kh2s2 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m35s
kube-system kube-scheduler-old-k8s-version-580201 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m42s
kube-system metrics-server-9975d5f86-ltkj7 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m30s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m33s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-6d64l 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m33s
kubernetes-dashboard kubernetes-dashboard-cd95d586-nltpw 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m33s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 9m1s (x4 over 9m1s) kubelet Node old-k8s-version-580201 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 9m1s (x5 over 9m1s) kubelet Node old-k8s-version-580201 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 9m1s (x4 over 9m1s) kubelet Node old-k8s-version-580201 status is now: NodeHasSufficientPID
Normal Starting 8m42s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m42s kubelet Node old-k8s-version-580201 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m42s kubelet Node old-k8s-version-580201 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m42s kubelet Node old-k8s-version-580201 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m42s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m35s kubelet Node old-k8s-version-580201 status is now: NodeReady
Normal Starting 8m33s kube-proxy Starting kube-proxy.
Normal Starting 6m2s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 6m1s (x8 over 6m1s) kubelet Node old-k8s-version-580201 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m1s (x8 over 6m1s) kubelet Node old-k8s-version-580201 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m1s (x7 over 6m1s) kubelet Node old-k8s-version-580201 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 6m1s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m50s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.001097] FS-Cache: O-key=[8] '0b71ed0000000000'
[ +0.000706] FS-Cache: N-cookie c=00000030 [p=00000027 fl=2 nc=0 na=1]
[ +0.000930] FS-Cache: N-cookie d=0000000087f55148{9p.inode} n=00000000f871f3b7
[ +0.001080] FS-Cache: N-key=[8] '0b71ed0000000000'
[ +0.003067] FS-Cache: Duplicate cookie detected
[ +0.000720] FS-Cache: O-cookie c=0000002a [p=00000027 fl=226 nc=0 na=1]
[ +0.001032] FS-Cache: O-cookie d=0000000087f55148{9p.inode} n=000000001f929ab1
[ +0.001094] FS-Cache: O-key=[8] '0b71ed0000000000'
[ +0.000704] FS-Cache: N-cookie c=00000031 [p=00000027 fl=2 nc=0 na=1]
[ +0.000930] FS-Cache: N-cookie d=0000000087f55148{9p.inode} n=0000000089f71322
[ +0.001056] FS-Cache: N-key=[8] '0b71ed0000000000'
[ +2.540554] FS-Cache: Duplicate cookie detected
[ +0.000753] FS-Cache: O-cookie c=00000029 [p=00000027 fl=226 nc=0 na=1]
[ +0.000979] FS-Cache: O-cookie d=0000000087f55148{9p.inode} n=0000000034975e77
[ +0.001059] FS-Cache: O-key=[8] '0a71ed0000000000'
[ +0.000687] FS-Cache: N-cookie c=00000033 [p=00000027 fl=2 nc=0 na=1]
[ +0.001004] FS-Cache: N-cookie d=0000000087f55148{9p.inode} n=00000000f871f3b7
[ +0.001075] FS-Cache: N-key=[8] '0a71ed0000000000'
[ +0.288301] FS-Cache: Duplicate cookie detected
[ +0.000737] FS-Cache: O-cookie c=0000002d [p=00000027 fl=226 nc=0 na=1]
[ +0.001032] FS-Cache: O-cookie d=0000000087f55148{9p.inode} n=0000000032981d0a
[ +0.001228] FS-Cache: O-key=[8] '1071ed0000000000'
[ +0.000736] FS-Cache: N-cookie c=00000034 [p=00000027 fl=2 nc=0 na=1]
[ +0.001065] FS-Cache: N-cookie d=0000000087f55148{9p.inode} n=00000000cd2a3e52
[ +0.001091] FS-Cache: N-key=[8] '1071ed0000000000'
==> etcd [32e2364d0f85d10892426c4892f412de9be4c7914009845e1e0c665542d1ffa9] <==
2024-03-15 23:45:24.359492 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:45:34.359222 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:45:44.360292 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:45:54.359112 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:46:04.359368 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:46:14.359116 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:46:24.359224 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:46:34.359232 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:46:44.359280 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:46:54.359155 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:47:04.359424 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:47:14.359335 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:47:24.359170 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:47:34.359346 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:47:44.359240 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:47:54.359178 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:48:04.359215 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:48:14.359129 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:48:24.359098 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:48:34.359172 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:48:44.359177 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:48:54.359013 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:49:04.359889 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:49:14.359875 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:49:24.359103 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [7c106e53b87dcc5de6dccc177c6e2532608dad6decd8dd578ca8fb725410a82d] <==
raft2024/03/15 23:40:30 INFO: ea7e25599daad906 received MsgVoteResp from ea7e25599daad906 at term 2
raft2024/03/15 23:40:30 INFO: ea7e25599daad906 became leader at term 2
raft2024/03/15 23:40:30 INFO: raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2
2024-03-15 23:40:30.647995 I | etcdserver: setting up the initial cluster version to 3.4
2024-03-15 23:40:30.652692 N | etcdserver/membership: set the initial cluster version to 3.4
2024-03-15 23:40:30.653091 I | etcdserver/api: enabled capabilities for version 3.4
2024-03-15 23:40:30.653242 I | embed: ready to serve client requests
2024-03-15 23:40:30.653669 I | embed: ready to serve client requests
2024-03-15 23:40:30.655092 I | embed: serving client requests on 127.0.0.1:2379
2024-03-15 23:40:30.684837 I | etcdserver: published {Name:old-k8s-version-580201 ClientURLs:[https://192.168.76.2:2379]} to cluster 6f20f2c4b2fb5f8a
2024-03-15 23:40:30.691632 I | embed: serving client requests on 192.168.76.2:2379
2024-03-15 23:40:49.560350 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:40:51.845747 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:41:01.845910 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:41:11.845833 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:41:21.845981 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:41:31.846007 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:41:41.845905 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:41:51.845902 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:42:01.845842 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:42:11.845805 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:42:21.845790 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:42:31.845796 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:42:41.845931 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-15 23:42:51.845883 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
23:49:29 up 4:31, 0 users, load average: 2.96, 2.14, 2.53
Linux old-k8s-version-580201 5.15.0-1055-aws #60~20.04.1-Ubuntu SMP Thu Feb 22 15:54:21 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [0088d2446dda408eb46d068ce7b0a048c3e567c0d81c9d75219817d46640bb68] <==
podIP = 192.168.76.2
I0315 23:40:55.699233 1 main.go:116] setting mtu 1500 for CNI
I0315 23:40:55.699247 1 main.go:146] kindnetd IP family: "ipv4"
I0315 23:40:55.699270 1 main.go:150] noMask IPv4 subnets: [10.244.0.0/16]
I0315 23:41:25.966974 1 main.go:191] Failed to get nodes, retrying after error: Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: i/o timeout
I0315 23:41:25.981516 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0315 23:41:25.981549 1 main.go:227] handling current node
I0315 23:41:35.996729 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0315 23:41:35.996759 1 main.go:227] handling current node
I0315 23:41:46.021645 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0315 23:41:46.021673 1 main.go:227] handling current node
I0315 23:41:56.025605 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0315 23:41:56.025632 1 main.go:227] handling current node
I0315 23:42:06.060460 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0315 23:42:06.060487 1 main.go:227] handling current node
I0315 23:42:16.107446 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0315 23:42:16.107498 1 main.go:227] handling current node
I0315 23:42:26.111544 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0315 23:42:26.111574 1 main.go:227] handling current node
I0315 23:42:36.143969 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0315 23:42:36.143997 1 main.go:227] handling current node
I0315 23:42:46.182095 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0315 23:42:46.182210 1 main.go:227] handling current node
I0315 23:42:56.206294 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0315 23:42:56.206530 1 main.go:227] handling current node
==> kindnet [528a22f565f78d4f3c888ca0711b45b7aac306832106588270edd1a5a169cc67] <==
I0315 23:47:28.664289 1 main.go:227] handling current node
I0315 23:47:38.671908 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0315 23:47:38.671952 1 main.go:227] handling current node
I0315 23:47:48.685610 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0315 23:47:48.685643 1 main.go:227] handling current node
I0315 23:47:58.698536 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0315 23:47:58.698564 1 main.go:227] handling current node
I0315 23:48:08.744304 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0315 23:48:08.744338 1 main.go:227] handling current node
I0315 23:48:18.831899 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0315 23:48:18.832184 1 main.go:227] handling current node
I0315 23:48:28.927117 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0315 23:48:28.927147 1 main.go:227] handling current node
I0315 23:48:39.017524 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0315 23:48:39.017553 1 main.go:227] handling current node
I0315 23:48:49.119143 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0315 23:48:49.119177 1 main.go:227] handling current node
I0315 23:48:59.239917 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0315 23:48:59.240115 1 main.go:227] handling current node
I0315 23:49:09.308352 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0315 23:49:09.308546 1 main.go:227] handling current node
I0315 23:49:19.451912 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0315 23:49:19.452127 1 main.go:227] handling current node
I0315 23:49:29.565912 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0315 23:49:29.566009 1 main.go:227] handling current node
==> kube-apiserver [0b82f42fc451d7affa0d14e641d6e50757f32f06a52f51b1b4c2a10e06459069] <==
I0315 23:46:14.172578 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0315 23:46:14.172604 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0315 23:46:39.987530 1 handler_proxy.go:102] no RequestInfo found in the context
E0315 23:46:39.987615 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0315 23:46:39.987623 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0315 23:46:46.167750 1 client.go:360] parsed scheme: "passthrough"
I0315 23:46:46.167801 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0315 23:46:46.167810 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0315 23:47:16.928753 1 client.go:360] parsed scheme: "passthrough"
I0315 23:47:16.928826 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0315 23:47:16.928836 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0315 23:47:48.802691 1 client.go:360] parsed scheme: "passthrough"
I0315 23:47:48.802740 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0315 23:47:48.802750 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0315 23:48:22.890355 1 client.go:360] parsed scheme: "passthrough"
I0315 23:48:22.890403 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0315 23:48:22.890412 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0315 23:48:37.548355 1 handler_proxy.go:102] no RequestInfo found in the context
E0315 23:48:37.548533 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0315 23:48:37.548547 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0315 23:48:56.174265 1 client.go:360] parsed scheme: "passthrough"
I0315 23:48:56.174510 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0315 23:48:56.174598 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [e8c4821ea89657837e9b8bc47f8e119ae8d9f7f26c1e2ea8bbe98c2d0b8cc790] <==
I0315 23:40:36.932632 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I0315 23:40:36.932673 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0315 23:40:37.467832 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0315 23:40:37.507974 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0315 23:40:37.632836 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
I0315 23:40:37.634063 1 controller.go:606] quota admission added evaluator for: endpoints
I0315 23:40:37.641752 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0315 23:40:38.558428 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0315 23:40:39.093022 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0315 23:40:39.148929 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0315 23:40:47.571685 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0315 23:40:54.498311 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0315 23:40:54.590430 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0315 23:41:01.802339 1 client.go:360] parsed scheme: "passthrough"
I0315 23:41:01.802496 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0315 23:41:01.802548 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0315 23:41:46.465167 1 client.go:360] parsed scheme: "passthrough"
I0315 23:41:46.465213 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0315 23:41:46.465223 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0315 23:42:18.318150 1 client.go:360] parsed scheme: "passthrough"
I0315 23:42:18.318195 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0315 23:42:18.318203 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0315 23:42:52.714654 1 client.go:360] parsed scheme: "passthrough"
I0315 23:42:52.714947 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0315 23:42:52.715064 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [040b549f2a914173d3fe9c7a601c396eb6e5db6b59f39a67785e6760cf69ffa4] <==
W0315 23:40:54.665969 1 node_lifecycle_controller.go:1044] Missing timestamp for Node old-k8s-version-580201. Assuming now as a timestamp.
I0315 23:40:54.666009 1 node_lifecycle_controller.go:1195] Controller detected that all Nodes are not-Ready. Entering master disruption mode.
I0315 23:40:54.669382 1 taint_manager.go:187] Starting NoExecuteTaintManager
I0315 23:40:54.676516 1 event.go:291] "Event occurred" object="old-k8s-version-580201" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node old-k8s-version-580201 event: Registered Node old-k8s-version-580201 in Controller"
I0315 23:40:54.708970 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-rgxjq"
I0315 23:40:54.798018 1 event.go:291] "Event occurred" object="kube-system/kube-apiserver-old-k8s-version-580201" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0315 23:40:54.803510 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-kh2s2"
I0315 23:40:54.803537 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-rdg2l"
I0315 23:40:54.834151 1 shared_informer.go:247] Caches are synced for resource quota
I0315 23:40:54.910296 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
E0315 23:40:54.922766 1 clusterroleaggregation_controller.go:181] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
E0315 23:40:54.924575 1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
E0315 23:40:54.933176 1 clusterroleaggregation_controller.go:181] view failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "view": the object has been modified; please apply your changes to the latest version and try again
E0315 23:40:55.021936 1 daemon_controller.go:320] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"70a8e8c8-8990-4b89-b937-ee7de5be66ce", ResourceVersion:"261", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63846142839, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001525360), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001525380)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.
LabelSelector)(0x40015253a0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Gl
usterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0x4001347b40), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001525
3c0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeS
ource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x40015253e0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil),
AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.20.0", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001525420)}}, Resources:v1.R
esourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x4001235f80), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPo
licy:"Always", TerminationGracePeriodSeconds:(*int64)(0x40003d96c8), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x40007c60e0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), Runtime
ClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x400000fed8)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x40003d97b8)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest version and try again
E0315 23:40:55.022105 1 daemon_controller.go:320] kube-system/kindnet failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kindnet", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"d88e1592-a2c3-48da-b814-ec49db06dbca", ResourceVersion:"277", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63846142839, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1", "kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"apps/v1\",\"kind\":\"DaemonSet\",\"metadata\":{\"annotations\":{},\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"},\"name\":\"kindnet\",\"namespace\":\"kube-system\"},\"spec\":{\"selector\":{\"matchLabels\":{\"app\":\"k
indnet\"}},\"template\":{\"metadata\":{\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"}},\"spec\":{\"containers\":[{\"env\":[{\"name\":\"HOST_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.hostIP\"}}},{\"name\":\"POD_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.podIP\"}}},{\"name\":\"POD_SUBNET\",\"value\":\"10.244.0.0/16\"}],\"image\":\"docker.io/kindest/kindnetd:v20240202-8f1494ea\",\"name\":\"kindnet-cni\",\"resources\":{\"limits\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"},\"requests\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"}},\"securityContext\":{\"capabilities\":{\"add\":[\"NET_RAW\",\"NET_ADMIN\"]},\"privileged\":false},\"volumeMounts\":[{\"mountPath\":\"/etc/cni/net.d\",\"name\":\"cni-cfg\"},{\"mountPath\":\"/run/xtables.lock\",\"name\":\"xtables-lock\",\"readOnly\":false},{\"mountPath\":\"/lib/modules\",\"name\":\"lib-modules\",\"readOnly\":true}]}],\"hostNetwork\":true,\"serviceAccountName\":\"kindnet\",\"tolerations\":[{\"effect\":\"NoSchedule\",\"operator\
":\"Exists\"}],\"volumes\":[{\"hostPath\":{\"path\":\"/etc/cni/net.d\",\"type\":\"DirectoryOrCreate\"},\"name\":\"cni-cfg\"},{\"hostPath\":{\"path\":\"/run/xtables.lock\",\"type\":\"FileOrCreate\"},\"name\":\"xtables-lock\"},{\"hostPath\":{\"path\":\"/lib/modules\"},\"name\":\"lib-modules\"}]}}}}\n"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubectl-client-side-apply", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001525480), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x40015254a0)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0x40015254c0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string
{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"cni-cfg", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x40015254e0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil),
FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001525500), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Glust
erfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001525520), EmptyDi
r:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil),
PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kindnet-cni", Image:"docker.io/kindest/kindnetd:v20240202-8f1494ea", Command:[]string(nil), Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"HOST_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001525540)}, v1.EnvVar{Name:"POD_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001525580)}, v1.EnvVar{Name:"POD_SUBNET", Value:"10.244.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:
0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"cni-cfg", ReadOnly:false, MountPath:"/etc/cni/net.d", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:
(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x40015fa000), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0x40003d9b68), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"kindnet", DeprecatedServiceAccount:"kindnet", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x40007c6310), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}},
HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x400000fee0)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x40003d9bf0)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kindnet": the object has been modified; please apply your changes to the latest version and try again
E0315 23:40:55.022175 1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
I0315 23:40:55.080846 1 shared_informer.go:240] Waiting for caches to sync for resource quota
I0315 23:40:55.081116 1 shared_informer.go:247] Caches are synced for resource quota
I0315 23:40:55.204412 1 shared_informer.go:247] Caches are synced for garbage collector
I0315 23:40:55.204440 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0315 23:40:55.210785 1 shared_informer.go:247] Caches are synced for garbage collector
I0315 23:40:55.880118 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0315 23:40:55.927458 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-rgxjq"
I0315 23:40:59.666224 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I0315 23:42:58.909881 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
==> kube-controller-manager [5da4950534a0bd1eda271710cc179a06c37b8638bc1f4c14254faa5a17c34416] <==
W0315 23:45:01.921997 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0315 23:45:29.619423 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0315 23:45:33.572414 1 request.go:655] Throttling request took 1.04840486s, request: GET:https://192.168.76.2:8443/apis/autoscaling/v2beta1?timeout=32s
W0315 23:45:34.423774 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0315 23:46:00.124005 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0315 23:46:06.074412 1 request.go:655] Throttling request took 1.048114363s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0315 23:46:06.931330 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0315 23:46:30.627160 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0315 23:46:38.581712 1 request.go:655] Throttling request took 1.048371281s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0315 23:46:39.434247 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0315 23:47:01.129116 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0315 23:47:11.084724 1 request.go:655] Throttling request took 1.047631805s, request: GET:https://192.168.76.2:8443/apis/certificates.k8s.io/v1beta1?timeout=32s
W0315 23:47:11.936104 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0315 23:47:31.630872 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0315 23:47:43.586726 1 request.go:655] Throttling request took 1.047732919s, request: GET:https://192.168.76.2:8443/apis/certificates.k8s.io/v1beta1?timeout=32s
W0315 23:47:44.438030 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0315 23:48:02.133037 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0315 23:48:16.088554 1 request.go:655] Throttling request took 1.047605537s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0315 23:48:16.939905 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0315 23:48:32.635162 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0315 23:48:48.590376 1 request.go:655] Throttling request took 1.047975758s, request: GET:https://192.168.76.2:8443/apis/networking.k8s.io/v1beta1?timeout=32s
W0315 23:48:49.442101 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0315 23:49:03.143021 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0315 23:49:21.092615 1 request.go:655] Throttling request took 1.048066117s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0315 23:49:21.944386 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-proxy [4476e3f7821c932adced40dcd348993b203a9f5597562662cb2680d470f82585] <==
I0315 23:40:56.881563 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0315 23:40:56.881683 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0315 23:40:56.904153 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0315 23:40:56.904448 1 server_others.go:185] Using iptables Proxier.
I0315 23:40:56.905081 1 server.go:650] Version: v1.20.0
I0315 23:40:56.905645 1 config.go:315] Starting service config controller
I0315 23:40:56.905744 1 shared_informer.go:240] Waiting for caches to sync for service config
I0315 23:40:56.905835 1 config.go:224] Starting endpoint slice config controller
I0315 23:40:56.905916 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0315 23:40:57.007434 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0315 23:40:57.007518 1 shared_informer.go:247] Caches are synced for service config
==> kube-proxy [f2d97e620a060322b239d2751d8d93b2656fd7741e45af5aca547f61e04fc64a] <==
I0315 23:43:39.349620 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0315 23:43:39.349772 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0315 23:43:39.367941 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0315 23:43:39.368140 1 server_others.go:185] Using iptables Proxier.
I0315 23:43:39.368432 1 server.go:650] Version: v1.20.0
I0315 23:43:39.369341 1 config.go:315] Starting service config controller
I0315 23:43:39.369408 1 shared_informer.go:240] Waiting for caches to sync for service config
I0315 23:43:39.369444 1 config.go:224] Starting endpoint slice config controller
I0315 23:43:39.373179 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0315 23:43:39.469586 1 shared_informer.go:247] Caches are synced for service config
I0315 23:43:39.473519 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-scheduler [80be09ea64652be3631bf46d9388d9f25564d3039bd1e13cca1ae9b95db2188d] <==
W0315 23:40:36.072393 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0315 23:40:36.072430 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0315 23:40:36.072456 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0315 23:40:36.072462 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0315 23:40:36.166872 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0315 23:40:36.167501 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0315 23:40:36.167565 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0315 23:40:36.167602 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0315 23:40:36.191427 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0315 23:40:36.191752 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0315 23:40:36.191963 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0315 23:40:36.192268 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0315 23:40:36.192626 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0315 23:40:36.192793 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0315 23:40:36.193023 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0315 23:40:36.193276 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0315 23:40:36.199896 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0315 23:40:36.200155 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0315 23:40:36.200256 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0315 23:40:36.200653 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0315 23:40:37.063648 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0315 23:40:37.106892 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0315 23:40:37.203912 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0315 23:40:37.253111 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
I0315 23:40:39.369005 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [a3f302b11bfa0e70126388c182f4d8009d91933a51ee175c23839f45d8da3577] <==
I0315 23:43:32.225660 1 serving.go:331] Generated self-signed cert in-memory
W0315 23:43:36.443534 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0315 23:43:36.445033 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0315 23:43:36.448094 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0315 23:43:36.448273 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0315 23:43:36.670903 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0315 23:43:36.672910 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0315 23:43:36.672931 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0315 23:43:36.672947 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0315 23:43:36.877588 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Mar 15 23:47:59 old-k8s-version-580201 kubelet[660]: E0315 23:47:59.070094 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
Mar 15 23:48:04 old-k8s-version-580201 kubelet[660]: E0315 23:48:04.070705 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 15 23:48:14 old-k8s-version-580201 kubelet[660]: I0315 23:48:14.070074 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 4a7e5f9424b7712949764289ab40cc210430d22371e7c4e934c894a8cc7d333c
Mar 15 23:48:14 old-k8s-version-580201 kubelet[660]: E0315 23:48:14.072003 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
Mar 15 23:48:15 old-k8s-version-580201 kubelet[660]: E0315 23:48:15.072752 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 15 23:48:28 old-k8s-version-580201 kubelet[660]: E0315 23:48:28.075534 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 15 23:48:28 old-k8s-version-580201 kubelet[660]: I0315 23:48:28.076052 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 4a7e5f9424b7712949764289ab40cc210430d22371e7c4e934c894a8cc7d333c
Mar 15 23:48:28 old-k8s-version-580201 kubelet[660]: E0315 23:48:28.076533 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
Mar 15 23:48:39 old-k8s-version-580201 kubelet[660]: E0315 23:48:39.070552 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 15 23:48:40 old-k8s-version-580201 kubelet[660]: I0315 23:48:40.069770 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 4a7e5f9424b7712949764289ab40cc210430d22371e7c4e934c894a8cc7d333c
Mar 15 23:48:40 old-k8s-version-580201 kubelet[660]: E0315 23:48:40.070289 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: I0315 23:48:51.069942 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 4a7e5f9424b7712949764289ab40cc210430d22371e7c4e934c894a8cc7d333c
Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: E0315 23:48:51.070831 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
Mar 15 23:48:51 old-k8s-version-580201 kubelet[660]: E0315 23:48:51.071399 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 15 23:49:02 old-k8s-version-580201 kubelet[660]: I0315 23:49:02.069833 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 4a7e5f9424b7712949764289ab40cc210430d22371e7c4e934c894a8cc7d333c
Mar 15 23:49:02 old-k8s-version-580201 kubelet[660]: E0315 23:49:02.070699 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
Mar 15 23:49:04 old-k8s-version-580201 kubelet[660]: E0315 23:49:04.070710 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 15 23:49:13 old-k8s-version-580201 kubelet[660]: I0315 23:49:13.069765 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 4a7e5f9424b7712949764289ab40cc210430d22371e7c4e934c894a8cc7d333c
Mar 15 23:49:13 old-k8s-version-580201 kubelet[660]: E0315 23:49:13.070137 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
Mar 15 23:49:18 old-k8s-version-580201 kubelet[660]: E0315 23:49:18.085482 660 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Mar 15 23:49:18 old-k8s-version-580201 kubelet[660]: E0315 23:49:18.085952 660 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Mar 15 23:49:18 old-k8s-version-580201 kubelet[660]: E0315 23:49:18.086136 660 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-hdgh8,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-ltkj7_kube-system(b3fff41
d-e5df-46a6-bd9f-2651e4d6458c): ErrImagePull: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Mar 15 23:49:18 old-k8s-version-580201 kubelet[660]: E0315 23:49:18.086182 660 pod_workers.go:191] Error syncing pod b3fff41d-e5df-46a6-bd9f-2651e4d6458c ("metrics-server-9975d5f86-ltkj7_kube-system(b3fff41d-e5df-46a6-bd9f-2651e4d6458c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Mar 15 23:49:24 old-k8s-version-580201 kubelet[660]: I0315 23:49:24.069897 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 4a7e5f9424b7712949764289ab40cc210430d22371e7c4e934c894a8cc7d333c
Mar 15 23:49:24 old-k8s-version-580201 kubelet[660]: E0315 23:49:24.070745 660 pod_workers.go:191] Error syncing pod 17778e1a-d404-40d7-b87e-d73bfc76714c ("dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-6d64l_kubernetes-dashboard(17778e1a-d404-40d7-b87e-d73bfc76714c)"
==> kubernetes-dashboard [60b9aafb04ea8824fed3cfba5719a397905e02658b9036d814c69569019d92c9] <==
2024/03/15 23:44:05 Using namespace: kubernetes-dashboard
2024/03/15 23:44:05 Using in-cluster config to connect to apiserver
2024/03/15 23:44:05 Using secret token for csrf signing
2024/03/15 23:44:05 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/03/15 23:44:05 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/03/15 23:44:05 Successful initial request to the apiserver, version: v1.20.0
2024/03/15 23:44:05 Generating JWE encryption key
2024/03/15 23:44:05 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/03/15 23:44:05 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/03/15 23:44:05 Initializing JWE encryption key from synchronized object
2024/03/15 23:44:05 Creating in-cluster Sidecar client
2024/03/15 23:44:05 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/15 23:44:05 Serving insecurely on HTTP port: 9090
2024/03/15 23:44:35 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/15 23:45:05 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/15 23:45:35 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/15 23:46:05 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/15 23:46:35 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/15 23:47:05 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/15 23:47:35 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/15 23:48:05 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/15 23:48:35 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/15 23:49:05 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/15 23:44:05 Starting overwatch
==> storage-provisioner [869cb514e87f1834ff32f1380bc3338f18531c3749ff6e334089ed165274a9e3] <==
I0315 23:44:24.189284 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0315 23:44:24.225561 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0315 23:44:24.225865 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0315 23:44:41.687804 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0315 23:44:41.688692 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"8d35b07c-0e40-4aba-b288-7c0730b56bb6", APIVersion:"v1", ResourceVersion:"848", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-580201_1a63aac6-8891-4bda-b494-ba840f6e5e61 became leader
I0315 23:44:41.689273 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-580201_1a63aac6-8891-4bda-b494-ba840f6e5e61!
I0315 23:44:41.790395 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-580201_1a63aac6-8891-4bda-b494-ba840f6e5e61!
==> storage-provisioner [f90ea0d50a8b7e01ed1e789326a149ebf034033fc89b9abb9b5dba3f1984efb4] <==
I0315 23:43:39.035807 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0315 23:44:09.061291 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-580201 -n old-k8s-version-580201
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-580201 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-ltkj7
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-580201 describe pod metrics-server-9975d5f86-ltkj7
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-580201 describe pod metrics-server-9975d5f86-ltkj7: exit status 1 (104.528149ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-ltkj7" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-580201 describe pod metrics-server-9975d5f86-ltkj7: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (378.93s)