=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-497253 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
E0307 22:33:48.560445 7764 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18320-2408/.minikube/profiles/functional-894723/client.crt: no such file or directory
E0307 22:34:28.003699 7764 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18320-2408/.minikube/profiles/addons-963512/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-497253 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m11.376429535s)
-- stdout --
* [old-k8s-version-497253] minikube v1.32.0 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=18320
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18320-2408/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18320-2408/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.28.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.4
* Using the docker driver based on existing profile
* Starting "old-k8s-version-497253" primary control-plane node in "old-k8s-version-497253" cluster
* Pulling base image v0.0.42-1708944392-18244 ...
* Restarting existing docker container for "old-k8s-version-497253" ...
* Preparing Kubernetes v1.20.0 on containerd 1.6.28 ...
* Verifying Kubernetes components...
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-497253 addons enable metrics-server
* Enabled addons: storage-provisioner, metrics-server, dashboard, default-storageclass
-- /stdout --
** stderr **
I0307 22:33:37.520916 203173 out.go:291] Setting OutFile to fd 1 ...
I0307 22:33:37.521037 203173 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 22:33:37.521047 203173 out.go:304] Setting ErrFile to fd 2...
I0307 22:33:37.521053 203173 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 22:33:37.521323 203173 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18320-2408/.minikube/bin
I0307 22:33:37.521682 203173 out.go:298] Setting JSON to false
I0307 22:33:37.522539 203173 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":4561,"bootTime":1709846257,"procs":192,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1055-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0307 22:33:37.522615 203173 start.go:139] virtualization:
I0307 22:33:37.526742 203173 out.go:177] * [old-k8s-version-497253] minikube v1.32.0 on Ubuntu 20.04 (arm64)
I0307 22:33:37.529143 203173 notify.go:220] Checking for updates...
I0307 22:33:37.532153 203173 out.go:177] - MINIKUBE_LOCATION=18320
I0307 22:33:37.534078 203173 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0307 22:33:37.536033 203173 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18320-2408/kubeconfig
I0307 22:33:37.538144 203173 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18320-2408/.minikube
I0307 22:33:37.540391 203173 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0307 22:33:37.542283 203173 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0307 22:33:37.544682 203173 config.go:182] Loaded profile config "old-k8s-version-497253": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0307 22:33:37.547030 203173 out.go:177] * Kubernetes 1.28.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.4
I0307 22:33:37.548958 203173 driver.go:392] Setting default libvirt URI to qemu:///system
I0307 22:33:37.572032 203173 docker.go:122] docker version: linux-25.0.4:Docker Engine - Community
I0307 22:33:37.572143 203173 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0307 22:33:37.670210 203173 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:55 OomKillDisable:true NGoroutines:71 SystemTime:2024-03-07 22:33:37.65882932 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0307 22:33:37.670417 203173 docker.go:295] overlay module found
I0307 22:33:37.673064 203173 out.go:177] * Using the docker driver based on existing profile
I0307 22:33:37.675039 203173 start.go:297] selected driver: docker
I0307 22:33:37.675055 203173 start.go:901] validating driver "docker" against &{Name:old-k8s-version-497253 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-497253 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0307 22:33:37.675165 203173 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0307 22:33:37.675782 203173 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0307 22:33:37.753720 203173 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:55 OomKillDisable:true NGoroutines:71 SystemTime:2024-03-07 22:33:37.74447346 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0307 22:33:37.754061 203173 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0307 22:33:37.754114 203173 cni.go:84] Creating CNI manager for ""
I0307 22:33:37.754124 203173 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0307 22:33:37.754174 203173 start.go:340] cluster config:
{Name:old-k8s-version-497253 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-497253 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0307 22:33:37.758977 203173 out.go:177] * Starting "old-k8s-version-497253" primary control-plane node in "old-k8s-version-497253" cluster
I0307 22:33:37.761555 203173 cache.go:121] Beginning downloading kic base image for docker with containerd
I0307 22:33:37.763983 203173 out.go:177] * Pulling base image v0.0.42-1708944392-18244 ...
I0307 22:33:37.766430 203173 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0307 22:33:37.766559 203173 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon
I0307 22:33:37.766672 203173 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18320-2408/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0307 22:33:37.766716 203173 cache.go:56] Caching tarball of preloaded images
I0307 22:33:37.766892 203173 preload.go:173] Found /home/jenkins/minikube-integration/18320-2408/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0307 22:33:37.766913 203173 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0307 22:33:37.767123 203173 profile.go:142] Saving config to /home/jenkins/minikube-integration/18320-2408/.minikube/profiles/old-k8s-version-497253/config.json ...
I0307 22:33:37.801786 203173 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon, skipping pull
I0307 22:33:37.801808 203173 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 exists in daemon, skipping load
I0307 22:33:37.801825 203173 cache.go:194] Successfully downloaded all kic artifacts
I0307 22:33:37.801853 203173 start.go:360] acquireMachinesLock for old-k8s-version-497253: {Name:mk272fd05919b45bf55ab72823af0f8539dbef2c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0307 22:33:37.801910 203173 start.go:364] duration metric: took 38.023µs to acquireMachinesLock for "old-k8s-version-497253"
I0307 22:33:37.801936 203173 start.go:96] Skipping create...Using existing machine configuration
I0307 22:33:37.801941 203173 fix.go:54] fixHost starting:
I0307 22:33:37.802218 203173 cli_runner.go:164] Run: docker container inspect old-k8s-version-497253 --format={{.State.Status}}
I0307 22:33:37.831469 203173 fix.go:112] recreateIfNeeded on old-k8s-version-497253: state=Stopped err=<nil>
W0307 22:33:37.831510 203173 fix.go:138] unexpected machine state, will restart: <nil>
I0307 22:33:37.836854 203173 out.go:177] * Restarting existing docker container for "old-k8s-version-497253" ...
I0307 22:33:37.838860 203173 cli_runner.go:164] Run: docker start old-k8s-version-497253
I0307 22:33:38.235309 203173 cli_runner.go:164] Run: docker container inspect old-k8s-version-497253 --format={{.State.Status}}
I0307 22:33:38.266234 203173 kic.go:430] container "old-k8s-version-497253" state is running.
I0307 22:33:38.266620 203173 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-497253
I0307 22:33:38.291715 203173 profile.go:142] Saving config to /home/jenkins/minikube-integration/18320-2408/.minikube/profiles/old-k8s-version-497253/config.json ...
I0307 22:33:38.291940 203173 machine.go:94] provisionDockerMachine start ...
I0307 22:33:38.291995 203173 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-497253
I0307 22:33:38.321612 203173 main.go:141] libmachine: Using SSH client type: native
I0307 22:33:38.321883 203173 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1c40] 0x3e44a0 <nil> [] 0s} 127.0.0.1 33067 <nil> <nil>}
I0307 22:33:38.321895 203173 main.go:141] libmachine: About to run SSH command:
hostname
I0307 22:33:38.322425 203173 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:56046->127.0.0.1:33067: read: connection reset by peer
I0307 22:33:41.447669 203173 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-497253
I0307 22:33:41.447721 203173 ubuntu.go:169] provisioning hostname "old-k8s-version-497253"
I0307 22:33:41.447788 203173 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-497253
I0307 22:33:41.463980 203173 main.go:141] libmachine: Using SSH client type: native
I0307 22:33:41.464228 203173 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1c40] 0x3e44a0 <nil> [] 0s} 127.0.0.1 33067 <nil> <nil>}
I0307 22:33:41.464245 203173 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-497253 && echo "old-k8s-version-497253" | sudo tee /etc/hostname
I0307 22:33:41.607450 203173 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-497253
I0307 22:33:41.607543 203173 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-497253
I0307 22:33:41.626478 203173 main.go:141] libmachine: Using SSH client type: native
I0307 22:33:41.626811 203173 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1c40] 0x3e44a0 <nil> [] 0s} 127.0.0.1 33067 <nil> <nil>}
I0307 22:33:41.626837 203173 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-497253' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-497253/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-497253' | sudo tee -a /etc/hosts;
fi
fi
I0307 22:33:41.757125 203173 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0307 22:33:41.757215 203173 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18320-2408/.minikube CaCertPath:/home/jenkins/minikube-integration/18320-2408/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18320-2408/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18320-2408/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18320-2408/.minikube}
I0307 22:33:41.757242 203173 ubuntu.go:177] setting up certificates
I0307 22:33:41.757251 203173 provision.go:84] configureAuth start
I0307 22:33:41.757324 203173 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-497253
I0307 22:33:41.774454 203173 provision.go:143] copyHostCerts
I0307 22:33:41.774519 203173 exec_runner.go:144] found /home/jenkins/minikube-integration/18320-2408/.minikube/ca.pem, removing ...
I0307 22:33:41.774541 203173 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18320-2408/.minikube/ca.pem
I0307 22:33:41.774633 203173 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18320-2408/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18320-2408/.minikube/ca.pem (1078 bytes)
I0307 22:33:41.774731 203173 exec_runner.go:144] found /home/jenkins/minikube-integration/18320-2408/.minikube/cert.pem, removing ...
I0307 22:33:41.774741 203173 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18320-2408/.minikube/cert.pem
I0307 22:33:41.774770 203173 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18320-2408/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18320-2408/.minikube/cert.pem (1123 bytes)
I0307 22:33:41.774826 203173 exec_runner.go:144] found /home/jenkins/minikube-integration/18320-2408/.minikube/key.pem, removing ...
I0307 22:33:41.774833 203173 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18320-2408/.minikube/key.pem
I0307 22:33:41.774864 203173 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18320-2408/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18320-2408/.minikube/key.pem (1675 bytes)
I0307 22:33:41.774919 203173 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18320-2408/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18320-2408/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18320-2408/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-497253 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-497253]
I0307 22:33:42.240409 203173 provision.go:177] copyRemoteCerts
I0307 22:33:42.240544 203173 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0307 22:33:42.240628 203173 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-497253
I0307 22:33:42.260173 203173 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33067 SSHKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/machines/old-k8s-version-497253/id_rsa Username:docker}
I0307 22:33:42.358244 203173 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0307 22:33:42.384218 203173 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0307 22:33:42.409480 203173 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0307 22:33:42.437462 203173 provision.go:87] duration metric: took 680.197298ms to configureAuth
I0307 22:33:42.437535 203173 ubuntu.go:193] setting minikube options for container-runtime
I0307 22:33:42.437798 203173 config.go:182] Loaded profile config "old-k8s-version-497253": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0307 22:33:42.437829 203173 machine.go:97] duration metric: took 4.145881451s to provisionDockerMachine
I0307 22:33:42.437862 203173 start.go:293] postStartSetup for "old-k8s-version-497253" (driver="docker")
I0307 22:33:42.437889 203173 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0307 22:33:42.438009 203173 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0307 22:33:42.438074 203173 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-497253
I0307 22:33:42.454665 203173 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33067 SSHKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/machines/old-k8s-version-497253/id_rsa Username:docker}
I0307 22:33:42.549164 203173 ssh_runner.go:195] Run: cat /etc/os-release
I0307 22:33:42.552153 203173 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0307 22:33:42.552191 203173 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0307 22:33:42.552201 203173 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0307 22:33:42.552208 203173 info.go:137] Remote host: Ubuntu 22.04.3 LTS
I0307 22:33:42.552224 203173 filesync.go:126] Scanning /home/jenkins/minikube-integration/18320-2408/.minikube/addons for local assets ...
I0307 22:33:42.552308 203173 filesync.go:126] Scanning /home/jenkins/minikube-integration/18320-2408/.minikube/files for local assets ...
I0307 22:33:42.552405 203173 filesync.go:149] local asset: /home/jenkins/minikube-integration/18320-2408/.minikube/files/etc/ssl/certs/77642.pem -> 77642.pem in /etc/ssl/certs
I0307 22:33:42.552515 203173 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0307 22:33:42.560853 203173 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/files/etc/ssl/certs/77642.pem --> /etc/ssl/certs/77642.pem (1708 bytes)
I0307 22:33:42.585157 203173 start.go:296] duration metric: took 147.264367ms for postStartSetup
I0307 22:33:42.585285 203173 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0307 22:33:42.585375 203173 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-497253
I0307 22:33:42.605899 203173 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33067 SSHKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/machines/old-k8s-version-497253/id_rsa Username:docker}
I0307 22:33:42.696824 203173 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0307 22:33:42.701241 203173 fix.go:56] duration metric: took 4.899293916s for fixHost
I0307 22:33:42.701270 203173 start.go:83] releasing machines lock for "old-k8s-version-497253", held for 4.899351253s
I0307 22:33:42.701348 203173 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-497253
I0307 22:33:42.718888 203173 ssh_runner.go:195] Run: cat /version.json
I0307 22:33:42.718944 203173 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-497253
I0307 22:33:42.719001 203173 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0307 22:33:42.719064 203173 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-497253
I0307 22:33:42.737025 203173 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33067 SSHKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/machines/old-k8s-version-497253/id_rsa Username:docker}
I0307 22:33:42.748363 203173 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33067 SSHKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/machines/old-k8s-version-497253/id_rsa Username:docker}
I0307 22:33:42.942478 203173 ssh_runner.go:195] Run: systemctl --version
I0307 22:33:42.946846 203173 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0307 22:33:42.951141 203173 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0307 22:33:42.968495 203173 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0307 22:33:42.968571 203173 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0307 22:33:42.977244 203173 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0307 22:33:42.977278 203173 start.go:494] detecting cgroup driver to use...
I0307 22:33:42.977330 203173 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0307 22:33:42.977399 203173 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0307 22:33:42.993667 203173 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0307 22:33:43.008461 203173 docker.go:217] disabling cri-docker service (if available) ...
I0307 22:33:43.008529 203173 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0307 22:33:43.022825 203173 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0307 22:33:43.034815 203173 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0307 22:33:43.125205 203173 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0307 22:33:43.232214 203173 docker.go:233] disabling docker service ...
I0307 22:33:43.232303 203173 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0307 22:33:43.246233 203173 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0307 22:33:43.258211 203173 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0307 22:33:43.373408 203173 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0307 22:33:43.467970 203173 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0307 22:33:43.479610 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0307 22:33:43.495961 203173 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0307 22:33:43.506100 203173 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0307 22:33:43.519913 203173 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0307 22:33:43.520009 203173 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0307 22:33:43.531606 203173 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0307 22:33:43.542438 203173 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0307 22:33:43.553110 203173 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0307 22:33:43.563620 203173 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0307 22:33:43.573843 203173 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0307 22:33:43.583467 203173 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0307 22:33:43.592261 203173 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0307 22:33:43.602763 203173 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0307 22:33:43.699516 203173 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0307 22:33:43.869994 203173 start.go:541] Will wait 60s for socket path /run/containerd/containerd.sock
I0307 22:33:43.870062 203173 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0307 22:33:43.875251 203173 start.go:562] Will wait 60s for crictl version
I0307 22:33:43.875314 203173 ssh_runner.go:195] Run: which crictl
I0307 22:33:43.879121 203173 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0307 22:33:43.918981 203173 start.go:578] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.6.28
RuntimeApiVersion: v1
I0307 22:33:43.919063 203173 ssh_runner.go:195] Run: containerd --version
I0307 22:33:43.941710 203173 ssh_runner.go:195] Run: containerd --version
I0307 22:33:43.969199 203173 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.6.28 ...
I0307 22:33:43.970890 203173 cli_runner.go:164] Run: docker network inspect old-k8s-version-497253 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0307 22:33:43.985333 203173 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0307 22:33:43.990181 203173 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0307 22:33:44.004046 203173 kubeadm.go:877] updating cluster {Name:old-k8s-version-497253 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-497253 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0307 22:33:44.004192 203173 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0307 22:33:44.004262 203173 ssh_runner.go:195] Run: sudo crictl images --output json
I0307 22:33:44.050751 203173 containerd.go:612] all images are preloaded for containerd runtime.
I0307 22:33:44.050779 203173 containerd.go:519] Images already preloaded, skipping extraction
I0307 22:33:44.050853 203173 ssh_runner.go:195] Run: sudo crictl images --output json
I0307 22:33:44.087263 203173 containerd.go:612] all images are preloaded for containerd runtime.
I0307 22:33:44.087288 203173 cache_images.go:84] Images are preloaded, skipping loading
I0307 22:33:44.087297 203173 kubeadm.go:928] updating node { 192.168.76.2 8443 v1.20.0 containerd true true} ...
I0307 22:33:44.087419 203173 kubeadm.go:940] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-497253 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-497253 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0307 22:33:44.087489 203173 ssh_runner.go:195] Run: sudo crictl info
I0307 22:33:44.124722 203173 cni.go:84] Creating CNI manager for ""
I0307 22:33:44.124748 203173 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0307 22:33:44.124758 203173 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0307 22:33:44.124779 203173 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-497253 NodeName:old-k8s-version-497253 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0307 22:33:44.124916 203173 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-497253"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0307 22:33:44.124990 203173 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0307 22:33:44.133783 203173 binaries.go:44] Found k8s binaries, skipping transfer
I0307 22:33:44.133855 203173 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0307 22:33:44.142271 203173 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0307 22:33:44.160371 203173 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0307 22:33:44.178020 203173 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0307 22:33:44.199193 203173 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0307 22:33:44.202611 203173 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0307 22:33:44.213161 203173 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0307 22:33:44.310236 203173 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0307 22:33:44.325404 203173 certs.go:68] Setting up /home/jenkins/minikube-integration/18320-2408/.minikube/profiles/old-k8s-version-497253 for IP: 192.168.76.2
I0307 22:33:44.325428 203173 certs.go:194] generating shared ca certs ...
I0307 22:33:44.325444 203173 certs.go:226] acquiring lock for ca certs: {Name:mk7f303c61c8508a802bee4114a394243ccd109f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0307 22:33:44.325588 203173 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18320-2408/.minikube/ca.key
I0307 22:33:44.325635 203173 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18320-2408/.minikube/proxy-client-ca.key
I0307 22:33:44.325646 203173 certs.go:256] generating profile certs ...
I0307 22:33:44.325739 203173 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18320-2408/.minikube/profiles/old-k8s-version-497253/client.key
I0307 22:33:44.325821 203173 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/18320-2408/.minikube/profiles/old-k8s-version-497253/apiserver.key.897d491f
I0307 22:33:44.325865 203173 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18320-2408/.minikube/profiles/old-k8s-version-497253/proxy-client.key
I0307 22:33:44.325978 203173 certs.go:484] found cert: /home/jenkins/minikube-integration/18320-2408/.minikube/certs/7764.pem (1338 bytes)
W0307 22:33:44.326011 203173 certs.go:480] ignoring /home/jenkins/minikube-integration/18320-2408/.minikube/certs/7764_empty.pem, impossibly tiny 0 bytes
I0307 22:33:44.326024 203173 certs.go:484] found cert: /home/jenkins/minikube-integration/18320-2408/.minikube/certs/ca-key.pem (1679 bytes)
I0307 22:33:44.326048 203173 certs.go:484] found cert: /home/jenkins/minikube-integration/18320-2408/.minikube/certs/ca.pem (1078 bytes)
I0307 22:33:44.326079 203173 certs.go:484] found cert: /home/jenkins/minikube-integration/18320-2408/.minikube/certs/cert.pem (1123 bytes)
I0307 22:33:44.326103 203173 certs.go:484] found cert: /home/jenkins/minikube-integration/18320-2408/.minikube/certs/key.pem (1675 bytes)
I0307 22:33:44.326149 203173 certs.go:484] found cert: /home/jenkins/minikube-integration/18320-2408/.minikube/files/etc/ssl/certs/77642.pem (1708 bytes)
I0307 22:33:44.326841 203173 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0307 22:33:44.353373 203173 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0307 22:33:44.378337 203173 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0307 22:33:44.403309 203173 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0307 22:33:44.429920 203173 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/profiles/old-k8s-version-497253/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0307 22:33:44.457103 203173 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/profiles/old-k8s-version-497253/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0307 22:33:44.488287 203173 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/profiles/old-k8s-version-497253/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0307 22:33:44.512905 203173 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/profiles/old-k8s-version-497253/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0307 22:33:44.537664 203173 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0307 22:33:44.561044 203173 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/certs/7764.pem --> /usr/share/ca-certificates/7764.pem (1338 bytes)
I0307 22:33:44.584442 203173 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/files/etc/ssl/certs/77642.pem --> /usr/share/ca-certificates/77642.pem (1708 bytes)
I0307 22:33:44.611185 203173 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0307 22:33:44.629043 203173 ssh_runner.go:195] Run: openssl version
I0307 22:33:44.634348 203173 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0307 22:33:44.644257 203173 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0307 22:33:44.648447 203173 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 7 21:47 /usr/share/ca-certificates/minikubeCA.pem
I0307 22:33:44.648514 203173 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0307 22:33:44.658108 203173 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0307 22:33:44.667169 203173 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7764.pem && ln -fs /usr/share/ca-certificates/7764.pem /etc/ssl/certs/7764.pem"
I0307 22:33:44.676185 203173 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7764.pem
I0307 22:33:44.679451 203173 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Mar 7 21:53 /usr/share/ca-certificates/7764.pem
I0307 22:33:44.679511 203173 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7764.pem
I0307 22:33:44.687470 203173 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/7764.pem /etc/ssl/certs/51391683.0"
I0307 22:33:44.696432 203173 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/77642.pem && ln -fs /usr/share/ca-certificates/77642.pem /etc/ssl/certs/77642.pem"
I0307 22:33:44.705440 203173 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/77642.pem
I0307 22:33:44.708800 203173 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Mar 7 21:53 /usr/share/ca-certificates/77642.pem
I0307 22:33:44.708879 203173 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/77642.pem
I0307 22:33:44.715537 203173 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/77642.pem /etc/ssl/certs/3ec20f2e.0"
I0307 22:33:44.723763 203173 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0307 22:33:44.727038 203173 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0307 22:33:44.733567 203173 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0307 22:33:44.740043 203173 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0307 22:33:44.748374 203173 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0307 22:33:44.755282 203173 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0307 22:33:44.761907 203173 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0307 22:33:44.768346 203173 kubeadm.go:391] StartCluster: {Name:old-k8s-version-497253 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-497253 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0307 22:33:44.768442 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0307 22:33:44.768503 203173 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0307 22:33:44.803721 203173 cri.go:89] found id: "a105c02644c9c901090c4c9792a32b0396cee09395513751eeb1be7fbf4b8477"
I0307 22:33:44.803785 203173 cri.go:89] found id: "68635283ca2e1d4364e11f919f9201c3e96e21e881f64632d2d769dde9a088e4"
I0307 22:33:44.803804 203173 cri.go:89] found id: "e9768721745ab392d0ad14d4055c5cf01cc780491a01953b4b45bf77d2d3b062"
I0307 22:33:44.803825 203173 cri.go:89] found id: "f1df99d1a705a4556e4be13c16d400b99149438c96bfe6da863b8b041983b036"
I0307 22:33:44.803860 203173 cri.go:89] found id: "cc2db588ff857bfb95417bfc8b125ca64e6caba952ba4acd81ec27522fde3127"
I0307 22:33:44.803880 203173 cri.go:89] found id: "2ca89421ca012456f503b4b92ac92a69bf6b0042461af4e2e3140e7adb8b27dc"
I0307 22:33:44.803897 203173 cri.go:89] found id: "bd7a60d8d4f26067debaaf5b2c23fe94dcfed76118b17104051bc8c755b35ce1"
I0307 22:33:44.803918 203173 cri.go:89] found id: "dabbb0b4fd2574e92c3a53182c494ec08df151f99bd21d27189df149b7f8961c"
I0307 22:33:44.803938 203173 cri.go:89] found id: ""
I0307 22:33:44.804015 203173 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0307 22:33:44.817503 203173 cri.go:116] JSON = null
W0307 22:33:44.817587 203173 kubeadm.go:398] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0307 22:33:44.817668 203173 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0307 22:33:44.826369 203173 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0307 22:33:44.826392 203173 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0307 22:33:44.826399 203173 kubeadm.go:587] restartPrimaryControlPlane start ...
I0307 22:33:44.826468 203173 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0307 22:33:44.834818 203173 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0307 22:33:44.835270 203173 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-497253" does not appear in /home/jenkins/minikube-integration/18320-2408/kubeconfig
I0307 22:33:44.835402 203173 kubeconfig.go:62] /home/jenkins/minikube-integration/18320-2408/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-497253" cluster setting kubeconfig missing "old-k8s-version-497253" context setting]
I0307 22:33:44.835729 203173 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18320-2408/kubeconfig: {Name:mkc7f9d8cfd4e14e150b8fc8a3019ac099191c36 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0307 22:33:44.836881 203173 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0307 22:33:44.846022 203173 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.76.2
I0307 22:33:44.846055 203173 kubeadm.go:591] duration metric: took 19.650661ms to restartPrimaryControlPlane
I0307 22:33:44.846065 203173 kubeadm.go:393] duration metric: took 77.729844ms to StartCluster
I0307 22:33:44.846080 203173 settings.go:142] acquiring lock: {Name:mk6b824c86d3c8cffe443e44d2dcdf6ba75674f0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0307 22:33:44.846137 203173 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/18320-2408/kubeconfig
I0307 22:33:44.846751 203173 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18320-2408/kubeconfig: {Name:mkc7f9d8cfd4e14e150b8fc8a3019ac099191c36 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0307 22:33:44.846946 203173 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0307 22:33:44.850660 203173 out.go:177] * Verifying Kubernetes components...
I0307 22:33:44.847243 203173 config.go:182] Loaded profile config "old-k8s-version-497253": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0307 22:33:44.847267 203173 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0307 22:33:44.852681 203173 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-497253"
I0307 22:33:44.852704 203173 addons.go:69] Setting dashboard=true in profile "old-k8s-version-497253"
I0307 22:33:44.852732 203173 addons.go:234] Setting addon dashboard=true in "old-k8s-version-497253"
W0307 22:33:44.852745 203173 addons.go:243] addon dashboard should already be in state true
I0307 22:33:44.852737 203173 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-497253"
W0307 22:33:44.852771 203173 addons.go:243] addon storage-provisioner should already be in state true
I0307 22:33:44.852821 203173 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-497253"
I0307 22:33:44.852827 203173 host.go:66] Checking if "old-k8s-version-497253" exists ...
I0307 22:33:44.852771 203173 host.go:66] Checking if "old-k8s-version-497253" exists ...
I0307 22:33:44.853324 203173 cli_runner.go:164] Run: docker container inspect old-k8s-version-497253 --format={{.State.Status}}
I0307 22:33:44.852847 203173 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-497253"
W0307 22:33:44.853384 203173 addons.go:243] addon metrics-server should already be in state true
I0307 22:33:44.853414 203173 host.go:66] Checking if "old-k8s-version-497253" exists ...
I0307 22:33:44.853798 203173 cli_runner.go:164] Run: docker container inspect old-k8s-version-497253 --format={{.State.Status}}
I0307 22:33:44.853324 203173 cli_runner.go:164] Run: docker container inspect old-k8s-version-497253 --format={{.State.Status}}
I0307 22:33:44.852853 203173 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-497253"
I0307 22:33:44.860552 203173 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-497253"
I0307 22:33:44.860881 203173 cli_runner.go:164] Run: docker container inspect old-k8s-version-497253 --format={{.State.Status}}
I0307 22:33:44.852689 203173 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0307 22:33:44.889679 203173 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0307 22:33:44.893291 203173 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0307 22:33:44.893260 203173 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0307 22:33:44.895760 203173 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0307 22:33:44.895774 203173 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0307 22:33:44.895788 203173 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0307 22:33:44.895829 203173 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-497253
I0307 22:33:44.895834 203173 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-497253
I0307 22:33:44.914557 203173 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0307 22:33:44.916729 203173 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0307 22:33:44.918986 203173 addons.go:426] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0307 22:33:44.919014 203173 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0307 22:33:44.919085 203173 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-497253
I0307 22:33:44.933374 203173 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-497253"
W0307 22:33:44.933398 203173 addons.go:243] addon default-storageclass should already be in state true
I0307 22:33:44.933422 203173 host.go:66] Checking if "old-k8s-version-497253" exists ...
I0307 22:33:44.933832 203173 cli_runner.go:164] Run: docker container inspect old-k8s-version-497253 --format={{.State.Status}}
I0307 22:33:44.956401 203173 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33067 SSHKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/machines/old-k8s-version-497253/id_rsa Username:docker}
I0307 22:33:44.996472 203173 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33067 SSHKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/machines/old-k8s-version-497253/id_rsa Username:docker}
I0307 22:33:45.006852 203173 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33067 SSHKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/machines/old-k8s-version-497253/id_rsa Username:docker}
I0307 22:33:45.020536 203173 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0307 22:33:45.020572 203173 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0307 22:33:45.020664 203173 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-497253
I0307 22:33:45.036595 203173 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0307 22:33:45.047926 203173 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33067 SSHKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/machines/old-k8s-version-497253/id_rsa Username:docker}
I0307 22:33:45.062831 203173 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-497253" to be "Ready" ...
I0307 22:33:45.131095 203173 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0307 22:33:45.131136 203173 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0307 22:33:45.171174 203173 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0307 22:33:45.171251 203173 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0307 22:33:45.188701 203173 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0307 22:33:45.188788 203173 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0307 22:33:45.200848 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0307 22:33:45.209675 203173 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0307 22:33:45.209705 203173 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0307 22:33:45.234125 203173 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0307 22:33:45.234177 203173 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0307 22:33:45.246407 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0307 22:33:45.292446 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0307 22:33:45.359177 203173 addons.go:426] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0307 22:33:45.359203 203173 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0307 22:33:45.529212 203173 addons.go:426] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0307 22:33:45.529235 203173 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
W0307 22:33:45.651171 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:45.651207 203173 retry.go:31] will retry after 207.834299ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:45.698512 203173 addons.go:426] installing /etc/kubernetes/addons/dashboard-role.yaml
I0307 22:33:45.698536 203173 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
W0307 22:33:45.702451 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:45.702483 203173 retry.go:31] will retry after 239.305637ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0307 22:33:45.702543 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:45.702554 203173 retry.go:31] will retry after 285.084592ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:45.727592 203173 addons.go:426] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0307 22:33:45.727618 203173 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0307 22:33:45.746591 203173 addons.go:426] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0307 22:33:45.746617 203173 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0307 22:33:45.765445 203173 addons.go:426] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0307 22:33:45.765472 203173 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0307 22:33:45.784173 203173 addons.go:426] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0307 22:33:45.784204 203173 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0307 22:33:45.801347 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0307 22:33:45.859481 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0307 22:33:45.892037 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:45.892066 203173 retry.go:31] will retry after 306.888809ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0307 22:33:45.940958 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:45.940989 203173 retry.go:31] will retry after 279.560793ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:45.942047 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0307 22:33:45.988311 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0307 22:33:46.018101 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:46.018133 203173 retry.go:31] will retry after 244.794844ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0307 22:33:46.071189 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:46.071222 203173 retry.go:31] will retry after 273.270477ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:46.199525 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0307 22:33:46.220976 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0307 22:33:46.263261 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0307 22:33:46.292179 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:46.292213 203173 retry.go:31] will retry after 462.749774ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0307 22:33:46.330178 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:46.330214 203173 retry.go:31] will retry after 659.088346ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:46.345501 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0307 22:33:46.373773 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:46.373805 203173 retry.go:31] will retry after 517.989931ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0307 22:33:46.422541 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:46.422583 203173 retry.go:31] will retry after 473.924423ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:46.755639 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0307 22:33:46.825405 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:46.825441 203173 retry.go:31] will retry after 778.977627ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:46.892734 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0307 22:33:46.897076 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0307 22:33:46.985660 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:46.985698 203173 retry.go:31] will retry after 450.201187ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:46.989997 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0307 22:33:46.996936 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:46.996970 203173 retry.go:31] will retry after 774.656034ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:47.063895 203173 node_ready.go:53] error getting node "old-k8s-version-497253": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-497253": dial tcp 192.168.76.2:8443: connect: connection refused
W0307 22:33:47.066480 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:47.066514 203173 retry.go:31] will retry after 446.708587ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:47.436978 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0307 22:33:47.503090 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:47.503120 203173 retry.go:31] will retry after 962.275792ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:47.514296 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0307 22:33:47.590713 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:47.590748 203173 retry.go:31] will retry after 1.007436906s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:47.605008 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0307 22:33:47.689105 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:47.689140 203173 retry.go:31] will retry after 977.055502ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:47.772328 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0307 22:33:47.849589 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:47.849626 203173 retry.go:31] will retry after 903.780241ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:48.465601 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0307 22:33:48.544093 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:48.544128 203173 retry.go:31] will retry after 1.405018754s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:48.598985 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0307 22:33:48.666353 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0307 22:33:48.676135 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:48.676166 203173 retry.go:31] will retry after 1.040011882s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0307 22:33:48.742582 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:48.742619 203173 retry.go:31] will retry after 1.848956226s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:48.753817 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0307 22:33:48.826415 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:48.826453 203173 retry.go:31] will retry after 1.750209019s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:49.064137 203173 node_ready.go:53] error getting node "old-k8s-version-497253": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-497253": dial tcp 192.168.76.2:8443: connect: connection refused
I0307 22:33:49.716389 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0307 22:33:49.783902 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:49.783932 203173 retry.go:31] will retry after 1.502014512s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:49.950288 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0307 22:33:50.023699 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:50.023736 203173 retry.go:31] will retry after 2.484788303s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:50.577426 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0307 22:33:50.591723 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0307 22:33:50.677623 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:50.677659 203173 retry.go:31] will retry after 1.750579278s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0307 22:33:50.699830 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:50.699864 203173 retry.go:31] will retry after 2.494936803s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:51.286811 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0307 22:33:51.356413 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:51.356444 203173 retry.go:31] will retry after 3.26534739s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:51.564065 203173 node_ready.go:53] error getting node "old-k8s-version-497253": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-497253": dial tcp 192.168.76.2:8443: connect: connection refused
I0307 22:33:52.428471 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0307 22:33:52.508694 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0307 22:33:52.630273 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:52.630302 203173 retry.go:31] will retry after 2.206892838s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0307 22:33:52.747835 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:52.747864 203173 retry.go:31] will retry after 6.342468947s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:53.194938 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0307 22:33:53.293108 203173 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:53.293144 203173 retry.go:31] will retry after 2.780395788s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0307 22:33:54.064180 203173 node_ready.go:53] error getting node "old-k8s-version-497253": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-497253": dial tcp 192.168.76.2:8443: connect: connection refused
I0307 22:33:54.622596 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0307 22:33:54.838036 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0307 22:33:56.074467 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0307 22:33:59.091476 203173 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0307 22:34:05.042942 203173 node_ready.go:49] node "old-k8s-version-497253" has status "Ready":"True"
I0307 22:34:05.042965 203173 node_ready.go:38] duration metric: took 19.980092742s for node "old-k8s-version-497253" to be "Ready" ...
I0307 22:34:05.042975 203173 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0307 22:34:05.229670 203173 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-jjsjg" in "kube-system" namespace to be "Ready" ...
I0307 22:34:05.586751 203173 pod_ready.go:92] pod "coredns-74ff55c5b-jjsjg" in "kube-system" namespace has status "Ready":"True"
I0307 22:34:05.586827 203173 pod_ready.go:81] duration metric: took 357.077337ms for pod "coredns-74ff55c5b-jjsjg" in "kube-system" namespace to be "Ready" ...
I0307 22:34:05.586856 203173 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-497253" in "kube-system" namespace to be "Ready" ...
I0307 22:34:05.737035 203173 pod_ready.go:92] pod "etcd-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"True"
I0307 22:34:05.737105 203173 pod_ready.go:81] duration metric: took 150.229235ms for pod "etcd-old-k8s-version-497253" in "kube-system" namespace to be "Ready" ...
I0307 22:34:05.737140 203173 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-497253" in "kube-system" namespace to be "Ready" ...
I0307 22:34:07.772384 203173 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:34:08.830746 203173 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (14.208115868s)
I0307 22:34:08.919288 203173 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (14.0812099s)
I0307 22:34:08.919327 203173 addons.go:470] Verifying addon metrics-server=true in "old-k8s-version-497253"
I0307 22:34:08.919425 203173 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (12.844926758s)
I0307 22:34:08.922187 203173 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-497253 addons enable metrics-server
I0307 22:34:08.919679 203173 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (9.828175238s)
I0307 22:34:08.939675 203173 out.go:177] * Enabled addons: storage-provisioner, metrics-server, dashboard, default-storageclass
I0307 22:34:08.941812 203173 addons.go:505] duration metric: took 24.094540566s for enable addons: enabled=[storage-provisioner metrics-server dashboard default-storageclass]
I0307 22:34:10.243149 203173 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:34:12.243533 203173 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:34:14.243184 203173 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"True"
I0307 22:34:14.243209 203173 pod_ready.go:81] duration metric: took 8.5060487s for pod "kube-apiserver-old-k8s-version-497253" in "kube-system" namespace to be "Ready" ...
I0307 22:34:14.243220 203173 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace to be "Ready" ...
I0307 22:34:16.250723 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:34:18.749639 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:34:20.749691 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:34:22.750761 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:34:24.796046 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:34:27.250622 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:34:29.251886 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:34:31.253634 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:34:33.750324 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:34:36.249866 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:34:38.249956 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:34:40.250636 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:34:42.250914 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:34:44.750128 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:34:47.249265 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:34:49.250180 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:34:51.750157 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:34:53.753267 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:34:56.249875 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:34:58.749926 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:01.250674 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:03.749214 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:05.750941 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:08.249026 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:10.251021 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:12.769053 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:15.253885 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:17.751535 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:20.250616 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:22.757325 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:25.278867 203173 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"True"
I0307 22:35:25.278895 203173 pod_ready.go:81] duration metric: took 1m11.035666367s for pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace to be "Ready" ...
I0307 22:35:25.278908 203173 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-8s7l5" in "kube-system" namespace to be "Ready" ...
I0307 22:35:25.284398 203173 pod_ready.go:92] pod "kube-proxy-8s7l5" in "kube-system" namespace has status "Ready":"True"
I0307 22:35:25.284421 203173 pod_ready.go:81] duration metric: took 5.505752ms for pod "kube-proxy-8s7l5" in "kube-system" namespace to be "Ready" ...
I0307 22:35:25.284432 203173 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-497253" in "kube-system" namespace to be "Ready" ...
I0307 22:35:25.289813 203173 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"True"
I0307 22:35:25.289838 203173 pod_ready.go:81] duration metric: took 5.397953ms for pod "kube-scheduler-old-k8s-version-497253" in "kube-system" namespace to be "Ready" ...
I0307 22:35:25.289850 203173 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace to be "Ready" ...
I0307 22:35:27.296486 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:29.297074 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:31.796091 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:33.797140 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:35.801061 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:38.297272 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:40.796600 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:42.797115 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:45.298847 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:47.796663 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:50.296374 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:52.796187 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:54.796599 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:56.798445 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:59.295821 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:01.296396 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:03.796625 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:06.296444 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:08.297407 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:10.796602 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:13.295686 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:15.296045 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:17.301566 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:19.796306 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:22.296441 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:24.796739 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:27.297453 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:29.300605 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:31.796632 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:34.296019 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:36.296825 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:38.796557 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:40.797121 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:43.296360 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:45.298301 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:47.796686 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:50.295837 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:52.296530 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:54.297148 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:56.796796 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:58.796999 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:01.296221 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:03.296654 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:05.297692 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:07.797249 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:10.296763 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:12.797250 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:14.798715 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:17.296697 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:19.297631 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:21.796680 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:24.296142 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:26.326766 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:28.795966 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:30.796372 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:33.296568 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:35.296723 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:37.796345 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:40.295858 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:42.297400 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:44.796351 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:46.796401 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:48.797340 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:51.296470 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:53.296690 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:55.298602 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:57.796372 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:59.796520 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:02.296249 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:04.796146 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:06.796971 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:09.296375 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:11.795721 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:13.801706 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:16.296885 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:18.298497 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:20.796022 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:22.797461 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:25.296255 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:27.297096 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:29.796172 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:32.295946 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:34.795870 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:36.796339 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:38.796554 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:41.297458 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:43.795600 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:45.797095 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:47.802184 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:50.296669 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:52.795972 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:55.296865 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:57.795956 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:00.301337 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:02.796169 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:05.295485 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:07.296560 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:09.796355 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:12.295856 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:14.296046 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:16.796231 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:18.796994 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:20.797675 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:23.296761 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:25.296213 203173 pod_ready.go:81] duration metric: took 4m0.00634836s for pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace to be "Ready" ...
E0307 22:39:25.296241 203173 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0307 22:39:25.296251 203173 pod_ready.go:38] duration metric: took 5m20.253260881s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0307 22:39:25.296265 203173 api_server.go:52] waiting for apiserver process to appear ...
I0307 22:39:25.296329 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0307 22:39:25.296395 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0307 22:39:25.336345 203173 cri.go:89] found id: "8b2ed0287cc5bbf594cda29d926ae828c7d6d12ad490285c6e855c8824388d29"
I0307 22:39:25.336366 203173 cri.go:89] found id: "cc2db588ff857bfb95417bfc8b125ca64e6caba952ba4acd81ec27522fde3127"
I0307 22:39:25.336371 203173 cri.go:89] found id: ""
I0307 22:39:25.336378 203173 logs.go:276] 2 containers: [8b2ed0287cc5bbf594cda29d926ae828c7d6d12ad490285c6e855c8824388d29 cc2db588ff857bfb95417bfc8b125ca64e6caba952ba4acd81ec27522fde3127]
I0307 22:39:25.336438 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.340420 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.343703 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0307 22:39:25.343781 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0307 22:39:25.383563 203173 cri.go:89] found id: "14afb08fcf0333a1d360d000f1fa3b158ae712b1b2a3e6c52b164c05245f920d"
I0307 22:39:25.383585 203173 cri.go:89] found id: "dabbb0b4fd2574e92c3a53182c494ec08df151f99bd21d27189df149b7f8961c"
I0307 22:39:25.383596 203173 cri.go:89] found id: ""
I0307 22:39:25.383604 203173 logs.go:276] 2 containers: [14afb08fcf0333a1d360d000f1fa3b158ae712b1b2a3e6c52b164c05245f920d dabbb0b4fd2574e92c3a53182c494ec08df151f99bd21d27189df149b7f8961c]
I0307 22:39:25.383675 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.387470 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.390779 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0307 22:39:25.390841 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0307 22:39:25.437462 203173 cri.go:89] found id: "413452dbe13bfb277303d92484791aa53ae9a198a089364135d2347bf8475623"
I0307 22:39:25.437481 203173 cri.go:89] found id: "a105c02644c9c901090c4c9792a32b0396cee09395513751eeb1be7fbf4b8477"
I0307 22:39:25.437486 203173 cri.go:89] found id: ""
I0307 22:39:25.437493 203173 logs.go:276] 2 containers: [413452dbe13bfb277303d92484791aa53ae9a198a089364135d2347bf8475623 a105c02644c9c901090c4c9792a32b0396cee09395513751eeb1be7fbf4b8477]
I0307 22:39:25.437547 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.441300 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.444236 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0307 22:39:25.444346 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0307 22:39:25.486461 203173 cri.go:89] found id: "157ece61e2d99f79b42530111727fc9798a3b91433c5d3a5cd83cefec75a6a67"
I0307 22:39:25.486519 203173 cri.go:89] found id: "2ca89421ca012456f503b4b92ac92a69bf6b0042461af4e2e3140e7adb8b27dc"
I0307 22:39:25.486538 203173 cri.go:89] found id: ""
I0307 22:39:25.486552 203173 logs.go:276] 2 containers: [157ece61e2d99f79b42530111727fc9798a3b91433c5d3a5cd83cefec75a6a67 2ca89421ca012456f503b4b92ac92a69bf6b0042461af4e2e3140e7adb8b27dc]
I0307 22:39:25.486610 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.490758 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.494081 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0307 22:39:25.494191 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0307 22:39:25.533954 203173 cri.go:89] found id: "7998095a37dd2896f96215e8ab5d29ae495d3dc1a00b119506f8ace55156b07a"
I0307 22:39:25.534016 203173 cri.go:89] found id: "f1df99d1a705a4556e4be13c16d400b99149438c96bfe6da863b8b041983b036"
I0307 22:39:25.534046 203173 cri.go:89] found id: ""
I0307 22:39:25.534060 203173 logs.go:276] 2 containers: [7998095a37dd2896f96215e8ab5d29ae495d3dc1a00b119506f8ace55156b07a f1df99d1a705a4556e4be13c16d400b99149438c96bfe6da863b8b041983b036]
I0307 22:39:25.534121 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.537826 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.542894 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0307 22:39:25.543014 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0307 22:39:25.585812 203173 cri.go:89] found id: "9ba0a9f80bc7b1866c7509e8df81dcc0d3e74b8702a84d7676660a9395cf59fc"
I0307 22:39:25.585836 203173 cri.go:89] found id: "bd7a60d8d4f26067debaaf5b2c23fe94dcfed76118b17104051bc8c755b35ce1"
I0307 22:39:25.585842 203173 cri.go:89] found id: ""
I0307 22:39:25.585855 203173 logs.go:276] 2 containers: [9ba0a9f80bc7b1866c7509e8df81dcc0d3e74b8702a84d7676660a9395cf59fc bd7a60d8d4f26067debaaf5b2c23fe94dcfed76118b17104051bc8c755b35ce1]
I0307 22:39:25.585922 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.589442 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.592832 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0307 22:39:25.592923 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0307 22:39:25.636509 203173 cri.go:89] found id: "2543aa094e87373b5f846e8bdc2bbadbdda2c55f6d326c6db6b9216375dde5e6"
I0307 22:39:25.636533 203173 cri.go:89] found id: "e9768721745ab392d0ad14d4055c5cf01cc780491a01953b4b45bf77d2d3b062"
I0307 22:39:25.636538 203173 cri.go:89] found id: ""
I0307 22:39:25.636545 203173 logs.go:276] 2 containers: [2543aa094e87373b5f846e8bdc2bbadbdda2c55f6d326c6db6b9216375dde5e6 e9768721745ab392d0ad14d4055c5cf01cc780491a01953b4b45bf77d2d3b062]
I0307 22:39:25.636619 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.640672 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.644632 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0307 22:39:25.644725 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0307 22:39:25.685799 203173 cri.go:89] found id: "778e16c451c2e6a7fecd1d1b5d37778e92f50fd757af7d8812222cfa025fdc86"
I0307 22:39:25.685822 203173 cri.go:89] found id: ""
I0307 22:39:25.685830 203173 logs.go:276] 1 containers: [778e16c451c2e6a7fecd1d1b5d37778e92f50fd757af7d8812222cfa025fdc86]
I0307 22:39:25.685911 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.689934 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0307 22:39:25.690008 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0307 22:39:25.727726 203173 cri.go:89] found id: "426c41631cb95479682cbd7b19483427f710b2f7932b9e6d2bc0367710c2ca1d"
I0307 22:39:25.727753 203173 cri.go:89] found id: "f98ff695720f5ebea06fa188196a8a6393c29dfd0211d4a0ec784c54cbb9f906"
I0307 22:39:25.727758 203173 cri.go:89] found id: ""
I0307 22:39:25.727766 203173 logs.go:276] 2 containers: [426c41631cb95479682cbd7b19483427f710b2f7932b9e6d2bc0367710c2ca1d f98ff695720f5ebea06fa188196a8a6393c29dfd0211d4a0ec784c54cbb9f906]
I0307 22:39:25.727867 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.731423 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.735053 203173 logs.go:123] Gathering logs for containerd ...
I0307 22:39:25.735120 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0307 22:39:25.796794 203173 logs.go:123] Gathering logs for etcd [14afb08fcf0333a1d360d000f1fa3b158ae712b1b2a3e6c52b164c05245f920d] ...
I0307 22:39:25.796828 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 14afb08fcf0333a1d360d000f1fa3b158ae712b1b2a3e6c52b164c05245f920d"
I0307 22:39:25.841590 203173 logs.go:123] Gathering logs for kube-scheduler [157ece61e2d99f79b42530111727fc9798a3b91433c5d3a5cd83cefec75a6a67] ...
I0307 22:39:25.841620 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 157ece61e2d99f79b42530111727fc9798a3b91433c5d3a5cd83cefec75a6a67"
I0307 22:39:25.886268 203173 logs.go:123] Gathering logs for kube-proxy [7998095a37dd2896f96215e8ab5d29ae495d3dc1a00b119506f8ace55156b07a] ...
I0307 22:39:25.886343 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7998095a37dd2896f96215e8ab5d29ae495d3dc1a00b119506f8ace55156b07a"
I0307 22:39:25.924898 203173 logs.go:123] Gathering logs for kube-scheduler [2ca89421ca012456f503b4b92ac92a69bf6b0042461af4e2e3140e7adb8b27dc] ...
I0307 22:39:25.924972 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2ca89421ca012456f503b4b92ac92a69bf6b0042461af4e2e3140e7adb8b27dc"
I0307 22:39:25.970416 203173 logs.go:123] Gathering logs for kindnet [2543aa094e87373b5f846e8bdc2bbadbdda2c55f6d326c6db6b9216375dde5e6] ...
I0307 22:39:25.970447 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2543aa094e87373b5f846e8bdc2bbadbdda2c55f6d326c6db6b9216375dde5e6"
I0307 22:39:26.015966 203173 logs.go:123] Gathering logs for kindnet [e9768721745ab392d0ad14d4055c5cf01cc780491a01953b4b45bf77d2d3b062] ...
I0307 22:39:26.015998 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e9768721745ab392d0ad14d4055c5cf01cc780491a01953b4b45bf77d2d3b062"
I0307 22:39:26.070164 203173 logs.go:123] Gathering logs for kubernetes-dashboard [778e16c451c2e6a7fecd1d1b5d37778e92f50fd757af7d8812222cfa025fdc86] ...
I0307 22:39:26.070190 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 778e16c451c2e6a7fecd1d1b5d37778e92f50fd757af7d8812222cfa025fdc86"
I0307 22:39:26.111136 203173 logs.go:123] Gathering logs for container status ...
I0307 22:39:26.111163 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0307 22:39:26.163682 203173 logs.go:123] Gathering logs for dmesg ...
I0307 22:39:26.163711 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0307 22:39:26.181702 203173 logs.go:123] Gathering logs for kube-apiserver [cc2db588ff857bfb95417bfc8b125ca64e6caba952ba4acd81ec27522fde3127] ...
I0307 22:39:26.181732 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cc2db588ff857bfb95417bfc8b125ca64e6caba952ba4acd81ec27522fde3127"
I0307 22:39:26.246451 203173 logs.go:123] Gathering logs for coredns [413452dbe13bfb277303d92484791aa53ae9a198a089364135d2347bf8475623] ...
I0307 22:39:26.246483 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 413452dbe13bfb277303d92484791aa53ae9a198a089364135d2347bf8475623"
I0307 22:39:26.295840 203173 logs.go:123] Gathering logs for kube-proxy [f1df99d1a705a4556e4be13c16d400b99149438c96bfe6da863b8b041983b036] ...
I0307 22:39:26.295868 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f1df99d1a705a4556e4be13c16d400b99149438c96bfe6da863b8b041983b036"
I0307 22:39:26.341619 203173 logs.go:123] Gathering logs for kube-controller-manager [bd7a60d8d4f26067debaaf5b2c23fe94dcfed76118b17104051bc8c755b35ce1] ...
I0307 22:39:26.341646 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bd7a60d8d4f26067debaaf5b2c23fe94dcfed76118b17104051bc8c755b35ce1"
I0307 22:39:26.408963 203173 logs.go:123] Gathering logs for kubelet ...
I0307 22:39:26.408996 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0307 22:39:26.472507 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:05 old-k8s-version-497253 kubelet[660]: E0307 22:34:05.261951 660 reflector.go:138] object-"kube-system"/"kindnet-token-ghqhd": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-ghqhd" is forbidden: User "system:node:old-k8s-version-497253" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-497253' and this object
W0307 22:39:26.479496 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:07 old-k8s-version-497253 kubelet[660]: E0307 22:34:07.162816 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0307 22:39:26.479691 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:07 old-k8s-version-497253 kubelet[660]: E0307 22:34:07.277655 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.482575 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:22 old-k8s-version-497253 kubelet[660]: E0307 22:34:22.936411 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0307 22:39:26.484741 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:36 old-k8s-version-497253 kubelet[660]: E0307 22:34:36.920792 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.485205 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:37 old-k8s-version-497253 kubelet[660]: E0307 22:34:37.462923 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.485558 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:38 old-k8s-version-497253 kubelet[660]: E0307 22:34:38.465991 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.486058 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:39 old-k8s-version-497253 kubelet[660]: E0307 22:34:39.469998 660 pod_workers.go:191] Error syncing pod f477a573-d9fd-4235-84a6-32e52bea48e1 ("storage-provisioner_kube-system(f477a573-d9fd-4235-84a6-32e52bea48e1)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(f477a573-d9fd-4235-84a6-32e52bea48e1)"
W0307 22:39:26.486394 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:41 old-k8s-version-497253 kubelet[660]: E0307 22:34:41.449013 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.489348 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:51 old-k8s-version-497253 kubelet[660]: E0307 22:34:51.926704 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0307 22:39:26.489941 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:54 old-k8s-version-497253 kubelet[660]: E0307 22:34:54.505288 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.490272 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:01 old-k8s-version-497253 kubelet[660]: E0307 22:35:01.448994 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.490457 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:02 old-k8s-version-497253 kubelet[660]: E0307 22:35:02.915003 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.490785 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:12 old-k8s-version-497253 kubelet[660]: E0307 22:35:12.922852 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.490970 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:14 old-k8s-version-497253 kubelet[660]: E0307 22:35:14.914572 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.491560 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:25 old-k8s-version-497253 kubelet[660]: E0307 22:35:25.578672 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.491748 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:26 old-k8s-version-497253 kubelet[660]: E0307 22:35:26.918579 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.492079 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:31 old-k8s-version-497253 kubelet[660]: E0307 22:35:31.448901 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.494548 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:39 old-k8s-version-497253 kubelet[660]: E0307 22:35:39.938727 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0307 22:39:26.494876 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:46 old-k8s-version-497253 kubelet[660]: E0307 22:35:46.914538 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.495064 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:53 old-k8s-version-497253 kubelet[660]: E0307 22:35:53.914358 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.495392 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:00 old-k8s-version-497253 kubelet[660]: E0307 22:36:00.917774 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.495577 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:05 old-k8s-version-497253 kubelet[660]: E0307 22:36:05.914412 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.496168 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:15 old-k8s-version-497253 kubelet[660]: E0307 22:36:15.682987 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.496383 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:18 old-k8s-version-497253 kubelet[660]: E0307 22:36:18.914367 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.496715 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:21 old-k8s-version-497253 kubelet[660]: E0307 22:36:21.449525 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.496902 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:31 old-k8s-version-497253 kubelet[660]: E0307 22:36:31.914470 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.497228 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:33 old-k8s-version-497253 kubelet[660]: E0307 22:36:33.914221 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.497446 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:42 old-k8s-version-497253 kubelet[660]: E0307 22:36:42.914696 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.497795 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:45 old-k8s-version-497253 kubelet[660]: E0307 22:36:45.914100 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.497981 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:57 old-k8s-version-497253 kubelet[660]: E0307 22:36:57.914372 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.498309 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:58 old-k8s-version-497253 kubelet[660]: E0307 22:36:58.914093 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.498659 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:10 old-k8s-version-497253 kubelet[660]: E0307 22:37:10.914874 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.501139 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:10 old-k8s-version-497253 kubelet[660]: E0307 22:37:10.928532 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0307 22:39:26.501328 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:21 old-k8s-version-497253 kubelet[660]: E0307 22:37:21.914234 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.501658 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:23 old-k8s-version-497253 kubelet[660]: E0307 22:37:23.914014 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.501850 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:33 old-k8s-version-497253 kubelet[660]: E0307 22:37:33.914590 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.502442 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:37 old-k8s-version-497253 kubelet[660]: E0307 22:37:37.858788 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.502771 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:41 old-k8s-version-497253 kubelet[660]: E0307 22:37:41.449456 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.502959 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:46 old-k8s-version-497253 kubelet[660]: E0307 22:37:46.917492 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.503286 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:56 old-k8s-version-497253 kubelet[660]: E0307 22:37:56.914065 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.503470 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:57 old-k8s-version-497253 kubelet[660]: E0307 22:37:57.915061 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.503655 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:09 old-k8s-version-497253 kubelet[660]: E0307 22:38:09.914552 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.503988 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:11 old-k8s-version-497253 kubelet[660]: E0307 22:38:11.913955 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.504175 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:23 old-k8s-version-497253 kubelet[660]: E0307 22:38:23.914295 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.504556 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:26 old-k8s-version-497253 kubelet[660]: E0307 22:38:26.914365 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.504744 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:35 old-k8s-version-497253 kubelet[660]: E0307 22:38:35.914352 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.505086 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:38 old-k8s-version-497253 kubelet[660]: E0307 22:38:38.914978 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.505272 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:48 old-k8s-version-497253 kubelet[660]: E0307 22:38:48.914308 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.505628 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:50 old-k8s-version-497253 kubelet[660]: E0307 22:38:50.914584 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.505961 203173 logs.go:138] Found kubelet problem: Mar 07 22:39:01 old-k8s-version-497253 kubelet[660]: E0307 22:39:01.914578 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.506151 203173 logs.go:138] Found kubelet problem: Mar 07 22:39:03 old-k8s-version-497253 kubelet[660]: E0307 22:39:03.914427 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.506484 203173 logs.go:138] Found kubelet problem: Mar 07 22:39:15 old-k8s-version-497253 kubelet[660]: E0307 22:39:15.913973 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.506668 203173 logs.go:138] Found kubelet problem: Mar 07 22:39:16 old-k8s-version-497253 kubelet[660]: E0307 22:39:16.918241 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0307 22:39:26.506680 203173 logs.go:123] Gathering logs for kube-apiserver [8b2ed0287cc5bbf594cda29d926ae828c7d6d12ad490285c6e855c8824388d29] ...
I0307 22:39:26.506725 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8b2ed0287cc5bbf594cda29d926ae828c7d6d12ad490285c6e855c8824388d29"
I0307 22:39:26.567581 203173 logs.go:123] Gathering logs for coredns [a105c02644c9c901090c4c9792a32b0396cee09395513751eeb1be7fbf4b8477] ...
I0307 22:39:26.567616 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a105c02644c9c901090c4c9792a32b0396cee09395513751eeb1be7fbf4b8477"
I0307 22:39:26.617169 203173 logs.go:123] Gathering logs for storage-provisioner [426c41631cb95479682cbd7b19483427f710b2f7932b9e6d2bc0367710c2ca1d] ...
I0307 22:39:26.617197 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 426c41631cb95479682cbd7b19483427f710b2f7932b9e6d2bc0367710c2ca1d"
I0307 22:39:26.667945 203173 logs.go:123] Gathering logs for storage-provisioner [f98ff695720f5ebea06fa188196a8a6393c29dfd0211d4a0ec784c54cbb9f906] ...
I0307 22:39:26.667973 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f98ff695720f5ebea06fa188196a8a6393c29dfd0211d4a0ec784c54cbb9f906"
I0307 22:39:26.707720 203173 logs.go:123] Gathering logs for describe nodes ...
I0307 22:39:26.707752 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0307 22:39:26.855434 203173 logs.go:123] Gathering logs for etcd [dabbb0b4fd2574e92c3a53182c494ec08df151f99bd21d27189df149b7f8961c] ...
I0307 22:39:26.855466 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dabbb0b4fd2574e92c3a53182c494ec08df151f99bd21d27189df149b7f8961c"
I0307 22:39:26.907427 203173 logs.go:123] Gathering logs for kube-controller-manager [9ba0a9f80bc7b1866c7509e8df81dcc0d3e74b8702a84d7676660a9395cf59fc] ...
I0307 22:39:26.907454 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9ba0a9f80bc7b1866c7509e8df81dcc0d3e74b8702a84d7676660a9395cf59fc"
I0307 22:39:26.977630 203173 out.go:304] Setting ErrFile to fd 2...
I0307 22:39:26.977706 203173 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0307 22:39:26.977771 203173 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0307 22:39:26.977934 203173 out.go:239] Mar 07 22:38:50 old-k8s-version-497253 kubelet[660]: E0307 22:38:50.914584 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
Mar 07 22:38:50 old-k8s-version-497253 kubelet[660]: E0307 22:38:50.914584 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.977983 203173 out.go:239] Mar 07 22:39:01 old-k8s-version-497253 kubelet[660]: E0307 22:39:01.914578 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
Mar 07 22:39:01 old-k8s-version-497253 kubelet[660]: E0307 22:39:01.914578 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.978041 203173 out.go:239] Mar 07 22:39:03 old-k8s-version-497253 kubelet[660]: E0307 22:39:03.914427 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 07 22:39:03 old-k8s-version-497253 kubelet[660]: E0307 22:39:03.914427 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.978077 203173 out.go:239] Mar 07 22:39:15 old-k8s-version-497253 kubelet[660]: E0307 22:39:15.913973 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
Mar 07 22:39:15 old-k8s-version-497253 kubelet[660]: E0307 22:39:15.913973 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.978110 203173 out.go:239] Mar 07 22:39:16 old-k8s-version-497253 kubelet[660]: E0307 22:39:16.918241 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 07 22:39:16 old-k8s-version-497253 kubelet[660]: E0307 22:39:16.918241 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0307 22:39:26.978155 203173 out.go:304] Setting ErrFile to fd 2...
I0307 22:39:26.978179 203173 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 22:39:36.979366 203173 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0307 22:39:36.991646 203173 api_server.go:72] duration metric: took 5m52.144665067s to wait for apiserver process to appear ...
I0307 22:39:36.991674 203173 api_server.go:88] waiting for apiserver healthz status ...
I0307 22:39:36.991726 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0307 22:39:36.991797 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0307 22:39:37.043778 203173 cri.go:89] found id: "8b2ed0287cc5bbf594cda29d926ae828c7d6d12ad490285c6e855c8824388d29"
I0307 22:39:37.043817 203173 cri.go:89] found id: "cc2db588ff857bfb95417bfc8b125ca64e6caba952ba4acd81ec27522fde3127"
I0307 22:39:37.043823 203173 cri.go:89] found id: ""
I0307 22:39:37.043831 203173 logs.go:276] 2 containers: [8b2ed0287cc5bbf594cda29d926ae828c7d6d12ad490285c6e855c8824388d29 cc2db588ff857bfb95417bfc8b125ca64e6caba952ba4acd81ec27522fde3127]
I0307 22:39:37.043902 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.049541 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.054684 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0307 22:39:37.054809 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0307 22:39:37.100838 203173 cri.go:89] found id: "14afb08fcf0333a1d360d000f1fa3b158ae712b1b2a3e6c52b164c05245f920d"
I0307 22:39:37.100860 203173 cri.go:89] found id: "dabbb0b4fd2574e92c3a53182c494ec08df151f99bd21d27189df149b7f8961c"
I0307 22:39:37.100865 203173 cri.go:89] found id: ""
I0307 22:39:37.100873 203173 logs.go:276] 2 containers: [14afb08fcf0333a1d360d000f1fa3b158ae712b1b2a3e6c52b164c05245f920d dabbb0b4fd2574e92c3a53182c494ec08df151f99bd21d27189df149b7f8961c]
I0307 22:39:37.100932 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.104646 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.108148 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0307 22:39:37.108223 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0307 22:39:37.151349 203173 cri.go:89] found id: "413452dbe13bfb277303d92484791aa53ae9a198a089364135d2347bf8475623"
I0307 22:39:37.151380 203173 cri.go:89] found id: "a105c02644c9c901090c4c9792a32b0396cee09395513751eeb1be7fbf4b8477"
I0307 22:39:37.151386 203173 cri.go:89] found id: ""
I0307 22:39:37.151393 203173 logs.go:276] 2 containers: [413452dbe13bfb277303d92484791aa53ae9a198a089364135d2347bf8475623 a105c02644c9c901090c4c9792a32b0396cee09395513751eeb1be7fbf4b8477]
I0307 22:39:37.151449 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.155102 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.158773 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0307 22:39:37.158875 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0307 22:39:37.197623 203173 cri.go:89] found id: "157ece61e2d99f79b42530111727fc9798a3b91433c5d3a5cd83cefec75a6a67"
I0307 22:39:37.197647 203173 cri.go:89] found id: "2ca89421ca012456f503b4b92ac92a69bf6b0042461af4e2e3140e7adb8b27dc"
I0307 22:39:37.197652 203173 cri.go:89] found id: ""
I0307 22:39:37.197659 203173 logs.go:276] 2 containers: [157ece61e2d99f79b42530111727fc9798a3b91433c5d3a5cd83cefec75a6a67 2ca89421ca012456f503b4b92ac92a69bf6b0042461af4e2e3140e7adb8b27dc]
I0307 22:39:37.197711 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.201264 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.204706 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0307 22:39:37.204782 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0307 22:39:37.244484 203173 cri.go:89] found id: "7998095a37dd2896f96215e8ab5d29ae495d3dc1a00b119506f8ace55156b07a"
I0307 22:39:37.244508 203173 cri.go:89] found id: "f1df99d1a705a4556e4be13c16d400b99149438c96bfe6da863b8b041983b036"
I0307 22:39:37.244513 203173 cri.go:89] found id: ""
I0307 22:39:37.244520 203173 logs.go:276] 2 containers: [7998095a37dd2896f96215e8ab5d29ae495d3dc1a00b119506f8ace55156b07a f1df99d1a705a4556e4be13c16d400b99149438c96bfe6da863b8b041983b036]
I0307 22:39:37.244580 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.248425 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.252613 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0307 22:39:37.252752 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0307 22:39:37.296151 203173 cri.go:89] found id: "9ba0a9f80bc7b1866c7509e8df81dcc0d3e74b8702a84d7676660a9395cf59fc"
I0307 22:39:37.296177 203173 cri.go:89] found id: "bd7a60d8d4f26067debaaf5b2c23fe94dcfed76118b17104051bc8c755b35ce1"
I0307 22:39:37.296182 203173 cri.go:89] found id: ""
I0307 22:39:37.296189 203173 logs.go:276] 2 containers: [9ba0a9f80bc7b1866c7509e8df81dcc0d3e74b8702a84d7676660a9395cf59fc bd7a60d8d4f26067debaaf5b2c23fe94dcfed76118b17104051bc8c755b35ce1]
I0307 22:39:37.296344 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.300120 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.303560 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0307 22:39:37.303657 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0307 22:39:37.341312 203173 cri.go:89] found id: "2543aa094e87373b5f846e8bdc2bbadbdda2c55f6d326c6db6b9216375dde5e6"
I0307 22:39:37.341335 203173 cri.go:89] found id: "e9768721745ab392d0ad14d4055c5cf01cc780491a01953b4b45bf77d2d3b062"
I0307 22:39:37.341341 203173 cri.go:89] found id: ""
I0307 22:39:37.341348 203173 logs.go:276] 2 containers: [2543aa094e87373b5f846e8bdc2bbadbdda2c55f6d326c6db6b9216375dde5e6 e9768721745ab392d0ad14d4055c5cf01cc780491a01953b4b45bf77d2d3b062]
I0307 22:39:37.341404 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.344938 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.348625 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0307 22:39:37.348737 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0307 22:39:37.386014 203173 cri.go:89] found id: "426c41631cb95479682cbd7b19483427f710b2f7932b9e6d2bc0367710c2ca1d"
I0307 22:39:37.386037 203173 cri.go:89] found id: "f98ff695720f5ebea06fa188196a8a6393c29dfd0211d4a0ec784c54cbb9f906"
I0307 22:39:37.386042 203173 cri.go:89] found id: ""
I0307 22:39:37.386049 203173 logs.go:276] 2 containers: [426c41631cb95479682cbd7b19483427f710b2f7932b9e6d2bc0367710c2ca1d f98ff695720f5ebea06fa188196a8a6393c29dfd0211d4a0ec784c54cbb9f906]
I0307 22:39:37.386141 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.390014 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.393469 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0307 22:39:37.393596 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0307 22:39:37.459166 203173 cri.go:89] found id: "778e16c451c2e6a7fecd1d1b5d37778e92f50fd757af7d8812222cfa025fdc86"
I0307 22:39:37.459191 203173 cri.go:89] found id: ""
I0307 22:39:37.459199 203173 logs.go:276] 1 containers: [778e16c451c2e6a7fecd1d1b5d37778e92f50fd757af7d8812222cfa025fdc86]
I0307 22:39:37.459285 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.463408 203173 logs.go:123] Gathering logs for describe nodes ...
I0307 22:39:37.463433 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0307 22:39:37.633708 203173 logs.go:123] Gathering logs for kube-apiserver [cc2db588ff857bfb95417bfc8b125ca64e6caba952ba4acd81ec27522fde3127] ...
I0307 22:39:37.633777 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cc2db588ff857bfb95417bfc8b125ca64e6caba952ba4acd81ec27522fde3127"
I0307 22:39:37.699015 203173 logs.go:123] Gathering logs for etcd [dabbb0b4fd2574e92c3a53182c494ec08df151f99bd21d27189df149b7f8961c] ...
I0307 22:39:37.699048 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dabbb0b4fd2574e92c3a53182c494ec08df151f99bd21d27189df149b7f8961c"
I0307 22:39:37.740792 203173 logs.go:123] Gathering logs for kube-scheduler [157ece61e2d99f79b42530111727fc9798a3b91433c5d3a5cd83cefec75a6a67] ...
I0307 22:39:37.740824 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 157ece61e2d99f79b42530111727fc9798a3b91433c5d3a5cd83cefec75a6a67"
I0307 22:39:37.793158 203173 logs.go:123] Gathering logs for kindnet [2543aa094e87373b5f846e8bdc2bbadbdda2c55f6d326c6db6b9216375dde5e6] ...
I0307 22:39:37.793186 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2543aa094e87373b5f846e8bdc2bbadbdda2c55f6d326c6db6b9216375dde5e6"
I0307 22:39:37.845822 203173 logs.go:123] Gathering logs for kubelet ...
I0307 22:39:37.845849 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0307 22:39:37.901312 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:05 old-k8s-version-497253 kubelet[660]: E0307 22:34:05.261951 660 reflector.go:138] object-"kube-system"/"kindnet-token-ghqhd": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-ghqhd" is forbidden: User "system:node:old-k8s-version-497253" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-497253' and this object
W0307 22:39:37.908351 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:07 old-k8s-version-497253 kubelet[660]: E0307 22:34:07.162816 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0307 22:39:37.908549 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:07 old-k8s-version-497253 kubelet[660]: E0307 22:34:07.277655 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.911329 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:22 old-k8s-version-497253 kubelet[660]: E0307 22:34:22.936411 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0307 22:39:37.913515 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:36 old-k8s-version-497253 kubelet[660]: E0307 22:34:36.920792 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.913980 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:37 old-k8s-version-497253 kubelet[660]: E0307 22:34:37.462923 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.914311 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:38 old-k8s-version-497253 kubelet[660]: E0307 22:34:38.465991 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.914752 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:39 old-k8s-version-497253 kubelet[660]: E0307 22:34:39.469998 660 pod_workers.go:191] Error syncing pod f477a573-d9fd-4235-84a6-32e52bea48e1 ("storage-provisioner_kube-system(f477a573-d9fd-4235-84a6-32e52bea48e1)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(f477a573-d9fd-4235-84a6-32e52bea48e1)"
W0307 22:39:37.915080 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:41 old-k8s-version-497253 kubelet[660]: E0307 22:34:41.449013 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.918016 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:51 old-k8s-version-497253 kubelet[660]: E0307 22:34:51.926704 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0307 22:39:37.918607 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:54 old-k8s-version-497253 kubelet[660]: E0307 22:34:54.505288 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.918933 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:01 old-k8s-version-497253 kubelet[660]: E0307 22:35:01.448994 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.919119 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:02 old-k8s-version-497253 kubelet[660]: E0307 22:35:02.915003 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.919448 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:12 old-k8s-version-497253 kubelet[660]: E0307 22:35:12.922852 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.919635 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:14 old-k8s-version-497253 kubelet[660]: E0307 22:35:14.914572 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.920224 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:25 old-k8s-version-497253 kubelet[660]: E0307 22:35:25.578672 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.920418 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:26 old-k8s-version-497253 kubelet[660]: E0307 22:35:26.918579 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.920747 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:31 old-k8s-version-497253 kubelet[660]: E0307 22:35:31.448901 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.923205 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:39 old-k8s-version-497253 kubelet[660]: E0307 22:35:39.938727 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0307 22:39:37.923532 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:46 old-k8s-version-497253 kubelet[660]: E0307 22:35:46.914538 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.923717 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:53 old-k8s-version-497253 kubelet[660]: E0307 22:35:53.914358 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.924047 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:00 old-k8s-version-497253 kubelet[660]: E0307 22:36:00.917774 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.924231 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:05 old-k8s-version-497253 kubelet[660]: E0307 22:36:05.914412 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.924825 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:15 old-k8s-version-497253 kubelet[660]: E0307 22:36:15.682987 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.925010 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:18 old-k8s-version-497253 kubelet[660]: E0307 22:36:18.914367 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.925336 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:21 old-k8s-version-497253 kubelet[660]: E0307 22:36:21.449525 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.925522 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:31 old-k8s-version-497253 kubelet[660]: E0307 22:36:31.914470 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.925856 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:33 old-k8s-version-497253 kubelet[660]: E0307 22:36:33.914221 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.926040 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:42 old-k8s-version-497253 kubelet[660]: E0307 22:36:42.914696 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.926366 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:45 old-k8s-version-497253 kubelet[660]: E0307 22:36:45.914100 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.926550 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:57 old-k8s-version-497253 kubelet[660]: E0307 22:36:57.914372 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.926879 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:58 old-k8s-version-497253 kubelet[660]: E0307 22:36:58.914093 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.927206 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:10 old-k8s-version-497253 kubelet[660]: E0307 22:37:10.914874 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.929692 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:10 old-k8s-version-497253 kubelet[660]: E0307 22:37:10.928532 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0307 22:39:37.929880 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:21 old-k8s-version-497253 kubelet[660]: E0307 22:37:21.914234 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.930207 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:23 old-k8s-version-497253 kubelet[660]: E0307 22:37:23.914014 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.930390 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:33 old-k8s-version-497253 kubelet[660]: E0307 22:37:33.914590 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.930976 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:37 old-k8s-version-497253 kubelet[660]: E0307 22:37:37.858788 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.931303 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:41 old-k8s-version-497253 kubelet[660]: E0307 22:37:41.449456 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.931488 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:46 old-k8s-version-497253 kubelet[660]: E0307 22:37:46.917492 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.931817 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:56 old-k8s-version-497253 kubelet[660]: E0307 22:37:56.914065 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.932001 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:57 old-k8s-version-497253 kubelet[660]: E0307 22:37:57.915061 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.932185 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:09 old-k8s-version-497253 kubelet[660]: E0307 22:38:09.914552 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.932518 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:11 old-k8s-version-497253 kubelet[660]: E0307 22:38:11.913955 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.932704 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:23 old-k8s-version-497253 kubelet[660]: E0307 22:38:23.914295 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.933032 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:26 old-k8s-version-497253 kubelet[660]: E0307 22:38:26.914365 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.933216 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:35 old-k8s-version-497253 kubelet[660]: E0307 22:38:35.914352 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.933542 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:38 old-k8s-version-497253 kubelet[660]: E0307 22:38:38.914978 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.933726 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:48 old-k8s-version-497253 kubelet[660]: E0307 22:38:48.914308 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.934052 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:50 old-k8s-version-497253 kubelet[660]: E0307 22:38:50.914584 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.934378 203173 logs.go:138] Found kubelet problem: Mar 07 22:39:01 old-k8s-version-497253 kubelet[660]: E0307 22:39:01.914578 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.934564 203173 logs.go:138] Found kubelet problem: Mar 07 22:39:03 old-k8s-version-497253 kubelet[660]: E0307 22:39:03.914427 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.934899 203173 logs.go:138] Found kubelet problem: Mar 07 22:39:15 old-k8s-version-497253 kubelet[660]: E0307 22:39:15.913973 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.935085 203173 logs.go:138] Found kubelet problem: Mar 07 22:39:16 old-k8s-version-497253 kubelet[660]: E0307 22:39:16.918241 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.935411 203173 logs.go:138] Found kubelet problem: Mar 07 22:39:26 old-k8s-version-497253 kubelet[660]: E0307 22:39:26.914096 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.935596 203173 logs.go:138] Found kubelet problem: Mar 07 22:39:29 old-k8s-version-497253 kubelet[660]: E0307 22:39:29.914280 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0307 22:39:37.935605 203173 logs.go:123] Gathering logs for etcd [14afb08fcf0333a1d360d000f1fa3b158ae712b1b2a3e6c52b164c05245f920d] ...
I0307 22:39:37.935619 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 14afb08fcf0333a1d360d000f1fa3b158ae712b1b2a3e6c52b164c05245f920d"
I0307 22:39:37.997943 203173 logs.go:123] Gathering logs for kube-controller-manager [9ba0a9f80bc7b1866c7509e8df81dcc0d3e74b8702a84d7676660a9395cf59fc] ...
I0307 22:39:37.997972 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9ba0a9f80bc7b1866c7509e8df81dcc0d3e74b8702a84d7676660a9395cf59fc"
I0307 22:39:38.115147 203173 logs.go:123] Gathering logs for dmesg ...
I0307 22:39:38.115183 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0307 22:39:38.133346 203173 logs.go:123] Gathering logs for coredns [a105c02644c9c901090c4c9792a32b0396cee09395513751eeb1be7fbf4b8477] ...
I0307 22:39:38.133379 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a105c02644c9c901090c4c9792a32b0396cee09395513751eeb1be7fbf4b8477"
I0307 22:39:38.172233 203173 logs.go:123] Gathering logs for kube-scheduler [2ca89421ca012456f503b4b92ac92a69bf6b0042461af4e2e3140e7adb8b27dc] ...
I0307 22:39:38.172264 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2ca89421ca012456f503b4b92ac92a69bf6b0042461af4e2e3140e7adb8b27dc"
I0307 22:39:38.215015 203173 logs.go:123] Gathering logs for kube-proxy [f1df99d1a705a4556e4be13c16d400b99149438c96bfe6da863b8b041983b036] ...
I0307 22:39:38.215047 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f1df99d1a705a4556e4be13c16d400b99149438c96bfe6da863b8b041983b036"
I0307 22:39:38.253945 203173 logs.go:123] Gathering logs for kindnet [e9768721745ab392d0ad14d4055c5cf01cc780491a01953b4b45bf77d2d3b062] ...
I0307 22:39:38.253974 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e9768721745ab392d0ad14d4055c5cf01cc780491a01953b4b45bf77d2d3b062"
I0307 22:39:38.298086 203173 logs.go:123] Gathering logs for storage-provisioner [426c41631cb95479682cbd7b19483427f710b2f7932b9e6d2bc0367710c2ca1d] ...
I0307 22:39:38.298117 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 426c41631cb95479682cbd7b19483427f710b2f7932b9e6d2bc0367710c2ca1d"
I0307 22:39:38.343935 203173 logs.go:123] Gathering logs for coredns [413452dbe13bfb277303d92484791aa53ae9a198a089364135d2347bf8475623] ...
I0307 22:39:38.343969 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 413452dbe13bfb277303d92484791aa53ae9a198a089364135d2347bf8475623"
I0307 22:39:38.382349 203173 logs.go:123] Gathering logs for kube-proxy [7998095a37dd2896f96215e8ab5d29ae495d3dc1a00b119506f8ace55156b07a] ...
I0307 22:39:38.382378 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7998095a37dd2896f96215e8ab5d29ae495d3dc1a00b119506f8ace55156b07a"
I0307 22:39:38.427494 203173 logs.go:123] Gathering logs for kube-controller-manager [bd7a60d8d4f26067debaaf5b2c23fe94dcfed76118b17104051bc8c755b35ce1] ...
I0307 22:39:38.427570 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bd7a60d8d4f26067debaaf5b2c23fe94dcfed76118b17104051bc8c755b35ce1"
I0307 22:39:38.491465 203173 logs.go:123] Gathering logs for storage-provisioner [f98ff695720f5ebea06fa188196a8a6393c29dfd0211d4a0ec784c54cbb9f906] ...
I0307 22:39:38.491536 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f98ff695720f5ebea06fa188196a8a6393c29dfd0211d4a0ec784c54cbb9f906"
I0307 22:39:38.532531 203173 logs.go:123] Gathering logs for kubernetes-dashboard [778e16c451c2e6a7fecd1d1b5d37778e92f50fd757af7d8812222cfa025fdc86] ...
I0307 22:39:38.532564 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 778e16c451c2e6a7fecd1d1b5d37778e92f50fd757af7d8812222cfa025fdc86"
I0307 22:39:38.577829 203173 logs.go:123] Gathering logs for containerd ...
I0307 22:39:38.577862 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0307 22:39:38.638480 203173 logs.go:123] Gathering logs for container status ...
I0307 22:39:38.638517 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0307 22:39:38.693638 203173 logs.go:123] Gathering logs for kube-apiserver [8b2ed0287cc5bbf594cda29d926ae828c7d6d12ad490285c6e855c8824388d29] ...
I0307 22:39:38.693667 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8b2ed0287cc5bbf594cda29d926ae828c7d6d12ad490285c6e855c8824388d29"
I0307 22:39:38.764704 203173 out.go:304] Setting ErrFile to fd 2...
I0307 22:39:38.764734 203173 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0307 22:39:38.764785 203173 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0307 22:39:38.764795 203173 out.go:239] Mar 07 22:39:03 old-k8s-version-497253 kubelet[660]: E0307 22:39:03.914427 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 07 22:39:03 old-k8s-version-497253 kubelet[660]: E0307 22:39:03.914427 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:38.764803 203173 out.go:239] Mar 07 22:39:15 old-k8s-version-497253 kubelet[660]: E0307 22:39:15.913973 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
Mar 07 22:39:15 old-k8s-version-497253 kubelet[660]: E0307 22:39:15.913973 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:38.764817 203173 out.go:239] Mar 07 22:39:16 old-k8s-version-497253 kubelet[660]: E0307 22:39:16.918241 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 07 22:39:16 old-k8s-version-497253 kubelet[660]: E0307 22:39:16.918241 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:38.764824 203173 out.go:239] Mar 07 22:39:26 old-k8s-version-497253 kubelet[660]: E0307 22:39:26.914096 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
Mar 07 22:39:26 old-k8s-version-497253 kubelet[660]: E0307 22:39:26.914096 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:38.764836 203173 out.go:239] Mar 07 22:39:29 old-k8s-version-497253 kubelet[660]: E0307 22:39:29.914280 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 07 22:39:29 old-k8s-version-497253 kubelet[660]: E0307 22:39:29.914280 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0307 22:39:38.764843 203173 out.go:304] Setting ErrFile to fd 2...
I0307 22:39:38.764849 203173 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 22:39:48.764963 203173 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0307 22:39:48.777388 203173 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0307 22:39:48.794117 203173 out.go:177]
W0307 22:39:48.797346 203173 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0307 22:39:48.797390 203173 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0307 22:39:48.797410 203173 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0307 22:39:48.797416 203173 out.go:239] *
*
W0307 22:39:48.798329 203173 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0307 22:39:48.800764 203173 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-497253 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-497253
helpers_test.go:235: (dbg) docker inspect old-k8s-version-497253:
-- stdout --
[
{
"Id": "5da5b5e5895e5a152492eb1a928e7582d7738546ef3f1f494fc581b79848d274",
"Created": "2024-03-07T22:30:54.402543856Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 203405,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-03-07T22:33:38.227072028Z",
"FinishedAt": "2024-03-07T22:33:36.802787321Z"
},
"Image": "sha256:4a9b65157dd7fb2ddb7cb7afe975b3dc288e9877c60d13613a69dd41a70e2e4e",
"ResolvConfPath": "/var/lib/docker/containers/5da5b5e5895e5a152492eb1a928e7582d7738546ef3f1f494fc581b79848d274/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/5da5b5e5895e5a152492eb1a928e7582d7738546ef3f1f494fc581b79848d274/hostname",
"HostsPath": "/var/lib/docker/containers/5da5b5e5895e5a152492eb1a928e7582d7738546ef3f1f494fc581b79848d274/hosts",
"LogPath": "/var/lib/docker/containers/5da5b5e5895e5a152492eb1a928e7582d7738546ef3f1f494fc581b79848d274/5da5b5e5895e5a152492eb1a928e7582d7738546ef3f1f494fc581b79848d274-json.log",
"Name": "/old-k8s-version-497253",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-497253:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-497253",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/3d80f0bc4a114d205a8392711721096edd71a9ea3631b4a85972fae12eda5537-init/diff:/var/lib/docker/overlay2/6822645c415ab3e3451f0dc6746bf9aea38c91b1070d7030c1ba88a1ef7f69e0/diff",
"MergedDir": "/var/lib/docker/overlay2/3d80f0bc4a114d205a8392711721096edd71a9ea3631b4a85972fae12eda5537/merged",
"UpperDir": "/var/lib/docker/overlay2/3d80f0bc4a114d205a8392711721096edd71a9ea3631b4a85972fae12eda5537/diff",
"WorkDir": "/var/lib/docker/overlay2/3d80f0bc4a114d205a8392711721096edd71a9ea3631b4a85972fae12eda5537/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-497253",
"Source": "/var/lib/docker/volumes/old-k8s-version-497253/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-497253",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-497253",
"name.minikube.sigs.k8s.io": "old-k8s-version-497253",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "8aab7a20fbb3828faae347e3a6fd0a027bf00f7d0b071089583e4156f4e1f8b8",
"SandboxKey": "/var/run/docker/netns/8aab7a20fbb3",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33067"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33066"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33063"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33065"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33064"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-497253": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": [
"5da5b5e5895e",
"old-k8s-version-497253"
],
"MacAddress": "02:42:c0:a8:4c:02",
"NetworkID": "c4f54b074df5ed656acbbc9c635d1f131cdf40a8a7fc4f5257a369f345bcfbbc",
"EndpointID": "f7949d76ead884877a69d20b356eced6aa0ce76fbbbaba509c9bed393b82f878",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DriverOpts": null,
"DNSNames": [
"old-k8s-version-497253",
"5da5b5e5895e"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-497253 -n old-k8s-version-497253
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-497253 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-497253 logs -n 25: (2.609039628s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| delete | -p force-systemd-flag-026071 | force-systemd-flag-026071 | jenkins | v1.32.0 | 07 Mar 24 22:29 UTC | 07 Mar 24 22:29 UTC |
| start | -p cert-expiration-193013 | cert-expiration-193013 | jenkins | v1.32.0 | 07 Mar 24 22:29 UTC | 07 Mar 24 22:30 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-env-344179 | force-systemd-env-344179 | jenkins | v1.32.0 | 07 Mar 24 22:30 UTC | 07 Mar 24 22:30 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-env-344179 | force-systemd-env-344179 | jenkins | v1.32.0 | 07 Mar 24 22:30 UTC | 07 Mar 24 22:30 UTC |
| start | -p cert-options-781550 | cert-options-781550 | jenkins | v1.32.0 | 07 Mar 24 22:30 UTC | 07 Mar 24 22:30 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-781550 ssh | cert-options-781550 | jenkins | v1.32.0 | 07 Mar 24 22:30 UTC | 07 Mar 24 22:30 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-781550 -- sudo | cert-options-781550 | jenkins | v1.32.0 | 07 Mar 24 22:30 UTC | 07 Mar 24 22:30 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-781550 | cert-options-781550 | jenkins | v1.32.0 | 07 Mar 24 22:30 UTC | 07 Mar 24 22:30 UTC |
| start | -p old-k8s-version-497253 | old-k8s-version-497253 | jenkins | v1.32.0 | 07 Mar 24 22:30 UTC | 07 Mar 24 22:33 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-193013 | cert-expiration-193013 | jenkins | v1.32.0 | 07 Mar 24 22:33 UTC | 07 Mar 24 22:33 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-193013 | cert-expiration-193013 | jenkins | v1.32.0 | 07 Mar 24 22:33 UTC | 07 Mar 24 22:33 UTC |
| addons | enable metrics-server -p old-k8s-version-497253 | old-k8s-version-497253 | jenkins | v1.32.0 | 07 Mar 24 22:33 UTC | 07 Mar 24 22:33 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| start | -p no-preload-767597 | no-preload-767597 | jenkins | v1.32.0 | 07 Mar 24 22:33 UTC | 07 Mar 24 22:34 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| stop | -p old-k8s-version-497253 | old-k8s-version-497253 | jenkins | v1.32.0 | 07 Mar 24 22:33 UTC | 07 Mar 24 22:33 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-497253 | old-k8s-version-497253 | jenkins | v1.32.0 | 07 Mar 24 22:33 UTC | 07 Mar 24 22:33 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-497253 | old-k8s-version-497253 | jenkins | v1.32.0 | 07 Mar 24 22:33 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-767597 | no-preload-767597 | jenkins | v1.32.0 | 07 Mar 24 22:34 UTC | 07 Mar 24 22:34 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-767597 | no-preload-767597 | jenkins | v1.32.0 | 07 Mar 24 22:34 UTC | 07 Mar 24 22:35 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-767597 | no-preload-767597 | jenkins | v1.32.0 | 07 Mar 24 22:35 UTC | 07 Mar 24 22:35 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-767597 | no-preload-767597 | jenkins | v1.32.0 | 07 Mar 24 22:35 UTC | 07 Mar 24 22:39 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| image | no-preload-767597 image list | no-preload-767597 | jenkins | v1.32.0 | 07 Mar 24 22:39 UTC | 07 Mar 24 22:39 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-767597 | no-preload-767597 | jenkins | v1.32.0 | 07 Mar 24 22:39 UTC | 07 Mar 24 22:39 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-767597 | no-preload-767597 | jenkins | v1.32.0 | 07 Mar 24 22:39 UTC | 07 Mar 24 22:39 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-767597 | no-preload-767597 | jenkins | v1.32.0 | 07 Mar 24 22:39 UTC | 07 Mar 24 22:39 UTC |
| delete | -p no-preload-767597 | no-preload-767597 | jenkins | v1.32.0 | 07 Mar 24 22:39 UTC | |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/03/07 22:35:05
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.22.0 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0307 22:35:05.539670 208512 out.go:291] Setting OutFile to fd 1 ...
I0307 22:35:05.539864 208512 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 22:35:05.539892 208512 out.go:304] Setting ErrFile to fd 2...
I0307 22:35:05.539915 208512 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 22:35:05.540167 208512 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18320-2408/.minikube/bin
I0307 22:35:05.540655 208512 out.go:298] Setting JSON to false
I0307 22:35:05.541749 208512 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":4649,"bootTime":1709846257,"procs":219,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1055-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0307 22:35:05.541859 208512 start.go:139] virtualization:
I0307 22:35:05.544310 208512 out.go:177] * [no-preload-767597] minikube v1.32.0 on Ubuntu 20.04 (arm64)
I0307 22:35:05.546633 208512 out.go:177] - MINIKUBE_LOCATION=18320
I0307 22:35:05.546729 208512 notify.go:220] Checking for updates...
I0307 22:35:05.551337 208512 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0307 22:35:05.553610 208512 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18320-2408/kubeconfig
I0307 22:35:05.555557 208512 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18320-2408/.minikube
I0307 22:35:05.557498 208512 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0307 22:35:05.560813 208512 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0307 22:35:05.563424 208512 config.go:182] Loaded profile config "no-preload-767597": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.29.0-rc.2
I0307 22:35:05.564012 208512 driver.go:392] Setting default libvirt URI to qemu:///system
I0307 22:35:05.586091 208512 docker.go:122] docker version: linux-25.0.4:Docker Engine - Community
I0307 22:35:05.586208 208512 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0307 22:35:05.656062 208512 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:38 OomKillDisable:true NGoroutines:56 SystemTime:2024-03-07 22:35:05.646333607 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0307 22:35:05.656173 208512 docker.go:295] overlay module found
I0307 22:35:05.659498 208512 out.go:177] * Using the docker driver based on existing profile
I0307 22:35:05.661127 208512 start.go:297] selected driver: docker
I0307 22:35:05.661144 208512 start.go:901] validating driver "docker" against &{Name:no-preload-767597 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-767597 Namespace:default APIServerHAVIP: APISer
verName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:f
alse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0307 22:35:05.661271 208512 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0307 22:35:05.661909 208512 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0307 22:35:05.720114 208512 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:38 OomKillDisable:true NGoroutines:56 SystemTime:2024-03-07 22:35:05.710233866 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0307 22:35:05.720511 208512 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0307 22:35:05.720541 208512 cni.go:84] Creating CNI manager for ""
I0307 22:35:05.720556 208512 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0307 22:35:05.720610 208512 start.go:340] cluster config:
{Name:no-preload-767597 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-767597 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Con
tainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:d
ocker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0307 22:35:05.723958 208512 out.go:177] * Starting "no-preload-767597" primary control-plane node in "no-preload-767597" cluster
I0307 22:35:05.725666 208512 cache.go:121] Beginning downloading kic base image for docker with containerd
I0307 22:35:05.727457 208512 out.go:177] * Pulling base image v0.0.42-1708944392-18244 ...
I0307 22:35:05.729212 208512 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime containerd
I0307 22:35:05.729288 208512 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon
I0307 22:35:05.729362 208512 profile.go:142] Saving config to /home/jenkins/minikube-integration/18320-2408/.minikube/profiles/no-preload-767597/config.json ...
I0307 22:35:05.729695 208512 cache.go:107] acquiring lock: {Name:mka6c3327e8416acbc1ddfc53ded2e1c0e027796 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0307 22:35:05.729785 208512 cache.go:115] /home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
I0307 22:35:05.729803 208512 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 108.134µs
I0307 22:35:05.729812 208512 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
I0307 22:35:05.729824 208512 cache.go:107] acquiring lock: {Name:mkc926160654c366d4e22891ccf53de9d40179db Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0307 22:35:05.729866 208512 cache.go:115] /home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 exists
I0307 22:35:05.729876 208512 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.29.0-rc.2" -> "/home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2" took 53.793µs
I0307 22:35:05.729883 208512 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.29.0-rc.2 -> /home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 succeeded
I0307 22:35:05.729894 208512 cache.go:107] acquiring lock: {Name:mk74108e32ca4ff12332d8ace0a83c3d5ab29616 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0307 22:35:05.729925 208512 cache.go:115] /home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 exists
I0307 22:35:05.729930 208512 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.29.0-rc.2" -> "/home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2" took 39.368µs
I0307 22:35:05.729938 208512 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.29.0-rc.2 -> /home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 succeeded
I0307 22:35:05.729948 208512 cache.go:107] acquiring lock: {Name:mke8b59caa1366e1b9f61a022166908cffd51832 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0307 22:35:05.729974 208512 cache.go:115] /home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 exists
I0307 22:35:05.729979 208512 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.29.0-rc.2" -> "/home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2" took 32.041µs
I0307 22:35:05.729985 208512 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.29.0-rc.2 -> /home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 succeeded
I0307 22:35:05.729970 208512 cache.go:107] acquiring lock: {Name:mkbbedbc94139b78cda59fb462df0ab035a59e23 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0307 22:35:05.729997 208512 cache.go:107] acquiring lock: {Name:mk9c211a81a668d6ffad9455ca24af36bab0332d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0307 22:35:05.730037 208512 cache.go:115] /home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9 exists
I0307 22:35:05.730045 208512 cache.go:96] cache image "registry.k8s.io/pause:3.9" -> "/home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9" took 81.534µs
I0307 22:35:05.730049 208512 cache.go:115] /home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.10-0 exists
I0307 22:35:05.730052 208512 cache.go:80] save to tar file registry.k8s.io/pause:3.9 -> /home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9 succeeded
I0307 22:35:05.730056 208512 cache.go:96] cache image "registry.k8s.io/etcd:3.5.10-0" -> "/home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.10-0" took 60.086µs
I0307 22:35:05.730063 208512 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.10-0 -> /home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.10-0 succeeded
I0307 22:35:05.730064 208512 cache.go:107] acquiring lock: {Name:mk6973bd0b593c335863a55401fb275d55bac78d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0307 22:35:05.730073 208512 cache.go:107] acquiring lock: {Name:mk94425fd57864a38c1451110d6dd403340ba31f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0307 22:35:05.730092 208512 cache.go:115] /home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 exists
I0307 22:35:05.730098 208512 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.29.0-rc.2" -> "/home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.29.0-rc.2" took 35.955µs
I0307 22:35:05.730104 208512 cache.go:115] /home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 exists
I0307 22:35:05.730110 208512 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1" took 38.909µs
I0307 22:35:05.730118 208512 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
I0307 22:35:05.730104 208512 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.29.0-rc.2 -> /home/jenkins/minikube-integration/18320-2408/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 succeeded
I0307 22:35:05.730132 208512 cache.go:87] Successfully saved all images to host disk.
I0307 22:35:05.750647 208512 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon, skipping pull
I0307 22:35:05.750688 208512 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 exists in daemon, skipping load
I0307 22:35:05.750703 208512 cache.go:194] Successfully downloaded all kic artifacts
I0307 22:35:05.750729 208512 start.go:360] acquireMachinesLock for no-preload-767597: {Name:mk1b21576e73b82e91984738a4b5e9ee433ab7ee Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0307 22:35:05.750790 208512 start.go:364] duration metric: took 44.726µs to acquireMachinesLock for "no-preload-767597"
I0307 22:35:05.750810 208512 start.go:96] Skipping create...Using existing machine configuration
I0307 22:35:05.750816 208512 fix.go:54] fixHost starting:
I0307 22:35:05.751078 208512 cli_runner.go:164] Run: docker container inspect no-preload-767597 --format={{.State.Status}}
I0307 22:35:05.769629 208512 fix.go:112] recreateIfNeeded on no-preload-767597: state=Stopped err=<nil>
W0307 22:35:05.769659 208512 fix.go:138] unexpected machine state, will restart: <nil>
I0307 22:35:05.772086 208512 out.go:177] * Restarting existing docker container for "no-preload-767597" ...
I0307 22:35:03.749214 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:05.750941 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:05.773718 208512 cli_runner.go:164] Run: docker start no-preload-767597
I0307 22:35:06.089985 208512 cli_runner.go:164] Run: docker container inspect no-preload-767597 --format={{.State.Status}}
I0307 22:35:06.114482 208512 kic.go:430] container "no-preload-767597" state is running.
I0307 22:35:06.115357 208512 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-767597
I0307 22:35:06.143354 208512 profile.go:142] Saving config to /home/jenkins/minikube-integration/18320-2408/.minikube/profiles/no-preload-767597/config.json ...
I0307 22:35:06.143620 208512 machine.go:94] provisionDockerMachine start ...
I0307 22:35:06.143696 208512 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-767597
I0307 22:35:06.168346 208512 main.go:141] libmachine: Using SSH client type: native
I0307 22:35:06.168646 208512 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1c40] 0x3e44a0 <nil> [] 0s} 127.0.0.1 33072 <nil> <nil>}
I0307 22:35:06.168661 208512 main.go:141] libmachine: About to run SSH command:
hostname
I0307 22:35:06.169319 208512 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:47432->127.0.0.1:33072: read: connection reset by peer
I0307 22:35:09.308053 208512 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-767597
I0307 22:35:09.308079 208512 ubuntu.go:169] provisioning hostname "no-preload-767597"
I0307 22:35:09.308143 208512 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-767597
I0307 22:35:09.323243 208512 main.go:141] libmachine: Using SSH client type: native
I0307 22:35:09.323507 208512 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1c40] 0x3e44a0 <nil> [] 0s} 127.0.0.1 33072 <nil> <nil>}
I0307 22:35:09.323523 208512 main.go:141] libmachine: About to run SSH command:
sudo hostname no-preload-767597 && echo "no-preload-767597" | sudo tee /etc/hostname
I0307 22:35:09.468491 208512 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-767597
I0307 22:35:09.468584 208512 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-767597
I0307 22:35:09.486013 208512 main.go:141] libmachine: Using SSH client type: native
I0307 22:35:09.486262 208512 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1c40] 0x3e44a0 <nil> [] 0s} 127.0.0.1 33072 <nil> <nil>}
I0307 22:35:09.486285 208512 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-767597' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-767597/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-767597' | sudo tee -a /etc/hosts;
fi
fi
I0307 22:35:09.616385 208512 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0307 22:35:09.616411 208512 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18320-2408/.minikube CaCertPath:/home/jenkins/minikube-integration/18320-2408/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18320-2408/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18320-2408/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18320-2408/.minikube}
I0307 22:35:09.616451 208512 ubuntu.go:177] setting up certificates
I0307 22:35:09.616462 208512 provision.go:84] configureAuth start
I0307 22:35:09.616526 208512 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-767597
I0307 22:35:09.639008 208512 provision.go:143] copyHostCerts
I0307 22:35:09.639078 208512 exec_runner.go:144] found /home/jenkins/minikube-integration/18320-2408/.minikube/ca.pem, removing ...
I0307 22:35:09.639093 208512 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18320-2408/.minikube/ca.pem
I0307 22:35:09.639167 208512 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18320-2408/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18320-2408/.minikube/ca.pem (1078 bytes)
I0307 22:35:09.639263 208512 exec_runner.go:144] found /home/jenkins/minikube-integration/18320-2408/.minikube/cert.pem, removing ...
I0307 22:35:09.639268 208512 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18320-2408/.minikube/cert.pem
I0307 22:35:09.639293 208512 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18320-2408/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18320-2408/.minikube/cert.pem (1123 bytes)
I0307 22:35:09.639349 208512 exec_runner.go:144] found /home/jenkins/minikube-integration/18320-2408/.minikube/key.pem, removing ...
I0307 22:35:09.639354 208512 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18320-2408/.minikube/key.pem
I0307 22:35:09.639383 208512 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18320-2408/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18320-2408/.minikube/key.pem (1675 bytes)
I0307 22:35:09.639432 208512 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18320-2408/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18320-2408/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18320-2408/.minikube/certs/ca-key.pem org=jenkins.no-preload-767597 san=[127.0.0.1 192.168.85.2 localhost minikube no-preload-767597]
I0307 22:35:10.676195 208512 provision.go:177] copyRemoteCerts
I0307 22:35:10.676297 208512 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0307 22:35:10.676344 208512 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-767597
I0307 22:35:10.694615 208512 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33072 SSHKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/machines/no-preload-767597/id_rsa Username:docker}
I0307 22:35:10.789174 208512 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0307 22:35:10.813943 208512 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0307 22:35:10.839582 208512 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0307 22:35:10.866601 208512 provision.go:87] duration metric: took 1.250117325s to configureAuth
I0307 22:35:10.866628 208512 ubuntu.go:193] setting minikube options for container-runtime
I0307 22:35:10.866817 208512 config.go:182] Loaded profile config "no-preload-767597": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.29.0-rc.2
I0307 22:35:10.866823 208512 machine.go:97] duration metric: took 4.72318698s to provisionDockerMachine
I0307 22:35:10.866831 208512 start.go:293] postStartSetup for "no-preload-767597" (driver="docker")
I0307 22:35:10.866842 208512 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0307 22:35:10.866893 208512 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0307 22:35:10.866930 208512 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-767597
I0307 22:35:10.884814 208512 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33072 SSHKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/machines/no-preload-767597/id_rsa Username:docker}
I0307 22:35:10.977196 208512 ssh_runner.go:195] Run: cat /etc/os-release
I0307 22:35:10.980159 208512 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0307 22:35:10.980194 208512 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0307 22:35:10.980226 208512 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0307 22:35:10.980235 208512 info.go:137] Remote host: Ubuntu 22.04.3 LTS
I0307 22:35:10.980245 208512 filesync.go:126] Scanning /home/jenkins/minikube-integration/18320-2408/.minikube/addons for local assets ...
I0307 22:35:10.980339 208512 filesync.go:126] Scanning /home/jenkins/minikube-integration/18320-2408/.minikube/files for local assets ...
I0307 22:35:10.980443 208512 filesync.go:149] local asset: /home/jenkins/minikube-integration/18320-2408/.minikube/files/etc/ssl/certs/77642.pem -> 77642.pem in /etc/ssl/certs
I0307 22:35:10.980587 208512 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0307 22:35:10.989109 208512 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/files/etc/ssl/certs/77642.pem --> /etc/ssl/certs/77642.pem (1708 bytes)
I0307 22:35:11.019358 208512 start.go:296] duration metric: took 152.512247ms for postStartSetup
I0307 22:35:11.019444 208512 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0307 22:35:11.019495 208512 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-767597
I0307 22:35:11.034983 208512 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33072 SSHKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/machines/no-preload-767597/id_rsa Username:docker}
I0307 22:35:11.125693 208512 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0307 22:35:11.130283 208512 fix.go:56] duration metric: took 5.379459505s for fixHost
I0307 22:35:11.130308 208512 start.go:83] releasing machines lock for "no-preload-767597", held for 5.379509145s
I0307 22:35:11.130380 208512 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-767597
I0307 22:35:11.145816 208512 ssh_runner.go:195] Run: cat /version.json
I0307 22:35:11.145872 208512 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-767597
I0307 22:35:11.146114 208512 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0307 22:35:11.146155 208512 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-767597
I0307 22:35:11.166469 208512 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33072 SSHKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/machines/no-preload-767597/id_rsa Username:docker}
I0307 22:35:11.167791 208512 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33072 SSHKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/machines/no-preload-767597/id_rsa Username:docker}
I0307 22:35:11.260106 208512 ssh_runner.go:195] Run: systemctl --version
I0307 22:35:11.384890 208512 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0307 22:35:11.389495 208512 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0307 22:35:11.409586 208512 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0307 22:35:11.409693 208512 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0307 22:35:11.418690 208512 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0307 22:35:11.418712 208512 start.go:494] detecting cgroup driver to use...
I0307 22:35:11.418743 208512 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0307 22:35:11.418791 208512 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0307 22:35:11.433857 208512 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0307 22:35:11.446795 208512 docker.go:217] disabling cri-docker service (if available) ...
I0307 22:35:11.446872 208512 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0307 22:35:11.461120 208512 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0307 22:35:11.472245 208512 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0307 22:35:11.564641 208512 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0307 22:35:11.657629 208512 docker.go:233] disabling docker service ...
I0307 22:35:11.657720 208512 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0307 22:35:11.670160 208512 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0307 22:35:11.681746 208512 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0307 22:35:11.774575 208512 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0307 22:35:11.862709 208512 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0307 22:35:11.875352 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0307 22:35:11.894457 208512 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0307 22:35:11.905427 208512 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0307 22:35:11.915375 208512 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0307 22:35:11.915500 208512 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0307 22:35:11.925501 208512 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0307 22:35:11.935706 208512 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0307 22:35:11.945534 208512 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0307 22:35:11.955134 208512 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0307 22:35:11.965268 208512 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0307 22:35:11.975859 208512 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0307 22:35:11.984932 208512 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0307 22:35:11.993636 208512 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0307 22:35:12.094898 208512 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0307 22:35:12.253778 208512 start.go:541] Will wait 60s for socket path /run/containerd/containerd.sock
I0307 22:35:12.253868 208512 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0307 22:35:12.259413 208512 start.go:562] Will wait 60s for crictl version
I0307 22:35:12.259506 208512 ssh_runner.go:195] Run: which crictl
I0307 22:35:12.263301 208512 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0307 22:35:12.308581 208512 start.go:578] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.6.28
RuntimeApiVersion: v1
I0307 22:35:12.308669 208512 ssh_runner.go:195] Run: containerd --version
I0307 22:35:12.333234 208512 ssh_runner.go:195] Run: containerd --version
I0307 22:35:12.367906 208512 out.go:177] * Preparing Kubernetes v1.29.0-rc.2 on containerd 1.6.28 ...
I0307 22:35:08.249026 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:10.251021 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:12.369952 208512 cli_runner.go:164] Run: docker network inspect no-preload-767597 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0307 22:35:12.385903 208512 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0307 22:35:12.389834 208512 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0307 22:35:12.402296 208512 kubeadm.go:877] updating cluster {Name:no-preload-767597 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-767597 Namespace:default APIServerHAVIP: APIServerName:minikubeC
A APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:
/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0307 22:35:12.402429 208512 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime containerd
I0307 22:35:12.402474 208512 ssh_runner.go:195] Run: sudo crictl images --output json
I0307 22:35:12.438131 208512 containerd.go:612] all images are preloaded for containerd runtime.
I0307 22:35:12.438155 208512 cache_images.go:84] Images are preloaded, skipping loading
I0307 22:35:12.438170 208512 kubeadm.go:928] updating node { 192.168.85.2 8443 v1.29.0-rc.2 containerd true true} ...
I0307 22:35:12.438275 208512 kubeadm.go:940] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.29.0-rc.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=no-preload-767597 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-767597 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0307 22:35:12.438339 208512 ssh_runner.go:195] Run: sudo crictl info
I0307 22:35:12.476805 208512 cni.go:84] Creating CNI manager for ""
I0307 22:35:12.476826 208512 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0307 22:35:12.476836 208512 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0307 22:35:12.476858 208512 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.29.0-rc.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-767597 NodeName:no-preload-767597 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0307 22:35:12.476995 208512 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "no-preload-767597"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.29.0-rc.2
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0307 22:35:12.477070 208512 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.29.0-rc.2
I0307 22:35:12.486347 208512 binaries.go:44] Found k8s binaries, skipping transfer
I0307 22:35:12.486418 208512 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0307 22:35:12.494910 208512 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (326 bytes)
I0307 22:35:12.512714 208512 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)
I0307 22:35:12.532829 208512 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2176 bytes)
I0307 22:35:12.552181 208512 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0307 22:35:12.555719 208512 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0307 22:35:12.566841 208512 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0307 22:35:12.666052 208512 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0307 22:35:12.684757 208512 certs.go:68] Setting up /home/jenkins/minikube-integration/18320-2408/.minikube/profiles/no-preload-767597 for IP: 192.168.85.2
I0307 22:35:12.684788 208512 certs.go:194] generating shared ca certs ...
I0307 22:35:12.684805 208512 certs.go:226] acquiring lock for ca certs: {Name:mk7f303c61c8508a802bee4114a394243ccd109f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0307 22:35:12.684937 208512 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18320-2408/.minikube/ca.key
I0307 22:35:12.684993 208512 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18320-2408/.minikube/proxy-client-ca.key
I0307 22:35:12.685005 208512 certs.go:256] generating profile certs ...
I0307 22:35:12.685087 208512 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18320-2408/.minikube/profiles/no-preload-767597/client.key
I0307 22:35:12.685175 208512 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/18320-2408/.minikube/profiles/no-preload-767597/apiserver.key.8eb0adea
I0307 22:35:12.685228 208512 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18320-2408/.minikube/profiles/no-preload-767597/proxy-client.key
I0307 22:35:12.685369 208512 certs.go:484] found cert: /home/jenkins/minikube-integration/18320-2408/.minikube/certs/7764.pem (1338 bytes)
W0307 22:35:12.685404 208512 certs.go:480] ignoring /home/jenkins/minikube-integration/18320-2408/.minikube/certs/7764_empty.pem, impossibly tiny 0 bytes
I0307 22:35:12.685416 208512 certs.go:484] found cert: /home/jenkins/minikube-integration/18320-2408/.minikube/certs/ca-key.pem (1679 bytes)
I0307 22:35:12.685444 208512 certs.go:484] found cert: /home/jenkins/minikube-integration/18320-2408/.minikube/certs/ca.pem (1078 bytes)
I0307 22:35:12.685478 208512 certs.go:484] found cert: /home/jenkins/minikube-integration/18320-2408/.minikube/certs/cert.pem (1123 bytes)
I0307 22:35:12.685503 208512 certs.go:484] found cert: /home/jenkins/minikube-integration/18320-2408/.minikube/certs/key.pem (1675 bytes)
I0307 22:35:12.685549 208512 certs.go:484] found cert: /home/jenkins/minikube-integration/18320-2408/.minikube/files/etc/ssl/certs/77642.pem (1708 bytes)
I0307 22:35:12.686235 208512 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0307 22:35:12.713409 208512 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0307 22:35:12.738625 208512 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0307 22:35:12.765287 208512 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0307 22:35:12.803678 208512 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/profiles/no-preload-767597/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0307 22:35:12.830316 208512 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/profiles/no-preload-767597/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0307 22:35:12.859080 208512 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/profiles/no-preload-767597/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0307 22:35:12.887026 208512 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/profiles/no-preload-767597/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0307 22:35:12.913198 208512 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/files/etc/ssl/certs/77642.pem --> /usr/share/ca-certificates/77642.pem (1708 bytes)
I0307 22:35:12.957260 208512 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0307 22:35:12.999129 208512 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18320-2408/.minikube/certs/7764.pem --> /usr/share/ca-certificates/7764.pem (1338 bytes)
I0307 22:35:13.029895 208512 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0307 22:35:13.050062 208512 ssh_runner.go:195] Run: openssl version
I0307 22:35:13.058403 208512 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/77642.pem && ln -fs /usr/share/ca-certificates/77642.pem /etc/ssl/certs/77642.pem"
I0307 22:35:13.069362 208512 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/77642.pem
I0307 22:35:13.072879 208512 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Mar 7 21:53 /usr/share/ca-certificates/77642.pem
I0307 22:35:13.072981 208512 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/77642.pem
I0307 22:35:13.079923 208512 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/77642.pem /etc/ssl/certs/3ec20f2e.0"
I0307 22:35:13.088691 208512 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0307 22:35:13.097976 208512 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0307 22:35:13.101637 208512 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 7 21:47 /usr/share/ca-certificates/minikubeCA.pem
I0307 22:35:13.101699 208512 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0307 22:35:13.108560 208512 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0307 22:35:13.117467 208512 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7764.pem && ln -fs /usr/share/ca-certificates/7764.pem /etc/ssl/certs/7764.pem"
I0307 22:35:13.127102 208512 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7764.pem
I0307 22:35:13.130554 208512 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Mar 7 21:53 /usr/share/ca-certificates/7764.pem
I0307 22:35:13.130621 208512 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7764.pem
I0307 22:35:13.137968 208512 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/7764.pem /etc/ssl/certs/51391683.0"
I0307 22:35:13.147301 208512 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0307 22:35:13.151104 208512 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0307 22:35:13.158301 208512 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0307 22:35:13.165343 208512 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0307 22:35:13.173370 208512 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0307 22:35:13.180671 208512 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0307 22:35:13.187377 208512 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0307 22:35:13.194422 208512 kubeadm.go:391] StartCluster: {Name:no-preload-767597 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-767597 Namespace:default APIServerHAVIP: APIServerName:minikubeCA A
PIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/ho
me/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0307 22:35:13.194528 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0307 22:35:13.194610 208512 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0307 22:35:13.233246 208512 cri.go:89] found id: "cd25d5f2cd96fffd3dc549470243d20ea7e47ef4dcd423227a4a52724f521183"
I0307 22:35:13.233268 208512 cri.go:89] found id: "988c7824310b34904cc0fcc89dceab6a97539faa8b8f508cbcbbdf112c8521fb"
I0307 22:35:13.233274 208512 cri.go:89] found id: "8f5bfb546acf680bf07066e7e21f63d7aff174c71c050e14a9bd642cdffe16f7"
I0307 22:35:13.233277 208512 cri.go:89] found id: "775c4272397dc700a1daf97c4e663e7fc3f71729356cee17bd4235ddf6daa2a3"
I0307 22:35:13.233282 208512 cri.go:89] found id: "61d3947cf55d680139b701ec61051f9ada8b04b18e981f05adeac9a4a7a67d89"
I0307 22:35:13.233287 208512 cri.go:89] found id: "a52fdbe185cf6604953f1db9bf33ddda100e7929d29ddd019abb2c4f628ccf8a"
I0307 22:35:13.233290 208512 cri.go:89] found id: "da7081019e6f16e832848ada7b2e006667f931fc538edab6b1ebd551fa208cbe"
I0307 22:35:13.233293 208512 cri.go:89] found id: "3ad41b9769064eab5e8003ea9de4b5b9f58af6a4d81413a5083b9b5abc308170"
I0307 22:35:13.233324 208512 cri.go:89] found id: ""
I0307 22:35:13.233396 208512 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0307 22:35:13.249198 208512 cri.go:116] JSON = null
W0307 22:35:13.249243 208512 kubeadm.go:398] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0307 22:35:13.249302 208512 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0307 22:35:13.259242 208512 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0307 22:35:13.259312 208512 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0307 22:35:13.259332 208512 kubeadm.go:587] restartPrimaryControlPlane start ...
I0307 22:35:13.259398 208512 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0307 22:35:13.268262 208512 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0307 22:35:13.268928 208512 kubeconfig.go:47] verify endpoint returned: get endpoint: "no-preload-767597" does not appear in /home/jenkins/minikube-integration/18320-2408/kubeconfig
I0307 22:35:13.269189 208512 kubeconfig.go:62] /home/jenkins/minikube-integration/18320-2408/kubeconfig needs updating (will repair): [kubeconfig missing "no-preload-767597" cluster setting kubeconfig missing "no-preload-767597" context setting]
I0307 22:35:13.269661 208512 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18320-2408/kubeconfig: {Name:mkc7f9d8cfd4e14e150b8fc8a3019ac099191c36 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0307 22:35:13.271015 208512 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0307 22:35:13.282333 208512 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.85.2
I0307 22:35:13.282367 208512 kubeadm.go:591] duration metric: took 23.023091ms to restartPrimaryControlPlane
I0307 22:35:13.282387 208512 kubeadm.go:393] duration metric: took 87.963131ms to StartCluster
I0307 22:35:13.282403 208512 settings.go:142] acquiring lock: {Name:mk6b824c86d3c8cffe443e44d2dcdf6ba75674f0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0307 22:35:13.282459 208512 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/18320-2408/kubeconfig
I0307 22:35:13.283397 208512 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18320-2408/kubeconfig: {Name:mkc7f9d8cfd4e14e150b8fc8a3019ac099191c36 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0307 22:35:13.283604 208512 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0307 22:35:13.286382 208512 out.go:177] * Verifying Kubernetes components...
I0307 22:35:13.283949 208512 config.go:182] Loaded profile config "no-preload-767597": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.29.0-rc.2
I0307 22:35:13.283961 208512 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0307 22:35:13.288915 208512 addons.go:69] Setting storage-provisioner=true in profile "no-preload-767597"
I0307 22:35:13.288938 208512 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0307 22:35:13.288949 208512 addons.go:234] Setting addon storage-provisioner=true in "no-preload-767597"
W0307 22:35:13.288957 208512 addons.go:243] addon storage-provisioner should already be in state true
I0307 22:35:13.288992 208512 host.go:66] Checking if "no-preload-767597" exists ...
I0307 22:35:13.289031 208512 addons.go:69] Setting dashboard=true in profile "no-preload-767597"
I0307 22:35:13.289048 208512 addons.go:234] Setting addon dashboard=true in "no-preload-767597"
W0307 22:35:13.289055 208512 addons.go:243] addon dashboard should already be in state true
I0307 22:35:13.289089 208512 host.go:66] Checking if "no-preload-767597" exists ...
I0307 22:35:13.289490 208512 cli_runner.go:164] Run: docker container inspect no-preload-767597 --format={{.State.Status}}
I0307 22:35:13.289499 208512 cli_runner.go:164] Run: docker container inspect no-preload-767597 --format={{.State.Status}}
I0307 22:35:13.290004 208512 addons.go:69] Setting metrics-server=true in profile "no-preload-767597"
I0307 22:35:13.290037 208512 addons.go:234] Setting addon metrics-server=true in "no-preload-767597"
W0307 22:35:13.290052 208512 addons.go:243] addon metrics-server should already be in state true
I0307 22:35:13.290082 208512 host.go:66] Checking if "no-preload-767597" exists ...
I0307 22:35:13.290520 208512 cli_runner.go:164] Run: docker container inspect no-preload-767597 --format={{.State.Status}}
I0307 22:35:13.290916 208512 addons.go:69] Setting default-storageclass=true in profile "no-preload-767597"
I0307 22:35:13.290945 208512 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-767597"
I0307 22:35:13.291235 208512 cli_runner.go:164] Run: docker container inspect no-preload-767597 --format={{.State.Status}}
I0307 22:35:13.330022 208512 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0307 22:35:13.336415 208512 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0307 22:35:13.339031 208512 addons.go:426] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0307 22:35:13.339055 208512 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0307 22:35:13.339118 208512 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-767597
I0307 22:35:13.403412 208512 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0307 22:35:13.405061 208512 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0307 22:35:13.405086 208512 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0307 22:35:13.405161 208512 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-767597
I0307 22:35:13.416685 208512 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0307 22:35:13.415112 208512 addons.go:234] Setting addon default-storageclass=true in "no-preload-767597"
I0307 22:35:13.415294 208512 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33072 SSHKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/machines/no-preload-767597/id_rsa Username:docker}
I0307 22:35:13.419148 208512 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0307 22:35:13.419166 208512 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0307 22:35:13.419219 208512 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-767597
W0307 22:35:13.419420 208512 addons.go:243] addon default-storageclass should already be in state true
I0307 22:35:13.419451 208512 host.go:66] Checking if "no-preload-767597" exists ...
I0307 22:35:13.419885 208512 cli_runner.go:164] Run: docker container inspect no-preload-767597 --format={{.State.Status}}
I0307 22:35:13.460975 208512 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33072 SSHKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/machines/no-preload-767597/id_rsa Username:docker}
I0307 22:35:13.485213 208512 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0307 22:35:13.485233 208512 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0307 22:35:13.485292 208512 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-767597
I0307 22:35:13.492422 208512 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33072 SSHKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/machines/no-preload-767597/id_rsa Username:docker}
I0307 22:35:13.523511 208512 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33072 SSHKeyPath:/home/jenkins/minikube-integration/18320-2408/.minikube/machines/no-preload-767597/id_rsa Username:docker}
I0307 22:35:13.553555 208512 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0307 22:35:13.685269 208512 node_ready.go:35] waiting up to 6m0s for node "no-preload-767597" to be "Ready" ...
I0307 22:35:13.712641 208512 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0307 22:35:13.712666 208512 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0307 22:35:13.752532 208512 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0307 22:35:13.752558 208512 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0307 22:35:13.789067 208512 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0307 22:35:13.801360 208512 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0307 22:35:13.801379 208512 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0307 22:35:13.826420 208512 addons.go:426] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0307 22:35:13.826453 208512 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0307 22:35:13.891072 208512 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0307 22:35:13.891110 208512 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0307 22:35:13.965948 208512 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0307 22:35:14.017690 208512 addons.go:426] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0307 22:35:14.017722 208512 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0307 22:35:14.180530 208512 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0307 22:35:14.180556 208512 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0307 22:35:14.290500 208512 addons.go:426] installing /etc/kubernetes/addons/dashboard-role.yaml
I0307 22:35:14.290526 208512 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0307 22:35:14.354148 208512 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0307 22:35:14.444806 208512 addons.go:426] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0307 22:35:14.444833 208512 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0307 22:35:14.577504 208512 addons.go:426] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0307 22:35:14.577532 208512 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0307 22:35:14.629444 208512 addons.go:426] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0307 22:35:14.629479 208512 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0307 22:35:14.697692 208512 addons.go:426] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0307 22:35:14.697718 208512 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0307 22:35:14.785218 208512 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0307 22:35:12.769053 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:15.253885 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:18.211449 208512 node_ready.go:49] node "no-preload-767597" has status "Ready":"True"
I0307 22:35:18.211491 208512 node_ready.go:38] duration metric: took 4.526184818s for node "no-preload-767597" to be "Ready" ...
I0307 22:35:18.211503 208512 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0307 22:35:18.259359 208512 pod_ready.go:78] waiting up to 6m0s for pod "coredns-76f75df574-w5rmw" in "kube-system" namespace to be "Ready" ...
I0307 22:35:18.289582 208512 pod_ready.go:92] pod "coredns-76f75df574-w5rmw" in "kube-system" namespace has status "Ready":"True"
I0307 22:35:18.289610 208512 pod_ready.go:81] duration metric: took 30.216736ms for pod "coredns-76f75df574-w5rmw" in "kube-system" namespace to be "Ready" ...
I0307 22:35:18.289621 208512 pod_ready.go:78] waiting up to 6m0s for pod "etcd-no-preload-767597" in "kube-system" namespace to be "Ready" ...
I0307 22:35:18.304829 208512 pod_ready.go:92] pod "etcd-no-preload-767597" in "kube-system" namespace has status "Ready":"True"
I0307 22:35:18.304853 208512 pod_ready.go:81] duration metric: took 15.224666ms for pod "etcd-no-preload-767597" in "kube-system" namespace to be "Ready" ...
I0307 22:35:18.304875 208512 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-no-preload-767597" in "kube-system" namespace to be "Ready" ...
I0307 22:35:18.355922 208512 pod_ready.go:92] pod "kube-apiserver-no-preload-767597" in "kube-system" namespace has status "Ready":"True"
I0307 22:35:18.355957 208512 pod_ready.go:81] duration metric: took 51.064552ms for pod "kube-apiserver-no-preload-767597" in "kube-system" namespace to be "Ready" ...
I0307 22:35:18.355970 208512 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-no-preload-767597" in "kube-system" namespace to be "Ready" ...
I0307 22:35:18.378001 208512 pod_ready.go:92] pod "kube-controller-manager-no-preload-767597" in "kube-system" namespace has status "Ready":"True"
I0307 22:35:18.378032 208512 pod_ready.go:81] duration metric: took 22.054112ms for pod "kube-controller-manager-no-preload-767597" in "kube-system" namespace to be "Ready" ...
I0307 22:35:18.378044 208512 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-d69xl" in "kube-system" namespace to be "Ready" ...
I0307 22:35:18.416467 208512 pod_ready.go:92] pod "kube-proxy-d69xl" in "kube-system" namespace has status "Ready":"True"
I0307 22:35:18.416499 208512 pod_ready.go:81] duration metric: took 38.448118ms for pod "kube-proxy-d69xl" in "kube-system" namespace to be "Ready" ...
I0307 22:35:18.416514 208512 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-no-preload-767597" in "kube-system" namespace to be "Ready" ...
I0307 22:35:18.815705 208512 pod_ready.go:92] pod "kube-scheduler-no-preload-767597" in "kube-system" namespace has status "Ready":"True"
I0307 22:35:18.815741 208512 pod_ready.go:81] duration metric: took 399.219381ms for pod "kube-scheduler-no-preload-767597" in "kube-system" namespace to be "Ready" ...
I0307 22:35:18.815754 208512 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace to be "Ready" ...
I0307 22:35:20.824700 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:21.293581 208512 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.504478529s)
I0307 22:35:21.293675 208512 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (7.327628481s)
I0307 22:35:21.293800 208512 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (6.508531507s)
I0307 22:35:21.296005 208512 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p no-preload-767597 addons enable metrics-server
I0307 22:35:21.293712 208512 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (6.939531995s)
I0307 22:35:21.298727 208512 addons.go:470] Verifying addon metrics-server=true in "no-preload-767597"
I0307 22:35:21.303830 208512 out.go:177] * Enabled addons: storage-provisioner, dashboard, metrics-server, default-storageclass
I0307 22:35:17.751535 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:20.250616 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:21.305624 208512 addons.go:505] duration metric: took 8.021656311s for enable addons: enabled=[storage-provisioner dashboard metrics-server default-storageclass]
I0307 22:35:23.322953 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:25.323598 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:22.757325 203173 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:25.278867 203173 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"True"
I0307 22:35:25.278895 203173 pod_ready.go:81] duration metric: took 1m11.035666367s for pod "kube-controller-manager-old-k8s-version-497253" in "kube-system" namespace to be "Ready" ...
I0307 22:35:25.278908 203173 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-8s7l5" in "kube-system" namespace to be "Ready" ...
I0307 22:35:25.284398 203173 pod_ready.go:92] pod "kube-proxy-8s7l5" in "kube-system" namespace has status "Ready":"True"
I0307 22:35:25.284421 203173 pod_ready.go:81] duration metric: took 5.505752ms for pod "kube-proxy-8s7l5" in "kube-system" namespace to be "Ready" ...
I0307 22:35:25.284432 203173 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-497253" in "kube-system" namespace to be "Ready" ...
I0307 22:35:25.289813 203173 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-497253" in "kube-system" namespace has status "Ready":"True"
I0307 22:35:25.289838 203173 pod_ready.go:81] duration metric: took 5.397953ms for pod "kube-scheduler-old-k8s-version-497253" in "kube-system" namespace to be "Ready" ...
I0307 22:35:25.289850 203173 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace to be "Ready" ...
I0307 22:35:27.296486 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:27.822479 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:30.322295 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:29.297074 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:31.796091 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:32.822330 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:34.822906 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:33.797140 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:35.801061 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:37.323060 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:39.822997 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:38.297272 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:40.796600 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:42.323261 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:44.822616 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:42.797115 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:45.298847 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:47.322250 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:49.322710 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:47.796663 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:50.296374 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:51.822111 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:54.322141 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:52.796187 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:54.796599 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:56.798445 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:56.322482 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:58.821628 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:35:59.295821 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:01.296396 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:00.821690 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:02.822220 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:05.322526 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:03.796625 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:06.296444 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:07.322791 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:09.822243 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:08.297407 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:10.796602 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:12.323306 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:14.822366 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:13.295686 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:15.296045 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:17.301566 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:17.322596 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:19.821419 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:19.796306 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:22.296441 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:21.822532 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:23.822861 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:24.796739 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:27.297453 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:26.322441 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:28.821852 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:29.300605 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:31.796632 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:30.822490 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:33.321736 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:35.323023 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:34.296019 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:36.296825 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:37.822341 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:39.822628 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:38.796557 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:40.797121 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:41.822738 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:44.321881 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:43.296360 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:45.298301 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:46.821848 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:48.823604 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:47.796686 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:50.295837 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:52.296530 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:51.322330 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:53.822168 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:54.297148 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:56.796796 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:56.322285 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:58.322762 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:00.324353 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:36:58.796999 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:01.296221 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:02.822525 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:05.322762 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:03.296654 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:05.297692 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:07.327637 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:09.822618 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:07.797249 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:10.296763 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:11.823794 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:14.322055 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:12.797250 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:14.798715 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:17.296697 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:16.322160 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:18.322304 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:19.297631 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:21.796680 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:20.823597 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:23.321913 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:25.322259 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:24.296142 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:26.326766 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:27.822749 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:29.822967 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:28.795966 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:30.796372 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:32.322380 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:34.822121 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:33.296568 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:35.296723 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:36.822226 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:39.321983 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:37.796345 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:40.295858 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:42.297400 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:41.322608 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:43.822624 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:44.796351 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:46.796401 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:46.321785 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:48.321869 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:48.797340 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:51.296470 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:50.822896 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:52.823106 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:55.322025 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:53.296690 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:55.298602 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:57.322728 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:59.822997 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:57.796372 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:37:59.796520 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:02.296249 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:02.322508 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:04.822317 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:04.796146 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:06.796971 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:07.322178 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:09.822101 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:09.296375 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:11.795721 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:11.823000 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:14.321873 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:13.801706 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:16.296885 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:16.321916 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:18.821728 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:18.298497 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:20.796022 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:20.822225 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:22.822800 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:24.823201 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:22.797461 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:25.296255 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:27.297096 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:26.824702 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:29.322418 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:29.796172 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:32.295946 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:31.822283 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:34.322435 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:34.795870 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:36.796339 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:36.322617 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:38.821766 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:38.796554 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:41.297458 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:40.821870 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:42.822216 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:45.323003 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:43.795600 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:45.797095 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:47.822420 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:49.824954 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:47.802184 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:50.296669 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:52.321790 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:54.322148 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:52.795972 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:55.296865 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:56.322286 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:58.323011 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:00.327819 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:38:57.795956 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:00.301337 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:02.822061 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:04.822313 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:02.796169 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:05.295485 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:07.296560 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:07.322963 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:09.822090 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:09.796355 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:12.295856 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:12.324257 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:14.822039 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:14.296046 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:16.796231 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:16.822121 208512 pod_ready.go:102] pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:18.821707 208512 pod_ready.go:81] duration metric: took 4m0.005941928s for pod "metrics-server-57f55c9bc5-wgs49" in "kube-system" namespace to be "Ready" ...
E0307 22:39:18.821734 208512 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0307 22:39:18.821746 208512 pod_ready.go:38] duration metric: took 4m0.610230786s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0307 22:39:18.821760 208512 api_server.go:52] waiting for apiserver process to appear ...
I0307 22:39:18.821789 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0307 22:39:18.821851 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0307 22:39:18.869636 208512 cri.go:89] found id: "8538ff6a2530eeddd6961ceeea4e8b8f31e001b211f6b0e42b463f41bfc8eb9b"
I0307 22:39:18.869660 208512 cri.go:89] found id: "3ad41b9769064eab5e8003ea9de4b5b9f58af6a4d81413a5083b9b5abc308170"
I0307 22:39:18.869665 208512 cri.go:89] found id: ""
I0307 22:39:18.869672 208512 logs.go:276] 2 containers: [8538ff6a2530eeddd6961ceeea4e8b8f31e001b211f6b0e42b463f41bfc8eb9b 3ad41b9769064eab5e8003ea9de4b5b9f58af6a4d81413a5083b9b5abc308170]
I0307 22:39:18.869750 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:18.874986 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:18.878367 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0307 22:39:18.878450 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0307 22:39:18.931485 208512 cri.go:89] found id: "8d3da2ccfc6f3e03a090f259d264c023c0220868e0038f3aab52d0bee1e0f788"
I0307 22:39:18.931516 208512 cri.go:89] found id: "61d3947cf55d680139b701ec61051f9ada8b04b18e981f05adeac9a4a7a67d89"
I0307 22:39:18.931521 208512 cri.go:89] found id: ""
I0307 22:39:18.931529 208512 logs.go:276] 2 containers: [8d3da2ccfc6f3e03a090f259d264c023c0220868e0038f3aab52d0bee1e0f788 61d3947cf55d680139b701ec61051f9ada8b04b18e981f05adeac9a4a7a67d89]
I0307 22:39:18.931597 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:18.935728 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:18.939289 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0307 22:39:18.939367 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0307 22:39:18.983237 208512 cri.go:89] found id: "66c0213f3c233ac7b951a4b86aab5ef89cc56a2ca5499180954b801d7ed742d1"
I0307 22:39:18.983298 208512 cri.go:89] found id: "cd25d5f2cd96fffd3dc549470243d20ea7e47ef4dcd423227a4a52724f521183"
I0307 22:39:18.983319 208512 cri.go:89] found id: ""
I0307 22:39:18.983343 208512 logs.go:276] 2 containers: [66c0213f3c233ac7b951a4b86aab5ef89cc56a2ca5499180954b801d7ed742d1 cd25d5f2cd96fffd3dc549470243d20ea7e47ef4dcd423227a4a52724f521183]
I0307 22:39:18.983416 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:18.987539 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:18.991066 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0307 22:39:18.991166 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0307 22:39:19.032889 208512 cri.go:89] found id: "ddaf309f6c6682b8d155b529ee31ae4f0dce1a6a9763127da6df7fdbbd31a16d"
I0307 22:39:19.032910 208512 cri.go:89] found id: "da7081019e6f16e832848ada7b2e006667f931fc538edab6b1ebd551fa208cbe"
I0307 22:39:19.032915 208512 cri.go:89] found id: ""
I0307 22:39:19.032922 208512 logs.go:276] 2 containers: [ddaf309f6c6682b8d155b529ee31ae4f0dce1a6a9763127da6df7fdbbd31a16d da7081019e6f16e832848ada7b2e006667f931fc538edab6b1ebd551fa208cbe]
I0307 22:39:19.032976 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:19.036597 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:19.039880 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0307 22:39:19.039952 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0307 22:39:19.089864 208512 cri.go:89] found id: "7c807963c5849afb9cda04a10c0ba18eb4139242b1caf7d11205fa10706faf36"
I0307 22:39:19.089888 208512 cri.go:89] found id: "775c4272397dc700a1daf97c4e663e7fc3f71729356cee17bd4235ddf6daa2a3"
I0307 22:39:19.089894 208512 cri.go:89] found id: ""
I0307 22:39:19.089900 208512 logs.go:276] 2 containers: [7c807963c5849afb9cda04a10c0ba18eb4139242b1caf7d11205fa10706faf36 775c4272397dc700a1daf97c4e663e7fc3f71729356cee17bd4235ddf6daa2a3]
I0307 22:39:19.089959 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:19.093701 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:19.096965 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0307 22:39:19.097036 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0307 22:39:19.143660 208512 cri.go:89] found id: "bf0796c3bdeb1fb7cbeadd653a03514f86b475a0faf4571351606a60b1da8a91"
I0307 22:39:19.143681 208512 cri.go:89] found id: "a52fdbe185cf6604953f1db9bf33ddda100e7929d29ddd019abb2c4f628ccf8a"
I0307 22:39:19.143686 208512 cri.go:89] found id: ""
I0307 22:39:19.143693 208512 logs.go:276] 2 containers: [bf0796c3bdeb1fb7cbeadd653a03514f86b475a0faf4571351606a60b1da8a91 a52fdbe185cf6604953f1db9bf33ddda100e7929d29ddd019abb2c4f628ccf8a]
I0307 22:39:19.143781 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:19.147396 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:19.150712 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0307 22:39:19.150808 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0307 22:39:19.187166 208512 cri.go:89] found id: "20752f16c26ce3f933b39f1e042151aa9c6c927a788b023f74cd5e26eb4e9dea"
I0307 22:39:19.187239 208512 cri.go:89] found id: "988c7824310b34904cc0fcc89dceab6a97539faa8b8f508cbcbbdf112c8521fb"
I0307 22:39:19.187258 208512 cri.go:89] found id: ""
I0307 22:39:19.187281 208512 logs.go:276] 2 containers: [20752f16c26ce3f933b39f1e042151aa9c6c927a788b023f74cd5e26eb4e9dea 988c7824310b34904cc0fcc89dceab6a97539faa8b8f508cbcbbdf112c8521fb]
I0307 22:39:19.187359 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:19.191044 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:19.194510 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0307 22:39:19.194599 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0307 22:39:19.232458 208512 cri.go:89] found id: "15345923272f30bf45fa6edcd96846838ad863ca72c9fe79a0ec5ca8d5c28a7e"
I0307 22:39:19.232491 208512 cri.go:89] found id: ""
I0307 22:39:19.232500 208512 logs.go:276] 1 containers: [15345923272f30bf45fa6edcd96846838ad863ca72c9fe79a0ec5ca8d5c28a7e]
I0307 22:39:19.232567 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:19.235934 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0307 22:39:19.236043 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0307 22:39:19.272434 208512 cri.go:89] found id: "ac29cd6286420edd0596fdc8868b3ee5d6b7b98bc806044fb91e4e443a93b393"
I0307 22:39:19.272457 208512 cri.go:89] found id: "3e0ca1a11903bcbc026af5c35f9936a9948e4225c5df356b916422ffc52a02b8"
I0307 22:39:19.272462 208512 cri.go:89] found id: ""
I0307 22:39:19.272469 208512 logs.go:276] 2 containers: [ac29cd6286420edd0596fdc8868b3ee5d6b7b98bc806044fb91e4e443a93b393 3e0ca1a11903bcbc026af5c35f9936a9948e4225c5df356b916422ffc52a02b8]
I0307 22:39:19.272525 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:19.276097 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:19.279492 208512 logs.go:123] Gathering logs for kube-scheduler [ddaf309f6c6682b8d155b529ee31ae4f0dce1a6a9763127da6df7fdbbd31a16d] ...
I0307 22:39:19.279527 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ddaf309f6c6682b8d155b529ee31ae4f0dce1a6a9763127da6df7fdbbd31a16d"
I0307 22:39:19.335718 208512 logs.go:123] Gathering logs for kube-proxy [775c4272397dc700a1daf97c4e663e7fc3f71729356cee17bd4235ddf6daa2a3] ...
I0307 22:39:19.335749 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 775c4272397dc700a1daf97c4e663e7fc3f71729356cee17bd4235ddf6daa2a3"
I0307 22:39:19.373413 208512 logs.go:123] Gathering logs for kube-controller-manager [bf0796c3bdeb1fb7cbeadd653a03514f86b475a0faf4571351606a60b1da8a91] ...
I0307 22:39:19.373446 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bf0796c3bdeb1fb7cbeadd653a03514f86b475a0faf4571351606a60b1da8a91"
I0307 22:39:19.436765 208512 logs.go:123] Gathering logs for kube-controller-manager [a52fdbe185cf6604953f1db9bf33ddda100e7929d29ddd019abb2c4f628ccf8a] ...
I0307 22:39:19.436799 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a52fdbe185cf6604953f1db9bf33ddda100e7929d29ddd019abb2c4f628ccf8a"
I0307 22:39:19.494641 208512 logs.go:123] Gathering logs for kubernetes-dashboard [15345923272f30bf45fa6edcd96846838ad863ca72c9fe79a0ec5ca8d5c28a7e] ...
I0307 22:39:19.494712 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 15345923272f30bf45fa6edcd96846838ad863ca72c9fe79a0ec5ca8d5c28a7e"
I0307 22:39:19.540826 208512 logs.go:123] Gathering logs for dmesg ...
I0307 22:39:19.540855 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0307 22:39:19.561869 208512 logs.go:123] Gathering logs for kube-apiserver [3ad41b9769064eab5e8003ea9de4b5b9f58af6a4d81413a5083b9b5abc308170] ...
I0307 22:39:19.561898 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3ad41b9769064eab5e8003ea9de4b5b9f58af6a4d81413a5083b9b5abc308170"
I0307 22:39:19.610968 208512 logs.go:123] Gathering logs for coredns [66c0213f3c233ac7b951a4b86aab5ef89cc56a2ca5499180954b801d7ed742d1] ...
I0307 22:39:19.610998 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 66c0213f3c233ac7b951a4b86aab5ef89cc56a2ca5499180954b801d7ed742d1"
I0307 22:39:19.662744 208512 logs.go:123] Gathering logs for containerd ...
I0307 22:39:19.662774 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0307 22:39:19.730097 208512 logs.go:123] Gathering logs for kindnet [20752f16c26ce3f933b39f1e042151aa9c6c927a788b023f74cd5e26eb4e9dea] ...
I0307 22:39:19.730132 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 20752f16c26ce3f933b39f1e042151aa9c6c927a788b023f74cd5e26eb4e9dea"
I0307 22:39:19.778859 208512 logs.go:123] Gathering logs for kindnet [988c7824310b34904cc0fcc89dceab6a97539faa8b8f508cbcbbdf112c8521fb] ...
I0307 22:39:19.778889 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 988c7824310b34904cc0fcc89dceab6a97539faa8b8f508cbcbbdf112c8521fb"
I0307 22:39:19.823368 208512 logs.go:123] Gathering logs for storage-provisioner [3e0ca1a11903bcbc026af5c35f9936a9948e4225c5df356b916422ffc52a02b8] ...
I0307 22:39:19.823397 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3e0ca1a11903bcbc026af5c35f9936a9948e4225c5df356b916422ffc52a02b8"
I0307 22:39:19.859667 208512 logs.go:123] Gathering logs for describe nodes ...
I0307 22:39:19.859702 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0307 22:39:20.001010 208512 logs.go:123] Gathering logs for etcd [8d3da2ccfc6f3e03a090f259d264c023c0220868e0038f3aab52d0bee1e0f788] ...
I0307 22:39:20.001044 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8d3da2ccfc6f3e03a090f259d264c023c0220868e0038f3aab52d0bee1e0f788"
I0307 22:39:20.068625 208512 logs.go:123] Gathering logs for etcd [61d3947cf55d680139b701ec61051f9ada8b04b18e981f05adeac9a4a7a67d89] ...
I0307 22:39:20.068658 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 61d3947cf55d680139b701ec61051f9ada8b04b18e981f05adeac9a4a7a67d89"
I0307 22:39:20.126808 208512 logs.go:123] Gathering logs for container status ...
I0307 22:39:20.126847 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0307 22:39:20.181924 208512 logs.go:123] Gathering logs for kube-scheduler [da7081019e6f16e832848ada7b2e006667f931fc538edab6b1ebd551fa208cbe] ...
I0307 22:39:20.181959 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 da7081019e6f16e832848ada7b2e006667f931fc538edab6b1ebd551fa208cbe"
I0307 22:39:20.242842 208512 logs.go:123] Gathering logs for kube-proxy [7c807963c5849afb9cda04a10c0ba18eb4139242b1caf7d11205fa10706faf36] ...
I0307 22:39:20.242877 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7c807963c5849afb9cda04a10c0ba18eb4139242b1caf7d11205fa10706faf36"
I0307 22:39:20.283160 208512 logs.go:123] Gathering logs for storage-provisioner [ac29cd6286420edd0596fdc8868b3ee5d6b7b98bc806044fb91e4e443a93b393] ...
I0307 22:39:20.283190 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ac29cd6286420edd0596fdc8868b3ee5d6b7b98bc806044fb91e4e443a93b393"
I0307 22:39:20.334236 208512 logs.go:123] Gathering logs for kubelet ...
I0307 22:39:20.334265 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0307 22:39:20.407784 208512 logs.go:123] Gathering logs for kube-apiserver [8538ff6a2530eeddd6961ceeea4e8b8f31e001b211f6b0e42b463f41bfc8eb9b] ...
I0307 22:39:20.407819 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8538ff6a2530eeddd6961ceeea4e8b8f31e001b211f6b0e42b463f41bfc8eb9b"
I0307 22:39:20.466820 208512 logs.go:123] Gathering logs for coredns [cd25d5f2cd96fffd3dc549470243d20ea7e47ef4dcd423227a4a52724f521183] ...
I0307 22:39:20.466857 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cd25d5f2cd96fffd3dc549470243d20ea7e47ef4dcd423227a4a52724f521183"
I0307 22:39:18.796994 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:20.797675 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:23.017796 208512 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0307 22:39:23.029818 208512 api_server.go:72] duration metric: took 4m9.746175934s to wait for apiserver process to appear ...
I0307 22:39:23.029891 208512 api_server.go:88] waiting for apiserver healthz status ...
I0307 22:39:23.029940 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0307 22:39:23.030034 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0307 22:39:23.075382 208512 cri.go:89] found id: "8538ff6a2530eeddd6961ceeea4e8b8f31e001b211f6b0e42b463f41bfc8eb9b"
I0307 22:39:23.075405 208512 cri.go:89] found id: "3ad41b9769064eab5e8003ea9de4b5b9f58af6a4d81413a5083b9b5abc308170"
I0307 22:39:23.075411 208512 cri.go:89] found id: ""
I0307 22:39:23.075418 208512 logs.go:276] 2 containers: [8538ff6a2530eeddd6961ceeea4e8b8f31e001b211f6b0e42b463f41bfc8eb9b 3ad41b9769064eab5e8003ea9de4b5b9f58af6a4d81413a5083b9b5abc308170]
I0307 22:39:23.075483 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:23.079550 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:23.082825 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0307 22:39:23.082889 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0307 22:39:23.120086 208512 cri.go:89] found id: "8d3da2ccfc6f3e03a090f259d264c023c0220868e0038f3aab52d0bee1e0f788"
I0307 22:39:23.120109 208512 cri.go:89] found id: "61d3947cf55d680139b701ec61051f9ada8b04b18e981f05adeac9a4a7a67d89"
I0307 22:39:23.120115 208512 cri.go:89] found id: ""
I0307 22:39:23.120123 208512 logs.go:276] 2 containers: [8d3da2ccfc6f3e03a090f259d264c023c0220868e0038f3aab52d0bee1e0f788 61d3947cf55d680139b701ec61051f9ada8b04b18e981f05adeac9a4a7a67d89]
I0307 22:39:23.120196 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:23.123687 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:23.127251 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0307 22:39:23.127409 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0307 22:39:23.167955 208512 cri.go:89] found id: "66c0213f3c233ac7b951a4b86aab5ef89cc56a2ca5499180954b801d7ed742d1"
I0307 22:39:23.168028 208512 cri.go:89] found id: "cd25d5f2cd96fffd3dc549470243d20ea7e47ef4dcd423227a4a52724f521183"
I0307 22:39:23.168059 208512 cri.go:89] found id: ""
I0307 22:39:23.168080 208512 logs.go:276] 2 containers: [66c0213f3c233ac7b951a4b86aab5ef89cc56a2ca5499180954b801d7ed742d1 cd25d5f2cd96fffd3dc549470243d20ea7e47ef4dcd423227a4a52724f521183]
I0307 22:39:23.168170 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:23.172615 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:23.176516 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0307 22:39:23.176584 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0307 22:39:23.219510 208512 cri.go:89] found id: "ddaf309f6c6682b8d155b529ee31ae4f0dce1a6a9763127da6df7fdbbd31a16d"
I0307 22:39:23.219529 208512 cri.go:89] found id: "da7081019e6f16e832848ada7b2e006667f931fc538edab6b1ebd551fa208cbe"
I0307 22:39:23.219534 208512 cri.go:89] found id: ""
I0307 22:39:23.219541 208512 logs.go:276] 2 containers: [ddaf309f6c6682b8d155b529ee31ae4f0dce1a6a9763127da6df7fdbbd31a16d da7081019e6f16e832848ada7b2e006667f931fc538edab6b1ebd551fa208cbe]
I0307 22:39:23.219612 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:23.223195 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:23.226557 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0307 22:39:23.226673 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0307 22:39:23.269931 208512 cri.go:89] found id: "7c807963c5849afb9cda04a10c0ba18eb4139242b1caf7d11205fa10706faf36"
I0307 22:39:23.270000 208512 cri.go:89] found id: "775c4272397dc700a1daf97c4e663e7fc3f71729356cee17bd4235ddf6daa2a3"
I0307 22:39:23.270017 208512 cri.go:89] found id: ""
I0307 22:39:23.270025 208512 logs.go:276] 2 containers: [7c807963c5849afb9cda04a10c0ba18eb4139242b1caf7d11205fa10706faf36 775c4272397dc700a1daf97c4e663e7fc3f71729356cee17bd4235ddf6daa2a3]
I0307 22:39:23.270093 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:23.273706 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:23.277042 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0307 22:39:23.277129 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0307 22:39:23.326962 208512 cri.go:89] found id: "bf0796c3bdeb1fb7cbeadd653a03514f86b475a0faf4571351606a60b1da8a91"
I0307 22:39:23.326983 208512 cri.go:89] found id: "a52fdbe185cf6604953f1db9bf33ddda100e7929d29ddd019abb2c4f628ccf8a"
I0307 22:39:23.326988 208512 cri.go:89] found id: ""
I0307 22:39:23.326995 208512 logs.go:276] 2 containers: [bf0796c3bdeb1fb7cbeadd653a03514f86b475a0faf4571351606a60b1da8a91 a52fdbe185cf6604953f1db9bf33ddda100e7929d29ddd019abb2c4f628ccf8a]
I0307 22:39:23.327067 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:23.330781 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:23.334158 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0307 22:39:23.334266 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0307 22:39:23.372751 208512 cri.go:89] found id: "20752f16c26ce3f933b39f1e042151aa9c6c927a788b023f74cd5e26eb4e9dea"
I0307 22:39:23.372811 208512 cri.go:89] found id: "988c7824310b34904cc0fcc89dceab6a97539faa8b8f508cbcbbdf112c8521fb"
I0307 22:39:23.372831 208512 cri.go:89] found id: ""
I0307 22:39:23.372856 208512 logs.go:276] 2 containers: [20752f16c26ce3f933b39f1e042151aa9c6c927a788b023f74cd5e26eb4e9dea 988c7824310b34904cc0fcc89dceab6a97539faa8b8f508cbcbbdf112c8521fb]
I0307 22:39:23.372927 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:23.377045 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:23.381497 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0307 22:39:23.381592 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0307 22:39:23.418727 208512 cri.go:89] found id: "ac29cd6286420edd0596fdc8868b3ee5d6b7b98bc806044fb91e4e443a93b393"
I0307 22:39:23.418789 208512 cri.go:89] found id: "3e0ca1a11903bcbc026af5c35f9936a9948e4225c5df356b916422ffc52a02b8"
I0307 22:39:23.418811 208512 cri.go:89] found id: ""
I0307 22:39:23.418826 208512 logs.go:276] 2 containers: [ac29cd6286420edd0596fdc8868b3ee5d6b7b98bc806044fb91e4e443a93b393 3e0ca1a11903bcbc026af5c35f9936a9948e4225c5df356b916422ffc52a02b8]
I0307 22:39:23.418910 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:23.422597 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:23.426213 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0307 22:39:23.426279 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0307 22:39:23.469521 208512 cri.go:89] found id: "15345923272f30bf45fa6edcd96846838ad863ca72c9fe79a0ec5ca8d5c28a7e"
I0307 22:39:23.469543 208512 cri.go:89] found id: ""
I0307 22:39:23.469552 208512 logs.go:276] 1 containers: [15345923272f30bf45fa6edcd96846838ad863ca72c9fe79a0ec5ca8d5c28a7e]
I0307 22:39:23.469605 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:23.473267 208512 logs.go:123] Gathering logs for storage-provisioner [ac29cd6286420edd0596fdc8868b3ee5d6b7b98bc806044fb91e4e443a93b393] ...
I0307 22:39:23.473328 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ac29cd6286420edd0596fdc8868b3ee5d6b7b98bc806044fb91e4e443a93b393"
I0307 22:39:23.511454 208512 logs.go:123] Gathering logs for kubelet ...
I0307 22:39:23.511519 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0307 22:39:23.582902 208512 logs.go:123] Gathering logs for etcd [8d3da2ccfc6f3e03a090f259d264c023c0220868e0038f3aab52d0bee1e0f788] ...
I0307 22:39:23.582936 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8d3da2ccfc6f3e03a090f259d264c023c0220868e0038f3aab52d0bee1e0f788"
I0307 22:39:23.629314 208512 logs.go:123] Gathering logs for coredns [66c0213f3c233ac7b951a4b86aab5ef89cc56a2ca5499180954b801d7ed742d1] ...
I0307 22:39:23.629346 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 66c0213f3c233ac7b951a4b86aab5ef89cc56a2ca5499180954b801d7ed742d1"
I0307 22:39:23.677252 208512 logs.go:123] Gathering logs for kube-controller-manager [bf0796c3bdeb1fb7cbeadd653a03514f86b475a0faf4571351606a60b1da8a91] ...
I0307 22:39:23.677281 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bf0796c3bdeb1fb7cbeadd653a03514f86b475a0faf4571351606a60b1da8a91"
I0307 22:39:23.754191 208512 logs.go:123] Gathering logs for coredns [cd25d5f2cd96fffd3dc549470243d20ea7e47ef4dcd423227a4a52724f521183] ...
I0307 22:39:23.754224 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cd25d5f2cd96fffd3dc549470243d20ea7e47ef4dcd423227a4a52724f521183"
I0307 22:39:23.796160 208512 logs.go:123] Gathering logs for kube-scheduler [da7081019e6f16e832848ada7b2e006667f931fc538edab6b1ebd551fa208cbe] ...
I0307 22:39:23.796190 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 da7081019e6f16e832848ada7b2e006667f931fc538edab6b1ebd551fa208cbe"
I0307 22:39:23.846343 208512 logs.go:123] Gathering logs for kube-proxy [775c4272397dc700a1daf97c4e663e7fc3f71729356cee17bd4235ddf6daa2a3] ...
I0307 22:39:23.846376 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 775c4272397dc700a1daf97c4e663e7fc3f71729356cee17bd4235ddf6daa2a3"
I0307 22:39:23.893266 208512 logs.go:123] Gathering logs for kindnet [988c7824310b34904cc0fcc89dceab6a97539faa8b8f508cbcbbdf112c8521fb] ...
I0307 22:39:23.893295 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 988c7824310b34904cc0fcc89dceab6a97539faa8b8f508cbcbbdf112c8521fb"
I0307 22:39:23.932799 208512 logs.go:123] Gathering logs for storage-provisioner [3e0ca1a11903bcbc026af5c35f9936a9948e4225c5df356b916422ffc52a02b8] ...
I0307 22:39:23.932827 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3e0ca1a11903bcbc026af5c35f9936a9948e4225c5df356b916422ffc52a02b8"
I0307 22:39:23.970809 208512 logs.go:123] Gathering logs for container status ...
I0307 22:39:23.970839 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0307 22:39:24.030721 208512 logs.go:123] Gathering logs for dmesg ...
I0307 22:39:24.030754 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0307 22:39:24.059034 208512 logs.go:123] Gathering logs for kube-proxy [7c807963c5849afb9cda04a10c0ba18eb4139242b1caf7d11205fa10706faf36] ...
I0307 22:39:24.059066 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7c807963c5849afb9cda04a10c0ba18eb4139242b1caf7d11205fa10706faf36"
I0307 22:39:24.101193 208512 logs.go:123] Gathering logs for kube-controller-manager [a52fdbe185cf6604953f1db9bf33ddda100e7929d29ddd019abb2c4f628ccf8a] ...
I0307 22:39:24.101227 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a52fdbe185cf6604953f1db9bf33ddda100e7929d29ddd019abb2c4f628ccf8a"
I0307 22:39:24.160531 208512 logs.go:123] Gathering logs for kindnet [20752f16c26ce3f933b39f1e042151aa9c6c927a788b023f74cd5e26eb4e9dea] ...
I0307 22:39:24.160565 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 20752f16c26ce3f933b39f1e042151aa9c6c927a788b023f74cd5e26eb4e9dea"
I0307 22:39:24.202320 208512 logs.go:123] Gathering logs for kube-scheduler [ddaf309f6c6682b8d155b529ee31ae4f0dce1a6a9763127da6df7fdbbd31a16d] ...
I0307 22:39:24.202351 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ddaf309f6c6682b8d155b529ee31ae4f0dce1a6a9763127da6df7fdbbd31a16d"
I0307 22:39:24.250518 208512 logs.go:123] Gathering logs for kubernetes-dashboard [15345923272f30bf45fa6edcd96846838ad863ca72c9fe79a0ec5ca8d5c28a7e] ...
I0307 22:39:24.250547 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 15345923272f30bf45fa6edcd96846838ad863ca72c9fe79a0ec5ca8d5c28a7e"
I0307 22:39:24.298653 208512 logs.go:123] Gathering logs for containerd ...
I0307 22:39:24.298683 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0307 22:39:24.359323 208512 logs.go:123] Gathering logs for describe nodes ...
I0307 22:39:24.359360 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0307 22:39:24.483739 208512 logs.go:123] Gathering logs for kube-apiserver [8538ff6a2530eeddd6961ceeea4e8b8f31e001b211f6b0e42b463f41bfc8eb9b] ...
I0307 22:39:24.483774 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8538ff6a2530eeddd6961ceeea4e8b8f31e001b211f6b0e42b463f41bfc8eb9b"
I0307 22:39:24.533361 208512 logs.go:123] Gathering logs for kube-apiserver [3ad41b9769064eab5e8003ea9de4b5b9f58af6a4d81413a5083b9b5abc308170] ...
I0307 22:39:24.533394 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3ad41b9769064eab5e8003ea9de4b5b9f58af6a4d81413a5083b9b5abc308170"
I0307 22:39:24.597407 208512 logs.go:123] Gathering logs for etcd [61d3947cf55d680139b701ec61051f9ada8b04b18e981f05adeac9a4a7a67d89] ...
I0307 22:39:24.597442 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 61d3947cf55d680139b701ec61051f9ada8b04b18e981f05adeac9a4a7a67d89"
I0307 22:39:23.296761 203173 pod_ready.go:102] pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace has status "Ready":"False"
I0307 22:39:25.296213 203173 pod_ready.go:81] duration metric: took 4m0.00634836s for pod "metrics-server-9975d5f86-qmg9k" in "kube-system" namespace to be "Ready" ...
E0307 22:39:25.296241 203173 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0307 22:39:25.296251 203173 pod_ready.go:38] duration metric: took 5m20.253260881s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0307 22:39:25.296265 203173 api_server.go:52] waiting for apiserver process to appear ...
I0307 22:39:25.296329 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0307 22:39:25.296395 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0307 22:39:25.336345 203173 cri.go:89] found id: "8b2ed0287cc5bbf594cda29d926ae828c7d6d12ad490285c6e855c8824388d29"
I0307 22:39:25.336366 203173 cri.go:89] found id: "cc2db588ff857bfb95417bfc8b125ca64e6caba952ba4acd81ec27522fde3127"
I0307 22:39:25.336371 203173 cri.go:89] found id: ""
I0307 22:39:25.336378 203173 logs.go:276] 2 containers: [8b2ed0287cc5bbf594cda29d926ae828c7d6d12ad490285c6e855c8824388d29 cc2db588ff857bfb95417bfc8b125ca64e6caba952ba4acd81ec27522fde3127]
I0307 22:39:25.336438 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.340420 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.343703 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0307 22:39:25.343781 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0307 22:39:25.383563 203173 cri.go:89] found id: "14afb08fcf0333a1d360d000f1fa3b158ae712b1b2a3e6c52b164c05245f920d"
I0307 22:39:25.383585 203173 cri.go:89] found id: "dabbb0b4fd2574e92c3a53182c494ec08df151f99bd21d27189df149b7f8961c"
I0307 22:39:25.383596 203173 cri.go:89] found id: ""
I0307 22:39:25.383604 203173 logs.go:276] 2 containers: [14afb08fcf0333a1d360d000f1fa3b158ae712b1b2a3e6c52b164c05245f920d dabbb0b4fd2574e92c3a53182c494ec08df151f99bd21d27189df149b7f8961c]
I0307 22:39:25.383675 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.387470 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.390779 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0307 22:39:25.390841 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0307 22:39:25.437462 203173 cri.go:89] found id: "413452dbe13bfb277303d92484791aa53ae9a198a089364135d2347bf8475623"
I0307 22:39:25.437481 203173 cri.go:89] found id: "a105c02644c9c901090c4c9792a32b0396cee09395513751eeb1be7fbf4b8477"
I0307 22:39:25.437486 203173 cri.go:89] found id: ""
I0307 22:39:25.437493 203173 logs.go:276] 2 containers: [413452dbe13bfb277303d92484791aa53ae9a198a089364135d2347bf8475623 a105c02644c9c901090c4c9792a32b0396cee09395513751eeb1be7fbf4b8477]
I0307 22:39:25.437547 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.441300 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.444236 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0307 22:39:25.444346 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0307 22:39:25.486461 203173 cri.go:89] found id: "157ece61e2d99f79b42530111727fc9798a3b91433c5d3a5cd83cefec75a6a67"
I0307 22:39:25.486519 203173 cri.go:89] found id: "2ca89421ca012456f503b4b92ac92a69bf6b0042461af4e2e3140e7adb8b27dc"
I0307 22:39:25.486538 203173 cri.go:89] found id: ""
I0307 22:39:25.486552 203173 logs.go:276] 2 containers: [157ece61e2d99f79b42530111727fc9798a3b91433c5d3a5cd83cefec75a6a67 2ca89421ca012456f503b4b92ac92a69bf6b0042461af4e2e3140e7adb8b27dc]
I0307 22:39:25.486610 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.490758 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.494081 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0307 22:39:25.494191 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0307 22:39:25.533954 203173 cri.go:89] found id: "7998095a37dd2896f96215e8ab5d29ae495d3dc1a00b119506f8ace55156b07a"
I0307 22:39:25.534016 203173 cri.go:89] found id: "f1df99d1a705a4556e4be13c16d400b99149438c96bfe6da863b8b041983b036"
I0307 22:39:25.534046 203173 cri.go:89] found id: ""
I0307 22:39:25.534060 203173 logs.go:276] 2 containers: [7998095a37dd2896f96215e8ab5d29ae495d3dc1a00b119506f8ace55156b07a f1df99d1a705a4556e4be13c16d400b99149438c96bfe6da863b8b041983b036]
I0307 22:39:25.534121 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.537826 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.542894 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0307 22:39:25.543014 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0307 22:39:25.585812 203173 cri.go:89] found id: "9ba0a9f80bc7b1866c7509e8df81dcc0d3e74b8702a84d7676660a9395cf59fc"
I0307 22:39:25.585836 203173 cri.go:89] found id: "bd7a60d8d4f26067debaaf5b2c23fe94dcfed76118b17104051bc8c755b35ce1"
I0307 22:39:25.585842 203173 cri.go:89] found id: ""
I0307 22:39:25.585855 203173 logs.go:276] 2 containers: [9ba0a9f80bc7b1866c7509e8df81dcc0d3e74b8702a84d7676660a9395cf59fc bd7a60d8d4f26067debaaf5b2c23fe94dcfed76118b17104051bc8c755b35ce1]
I0307 22:39:25.585922 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.589442 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.592832 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0307 22:39:25.592923 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0307 22:39:25.636509 203173 cri.go:89] found id: "2543aa094e87373b5f846e8bdc2bbadbdda2c55f6d326c6db6b9216375dde5e6"
I0307 22:39:25.636533 203173 cri.go:89] found id: "e9768721745ab392d0ad14d4055c5cf01cc780491a01953b4b45bf77d2d3b062"
I0307 22:39:25.636538 203173 cri.go:89] found id: ""
I0307 22:39:25.636545 203173 logs.go:276] 2 containers: [2543aa094e87373b5f846e8bdc2bbadbdda2c55f6d326c6db6b9216375dde5e6 e9768721745ab392d0ad14d4055c5cf01cc780491a01953b4b45bf77d2d3b062]
I0307 22:39:25.636619 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.640672 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.644632 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0307 22:39:25.644725 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0307 22:39:25.685799 203173 cri.go:89] found id: "778e16c451c2e6a7fecd1d1b5d37778e92f50fd757af7d8812222cfa025fdc86"
I0307 22:39:25.685822 203173 cri.go:89] found id: ""
I0307 22:39:25.685830 203173 logs.go:276] 1 containers: [778e16c451c2e6a7fecd1d1b5d37778e92f50fd757af7d8812222cfa025fdc86]
I0307 22:39:25.685911 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.689934 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0307 22:39:25.690008 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0307 22:39:25.727726 203173 cri.go:89] found id: "426c41631cb95479682cbd7b19483427f710b2f7932b9e6d2bc0367710c2ca1d"
I0307 22:39:25.727753 203173 cri.go:89] found id: "f98ff695720f5ebea06fa188196a8a6393c29dfd0211d4a0ec784c54cbb9f906"
I0307 22:39:25.727758 203173 cri.go:89] found id: ""
I0307 22:39:25.727766 203173 logs.go:276] 2 containers: [426c41631cb95479682cbd7b19483427f710b2f7932b9e6d2bc0367710c2ca1d f98ff695720f5ebea06fa188196a8a6393c29dfd0211d4a0ec784c54cbb9f906]
I0307 22:39:25.727867 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.731423 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:25.735053 203173 logs.go:123] Gathering logs for containerd ...
I0307 22:39:25.735120 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0307 22:39:25.796794 203173 logs.go:123] Gathering logs for etcd [14afb08fcf0333a1d360d000f1fa3b158ae712b1b2a3e6c52b164c05245f920d] ...
I0307 22:39:25.796828 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 14afb08fcf0333a1d360d000f1fa3b158ae712b1b2a3e6c52b164c05245f920d"
I0307 22:39:25.841590 203173 logs.go:123] Gathering logs for kube-scheduler [157ece61e2d99f79b42530111727fc9798a3b91433c5d3a5cd83cefec75a6a67] ...
I0307 22:39:25.841620 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 157ece61e2d99f79b42530111727fc9798a3b91433c5d3a5cd83cefec75a6a67"
I0307 22:39:25.886268 203173 logs.go:123] Gathering logs for kube-proxy [7998095a37dd2896f96215e8ab5d29ae495d3dc1a00b119506f8ace55156b07a] ...
I0307 22:39:25.886343 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7998095a37dd2896f96215e8ab5d29ae495d3dc1a00b119506f8ace55156b07a"
I0307 22:39:25.924898 203173 logs.go:123] Gathering logs for kube-scheduler [2ca89421ca012456f503b4b92ac92a69bf6b0042461af4e2e3140e7adb8b27dc] ...
I0307 22:39:25.924972 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2ca89421ca012456f503b4b92ac92a69bf6b0042461af4e2e3140e7adb8b27dc"
I0307 22:39:25.970416 203173 logs.go:123] Gathering logs for kindnet [2543aa094e87373b5f846e8bdc2bbadbdda2c55f6d326c6db6b9216375dde5e6] ...
I0307 22:39:25.970447 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2543aa094e87373b5f846e8bdc2bbadbdda2c55f6d326c6db6b9216375dde5e6"
I0307 22:39:26.015966 203173 logs.go:123] Gathering logs for kindnet [e9768721745ab392d0ad14d4055c5cf01cc780491a01953b4b45bf77d2d3b062] ...
I0307 22:39:26.015998 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e9768721745ab392d0ad14d4055c5cf01cc780491a01953b4b45bf77d2d3b062"
I0307 22:39:26.070164 203173 logs.go:123] Gathering logs for kubernetes-dashboard [778e16c451c2e6a7fecd1d1b5d37778e92f50fd757af7d8812222cfa025fdc86] ...
I0307 22:39:26.070190 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 778e16c451c2e6a7fecd1d1b5d37778e92f50fd757af7d8812222cfa025fdc86"
I0307 22:39:26.111136 203173 logs.go:123] Gathering logs for container status ...
I0307 22:39:26.111163 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0307 22:39:26.163682 203173 logs.go:123] Gathering logs for dmesg ...
I0307 22:39:26.163711 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0307 22:39:26.181702 203173 logs.go:123] Gathering logs for kube-apiserver [cc2db588ff857bfb95417bfc8b125ca64e6caba952ba4acd81ec27522fde3127] ...
I0307 22:39:26.181732 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cc2db588ff857bfb95417bfc8b125ca64e6caba952ba4acd81ec27522fde3127"
I0307 22:39:26.246451 203173 logs.go:123] Gathering logs for coredns [413452dbe13bfb277303d92484791aa53ae9a198a089364135d2347bf8475623] ...
I0307 22:39:26.246483 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 413452dbe13bfb277303d92484791aa53ae9a198a089364135d2347bf8475623"
I0307 22:39:26.295840 203173 logs.go:123] Gathering logs for kube-proxy [f1df99d1a705a4556e4be13c16d400b99149438c96bfe6da863b8b041983b036] ...
I0307 22:39:26.295868 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f1df99d1a705a4556e4be13c16d400b99149438c96bfe6da863b8b041983b036"
I0307 22:39:26.341619 203173 logs.go:123] Gathering logs for kube-controller-manager [bd7a60d8d4f26067debaaf5b2c23fe94dcfed76118b17104051bc8c755b35ce1] ...
I0307 22:39:26.341646 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bd7a60d8d4f26067debaaf5b2c23fe94dcfed76118b17104051bc8c755b35ce1"
I0307 22:39:26.408963 203173 logs.go:123] Gathering logs for kubelet ...
I0307 22:39:26.408996 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0307 22:39:26.472507 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:05 old-k8s-version-497253 kubelet[660]: E0307 22:34:05.261951 660 reflector.go:138] object-"kube-system"/"kindnet-token-ghqhd": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-ghqhd" is forbidden: User "system:node:old-k8s-version-497253" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-497253' and this object
W0307 22:39:26.479496 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:07 old-k8s-version-497253 kubelet[660]: E0307 22:34:07.162816 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0307 22:39:26.479691 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:07 old-k8s-version-497253 kubelet[660]: E0307 22:34:07.277655 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.482575 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:22 old-k8s-version-497253 kubelet[660]: E0307 22:34:22.936411 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0307 22:39:26.484741 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:36 old-k8s-version-497253 kubelet[660]: E0307 22:34:36.920792 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.485205 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:37 old-k8s-version-497253 kubelet[660]: E0307 22:34:37.462923 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.485558 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:38 old-k8s-version-497253 kubelet[660]: E0307 22:34:38.465991 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.486058 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:39 old-k8s-version-497253 kubelet[660]: E0307 22:34:39.469998 660 pod_workers.go:191] Error syncing pod f477a573-d9fd-4235-84a6-32e52bea48e1 ("storage-provisioner_kube-system(f477a573-d9fd-4235-84a6-32e52bea48e1)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(f477a573-d9fd-4235-84a6-32e52bea48e1)"
W0307 22:39:26.486394 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:41 old-k8s-version-497253 kubelet[660]: E0307 22:34:41.449013 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.489348 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:51 old-k8s-version-497253 kubelet[660]: E0307 22:34:51.926704 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0307 22:39:26.489941 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:54 old-k8s-version-497253 kubelet[660]: E0307 22:34:54.505288 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.490272 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:01 old-k8s-version-497253 kubelet[660]: E0307 22:35:01.448994 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.490457 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:02 old-k8s-version-497253 kubelet[660]: E0307 22:35:02.915003 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.490785 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:12 old-k8s-version-497253 kubelet[660]: E0307 22:35:12.922852 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.490970 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:14 old-k8s-version-497253 kubelet[660]: E0307 22:35:14.914572 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.491560 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:25 old-k8s-version-497253 kubelet[660]: E0307 22:35:25.578672 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.491748 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:26 old-k8s-version-497253 kubelet[660]: E0307 22:35:26.918579 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.492079 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:31 old-k8s-version-497253 kubelet[660]: E0307 22:35:31.448901 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.494548 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:39 old-k8s-version-497253 kubelet[660]: E0307 22:35:39.938727 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0307 22:39:26.494876 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:46 old-k8s-version-497253 kubelet[660]: E0307 22:35:46.914538 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.495064 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:53 old-k8s-version-497253 kubelet[660]: E0307 22:35:53.914358 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.495392 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:00 old-k8s-version-497253 kubelet[660]: E0307 22:36:00.917774 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.495577 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:05 old-k8s-version-497253 kubelet[660]: E0307 22:36:05.914412 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.496168 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:15 old-k8s-version-497253 kubelet[660]: E0307 22:36:15.682987 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.496383 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:18 old-k8s-version-497253 kubelet[660]: E0307 22:36:18.914367 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.496715 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:21 old-k8s-version-497253 kubelet[660]: E0307 22:36:21.449525 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.496902 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:31 old-k8s-version-497253 kubelet[660]: E0307 22:36:31.914470 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.497228 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:33 old-k8s-version-497253 kubelet[660]: E0307 22:36:33.914221 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.497446 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:42 old-k8s-version-497253 kubelet[660]: E0307 22:36:42.914696 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.497795 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:45 old-k8s-version-497253 kubelet[660]: E0307 22:36:45.914100 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.497981 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:57 old-k8s-version-497253 kubelet[660]: E0307 22:36:57.914372 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.498309 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:58 old-k8s-version-497253 kubelet[660]: E0307 22:36:58.914093 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.498659 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:10 old-k8s-version-497253 kubelet[660]: E0307 22:37:10.914874 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.501139 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:10 old-k8s-version-497253 kubelet[660]: E0307 22:37:10.928532 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0307 22:39:26.501328 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:21 old-k8s-version-497253 kubelet[660]: E0307 22:37:21.914234 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.501658 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:23 old-k8s-version-497253 kubelet[660]: E0307 22:37:23.914014 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.501850 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:33 old-k8s-version-497253 kubelet[660]: E0307 22:37:33.914590 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.502442 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:37 old-k8s-version-497253 kubelet[660]: E0307 22:37:37.858788 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.502771 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:41 old-k8s-version-497253 kubelet[660]: E0307 22:37:41.449456 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.502959 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:46 old-k8s-version-497253 kubelet[660]: E0307 22:37:46.917492 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.503286 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:56 old-k8s-version-497253 kubelet[660]: E0307 22:37:56.914065 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.503470 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:57 old-k8s-version-497253 kubelet[660]: E0307 22:37:57.915061 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.503655 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:09 old-k8s-version-497253 kubelet[660]: E0307 22:38:09.914552 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.503988 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:11 old-k8s-version-497253 kubelet[660]: E0307 22:38:11.913955 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.504175 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:23 old-k8s-version-497253 kubelet[660]: E0307 22:38:23.914295 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.504556 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:26 old-k8s-version-497253 kubelet[660]: E0307 22:38:26.914365 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.504744 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:35 old-k8s-version-497253 kubelet[660]: E0307 22:38:35.914352 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.505086 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:38 old-k8s-version-497253 kubelet[660]: E0307 22:38:38.914978 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.505272 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:48 old-k8s-version-497253 kubelet[660]: E0307 22:38:48.914308 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.505628 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:50 old-k8s-version-497253 kubelet[660]: E0307 22:38:50.914584 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.505961 203173 logs.go:138] Found kubelet problem: Mar 07 22:39:01 old-k8s-version-497253 kubelet[660]: E0307 22:39:01.914578 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.506151 203173 logs.go:138] Found kubelet problem: Mar 07 22:39:03 old-k8s-version-497253 kubelet[660]: E0307 22:39:03.914427 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.506484 203173 logs.go:138] Found kubelet problem: Mar 07 22:39:15 old-k8s-version-497253 kubelet[660]: E0307 22:39:15.913973 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.506668 203173 logs.go:138] Found kubelet problem: Mar 07 22:39:16 old-k8s-version-497253 kubelet[660]: E0307 22:39:16.918241 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0307 22:39:26.506680 203173 logs.go:123] Gathering logs for kube-apiserver [8b2ed0287cc5bbf594cda29d926ae828c7d6d12ad490285c6e855c8824388d29] ...
I0307 22:39:26.506725 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8b2ed0287cc5bbf594cda29d926ae828c7d6d12ad490285c6e855c8824388d29"
I0307 22:39:26.567581 203173 logs.go:123] Gathering logs for coredns [a105c02644c9c901090c4c9792a32b0396cee09395513751eeb1be7fbf4b8477] ...
I0307 22:39:26.567616 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a105c02644c9c901090c4c9792a32b0396cee09395513751eeb1be7fbf4b8477"
I0307 22:39:26.617169 203173 logs.go:123] Gathering logs for storage-provisioner [426c41631cb95479682cbd7b19483427f710b2f7932b9e6d2bc0367710c2ca1d] ...
I0307 22:39:26.617197 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 426c41631cb95479682cbd7b19483427f710b2f7932b9e6d2bc0367710c2ca1d"
I0307 22:39:26.667945 203173 logs.go:123] Gathering logs for storage-provisioner [f98ff695720f5ebea06fa188196a8a6393c29dfd0211d4a0ec784c54cbb9f906] ...
I0307 22:39:26.667973 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f98ff695720f5ebea06fa188196a8a6393c29dfd0211d4a0ec784c54cbb9f906"
I0307 22:39:26.707720 203173 logs.go:123] Gathering logs for describe nodes ...
I0307 22:39:26.707752 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0307 22:39:26.855434 203173 logs.go:123] Gathering logs for etcd [dabbb0b4fd2574e92c3a53182c494ec08df151f99bd21d27189df149b7f8961c] ...
I0307 22:39:26.855466 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dabbb0b4fd2574e92c3a53182c494ec08df151f99bd21d27189df149b7f8961c"
I0307 22:39:26.907427 203173 logs.go:123] Gathering logs for kube-controller-manager [9ba0a9f80bc7b1866c7509e8df81dcc0d3e74b8702a84d7676660a9395cf59fc] ...
I0307 22:39:26.907454 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9ba0a9f80bc7b1866c7509e8df81dcc0d3e74b8702a84d7676660a9395cf59fc"
I0307 22:39:26.977630 203173 out.go:304] Setting ErrFile to fd 2...
I0307 22:39:26.977706 203173 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0307 22:39:26.977771 203173 out.go:239] X Problems detected in kubelet:
W0307 22:39:26.977934 203173 out.go:239] Mar 07 22:38:50 old-k8s-version-497253 kubelet[660]: E0307 22:38:50.914584 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.977983 203173 out.go:239] Mar 07 22:39:01 old-k8s-version-497253 kubelet[660]: E0307 22:39:01.914578 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.978041 203173 out.go:239] Mar 07 22:39:03 old-k8s-version-497253 kubelet[660]: E0307 22:39:03.914427 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:26.978077 203173 out.go:239] Mar 07 22:39:15 old-k8s-version-497253 kubelet[660]: E0307 22:39:15.913973 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:26.978110 203173 out.go:239] Mar 07 22:39:16 old-k8s-version-497253 kubelet[660]: E0307 22:39:16.918241 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0307 22:39:26.978155 203173 out.go:304] Setting ErrFile to fd 2...
I0307 22:39:26.978179 203173 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 22:39:27.145828 208512 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0307 22:39:27.153472 208512 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0307 22:39:27.154680 208512 api_server.go:141] control plane version: v1.29.0-rc.2
I0307 22:39:27.154704 208512 api_server.go:131] duration metric: took 4.124792722s to wait for apiserver health ...
I0307 22:39:27.154712 208512 system_pods.go:43] waiting for kube-system pods to appear ...
I0307 22:39:27.154733 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0307 22:39:27.154795 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0307 22:39:27.193045 208512 cri.go:89] found id: "8538ff6a2530eeddd6961ceeea4e8b8f31e001b211f6b0e42b463f41bfc8eb9b"
I0307 22:39:27.193067 208512 cri.go:89] found id: "3ad41b9769064eab5e8003ea9de4b5b9f58af6a4d81413a5083b9b5abc308170"
I0307 22:39:27.193072 208512 cri.go:89] found id: ""
I0307 22:39:27.193079 208512 logs.go:276] 2 containers: [8538ff6a2530eeddd6961ceeea4e8b8f31e001b211f6b0e42b463f41bfc8eb9b 3ad41b9769064eab5e8003ea9de4b5b9f58af6a4d81413a5083b9b5abc308170]
I0307 22:39:27.193139 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:27.196788 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:27.200449 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0307 22:39:27.200547 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0307 22:39:27.246704 208512 cri.go:89] found id: "8d3da2ccfc6f3e03a090f259d264c023c0220868e0038f3aab52d0bee1e0f788"
I0307 22:39:27.246727 208512 cri.go:89] found id: "61d3947cf55d680139b701ec61051f9ada8b04b18e981f05adeac9a4a7a67d89"
I0307 22:39:27.246732 208512 cri.go:89] found id: ""
I0307 22:39:27.246739 208512 logs.go:276] 2 containers: [8d3da2ccfc6f3e03a090f259d264c023c0220868e0038f3aab52d0bee1e0f788 61d3947cf55d680139b701ec61051f9ada8b04b18e981f05adeac9a4a7a67d89]
I0307 22:39:27.246793 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:27.251566 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:27.255110 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0307 22:39:27.255188 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0307 22:39:27.295321 208512 cri.go:89] found id: "66c0213f3c233ac7b951a4b86aab5ef89cc56a2ca5499180954b801d7ed742d1"
I0307 22:39:27.295345 208512 cri.go:89] found id: "cd25d5f2cd96fffd3dc549470243d20ea7e47ef4dcd423227a4a52724f521183"
I0307 22:39:27.295350 208512 cri.go:89] found id: ""
I0307 22:39:27.295357 208512 logs.go:276] 2 containers: [66c0213f3c233ac7b951a4b86aab5ef89cc56a2ca5499180954b801d7ed742d1 cd25d5f2cd96fffd3dc549470243d20ea7e47ef4dcd423227a4a52724f521183]
I0307 22:39:27.295410 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:27.299533 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:27.303015 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0307 22:39:27.303089 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0307 22:39:27.349488 208512 cri.go:89] found id: "ddaf309f6c6682b8d155b529ee31ae4f0dce1a6a9763127da6df7fdbbd31a16d"
I0307 22:39:27.349512 208512 cri.go:89] found id: "da7081019e6f16e832848ada7b2e006667f931fc538edab6b1ebd551fa208cbe"
I0307 22:39:27.349521 208512 cri.go:89] found id: ""
I0307 22:39:27.349529 208512 logs.go:276] 2 containers: [ddaf309f6c6682b8d155b529ee31ae4f0dce1a6a9763127da6df7fdbbd31a16d da7081019e6f16e832848ada7b2e006667f931fc538edab6b1ebd551fa208cbe]
I0307 22:39:27.349597 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:27.353355 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:27.356796 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0307 22:39:27.356881 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0307 22:39:27.405902 208512 cri.go:89] found id: "7c807963c5849afb9cda04a10c0ba18eb4139242b1caf7d11205fa10706faf36"
I0307 22:39:27.405938 208512 cri.go:89] found id: "775c4272397dc700a1daf97c4e663e7fc3f71729356cee17bd4235ddf6daa2a3"
I0307 22:39:27.405943 208512 cri.go:89] found id: ""
I0307 22:39:27.405951 208512 logs.go:276] 2 containers: [7c807963c5849afb9cda04a10c0ba18eb4139242b1caf7d11205fa10706faf36 775c4272397dc700a1daf97c4e663e7fc3f71729356cee17bd4235ddf6daa2a3]
I0307 22:39:27.406059 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:27.410551 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:27.418132 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0307 22:39:27.418235 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0307 22:39:27.457792 208512 cri.go:89] found id: "bf0796c3bdeb1fb7cbeadd653a03514f86b475a0faf4571351606a60b1da8a91"
I0307 22:39:27.457873 208512 cri.go:89] found id: "a52fdbe185cf6604953f1db9bf33ddda100e7929d29ddd019abb2c4f628ccf8a"
I0307 22:39:27.457885 208512 cri.go:89] found id: ""
I0307 22:39:27.457894 208512 logs.go:276] 2 containers: [bf0796c3bdeb1fb7cbeadd653a03514f86b475a0faf4571351606a60b1da8a91 a52fdbe185cf6604953f1db9bf33ddda100e7929d29ddd019abb2c4f628ccf8a]
I0307 22:39:27.457950 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:27.462384 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:27.465848 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0307 22:39:27.465922 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0307 22:39:27.505688 208512 cri.go:89] found id: "20752f16c26ce3f933b39f1e042151aa9c6c927a788b023f74cd5e26eb4e9dea"
I0307 22:39:27.505710 208512 cri.go:89] found id: "988c7824310b34904cc0fcc89dceab6a97539faa8b8f508cbcbbdf112c8521fb"
I0307 22:39:27.505715 208512 cri.go:89] found id: ""
I0307 22:39:27.505723 208512 logs.go:276] 2 containers: [20752f16c26ce3f933b39f1e042151aa9c6c927a788b023f74cd5e26eb4e9dea 988c7824310b34904cc0fcc89dceab6a97539faa8b8f508cbcbbdf112c8521fb]
I0307 22:39:27.505777 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:27.510061 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:27.514254 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0307 22:39:27.514325 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0307 22:39:27.556909 208512 cri.go:89] found id: "15345923272f30bf45fa6edcd96846838ad863ca72c9fe79a0ec5ca8d5c28a7e"
I0307 22:39:27.556943 208512 cri.go:89] found id: ""
I0307 22:39:27.556952 208512 logs.go:276] 1 containers: [15345923272f30bf45fa6edcd96846838ad863ca72c9fe79a0ec5ca8d5c28a7e]
I0307 22:39:27.557005 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:27.560920 208512 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0307 22:39:27.560999 208512 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0307 22:39:27.603029 208512 cri.go:89] found id: "ac29cd6286420edd0596fdc8868b3ee5d6b7b98bc806044fb91e4e443a93b393"
I0307 22:39:27.603055 208512 cri.go:89] found id: "3e0ca1a11903bcbc026af5c35f9936a9948e4225c5df356b916422ffc52a02b8"
I0307 22:39:27.603061 208512 cri.go:89] found id: ""
I0307 22:39:27.603068 208512 logs.go:276] 2 containers: [ac29cd6286420edd0596fdc8868b3ee5d6b7b98bc806044fb91e4e443a93b393 3e0ca1a11903bcbc026af5c35f9936a9948e4225c5df356b916422ffc52a02b8]
I0307 22:39:27.603122 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:27.606583 208512 ssh_runner.go:195] Run: which crictl
I0307 22:39:27.610185 208512 logs.go:123] Gathering logs for kube-scheduler [ddaf309f6c6682b8d155b529ee31ae4f0dce1a6a9763127da6df7fdbbd31a16d] ...
I0307 22:39:27.610219 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ddaf309f6c6682b8d155b529ee31ae4f0dce1a6a9763127da6df7fdbbd31a16d"
I0307 22:39:27.659712 208512 logs.go:123] Gathering logs for dmesg ...
I0307 22:39:27.659783 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0307 22:39:27.677490 208512 logs.go:123] Gathering logs for describe nodes ...
I0307 22:39:27.677519 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0307 22:39:27.801447 208512 logs.go:123] Gathering logs for kube-proxy [775c4272397dc700a1daf97c4e663e7fc3f71729356cee17bd4235ddf6daa2a3] ...
I0307 22:39:27.801480 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 775c4272397dc700a1daf97c4e663e7fc3f71729356cee17bd4235ddf6daa2a3"
I0307 22:39:27.848958 208512 logs.go:123] Gathering logs for kindnet [988c7824310b34904cc0fcc89dceab6a97539faa8b8f508cbcbbdf112c8521fb] ...
I0307 22:39:27.848985 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 988c7824310b34904cc0fcc89dceab6a97539faa8b8f508cbcbbdf112c8521fb"
I0307 22:39:27.889814 208512 logs.go:123] Gathering logs for kubelet ...
I0307 22:39:27.889843 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0307 22:39:27.965467 208512 logs.go:123] Gathering logs for kube-apiserver [8538ff6a2530eeddd6961ceeea4e8b8f31e001b211f6b0e42b463f41bfc8eb9b] ...
I0307 22:39:27.965507 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8538ff6a2530eeddd6961ceeea4e8b8f31e001b211f6b0e42b463f41bfc8eb9b"
I0307 22:39:28.028155 208512 logs.go:123] Gathering logs for kube-proxy [7c807963c5849afb9cda04a10c0ba18eb4139242b1caf7d11205fa10706faf36] ...
I0307 22:39:28.028194 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7c807963c5849afb9cda04a10c0ba18eb4139242b1caf7d11205fa10706faf36"
I0307 22:39:28.073330 208512 logs.go:123] Gathering logs for kube-controller-manager [a52fdbe185cf6604953f1db9bf33ddda100e7929d29ddd019abb2c4f628ccf8a] ...
I0307 22:39:28.073357 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a52fdbe185cf6604953f1db9bf33ddda100e7929d29ddd019abb2c4f628ccf8a"
I0307 22:39:28.150355 208512 logs.go:123] Gathering logs for kindnet [20752f16c26ce3f933b39f1e042151aa9c6c927a788b023f74cd5e26eb4e9dea] ...
I0307 22:39:28.150387 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 20752f16c26ce3f933b39f1e042151aa9c6c927a788b023f74cd5e26eb4e9dea"
I0307 22:39:28.194285 208512 logs.go:123] Gathering logs for kubernetes-dashboard [15345923272f30bf45fa6edcd96846838ad863ca72c9fe79a0ec5ca8d5c28a7e] ...
I0307 22:39:28.194316 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 15345923272f30bf45fa6edcd96846838ad863ca72c9fe79a0ec5ca8d5c28a7e"
I0307 22:39:28.233518 208512 logs.go:123] Gathering logs for storage-provisioner [3e0ca1a11903bcbc026af5c35f9936a9948e4225c5df356b916422ffc52a02b8] ...
I0307 22:39:28.233551 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3e0ca1a11903bcbc026af5c35f9936a9948e4225c5df356b916422ffc52a02b8"
I0307 22:39:28.275721 208512 logs.go:123] Gathering logs for container status ...
I0307 22:39:28.275754 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0307 22:39:28.327836 208512 logs.go:123] Gathering logs for kube-apiserver [3ad41b9769064eab5e8003ea9de4b5b9f58af6a4d81413a5083b9b5abc308170] ...
I0307 22:39:28.327868 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3ad41b9769064eab5e8003ea9de4b5b9f58af6a4d81413a5083b9b5abc308170"
I0307 22:39:28.374408 208512 logs.go:123] Gathering logs for kube-scheduler [da7081019e6f16e832848ada7b2e006667f931fc538edab6b1ebd551fa208cbe] ...
I0307 22:39:28.374441 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 da7081019e6f16e832848ada7b2e006667f931fc538edab6b1ebd551fa208cbe"
I0307 22:39:28.420692 208512 logs.go:123] Gathering logs for coredns [66c0213f3c233ac7b951a4b86aab5ef89cc56a2ca5499180954b801d7ed742d1] ...
I0307 22:39:28.420724 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 66c0213f3c233ac7b951a4b86aab5ef89cc56a2ca5499180954b801d7ed742d1"
I0307 22:39:28.461500 208512 logs.go:123] Gathering logs for coredns [cd25d5f2cd96fffd3dc549470243d20ea7e47ef4dcd423227a4a52724f521183] ...
I0307 22:39:28.461530 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cd25d5f2cd96fffd3dc549470243d20ea7e47ef4dcd423227a4a52724f521183"
I0307 22:39:28.498755 208512 logs.go:123] Gathering logs for kube-controller-manager [bf0796c3bdeb1fb7cbeadd653a03514f86b475a0faf4571351606a60b1da8a91] ...
I0307 22:39:28.498786 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bf0796c3bdeb1fb7cbeadd653a03514f86b475a0faf4571351606a60b1da8a91"
I0307 22:39:28.559697 208512 logs.go:123] Gathering logs for storage-provisioner [ac29cd6286420edd0596fdc8868b3ee5d6b7b98bc806044fb91e4e443a93b393] ...
I0307 22:39:28.559734 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ac29cd6286420edd0596fdc8868b3ee5d6b7b98bc806044fb91e4e443a93b393"
I0307 22:39:28.606479 208512 logs.go:123] Gathering logs for containerd ...
I0307 22:39:28.606506 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0307 22:39:28.678573 208512 logs.go:123] Gathering logs for etcd [8d3da2ccfc6f3e03a090f259d264c023c0220868e0038f3aab52d0bee1e0f788] ...
I0307 22:39:28.678619 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8d3da2ccfc6f3e03a090f259d264c023c0220868e0038f3aab52d0bee1e0f788"
I0307 22:39:28.728077 208512 logs.go:123] Gathering logs for etcd [61d3947cf55d680139b701ec61051f9ada8b04b18e981f05adeac9a4a7a67d89] ...
I0307 22:39:28.728113 208512 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 61d3947cf55d680139b701ec61051f9ada8b04b18e981f05adeac9a4a7a67d89"
I0307 22:39:31.284024 208512 system_pods.go:59] 9 kube-system pods found
I0307 22:39:31.284056 208512 system_pods.go:61] "coredns-76f75df574-w5rmw" [0251e6d2-6b13-4f2a-be14-0f5f5c9f2d06] Running
I0307 22:39:31.284062 208512 system_pods.go:61] "etcd-no-preload-767597" [0c594181-bb51-41e5-81fa-757eb754f8c4] Running
I0307 22:39:31.284067 208512 system_pods.go:61] "kindnet-pgvkb" [af4ef8bb-b524-4d21-9b05-fae30994c410] Running
I0307 22:39:31.284071 208512 system_pods.go:61] "kube-apiserver-no-preload-767597" [49192b5e-9e73-458b-9662-7fdc410ccc89] Running
I0307 22:39:31.284075 208512 system_pods.go:61] "kube-controller-manager-no-preload-767597" [7f49d455-b0be-43fc-aed2-ea65addd5aaa] Running
I0307 22:39:31.284079 208512 system_pods.go:61] "kube-proxy-d69xl" [2b00fe4a-4082-49b2-afac-955aa21f2d85] Running
I0307 22:39:31.284083 208512 system_pods.go:61] "kube-scheduler-no-preload-767597" [e5152d4a-e849-4097-b447-6de2df64196a] Running
I0307 22:39:31.284090 208512 system_pods.go:61] "metrics-server-57f55c9bc5-wgs49" [87cee0d4-cd14-4683-8b66-946fbd076723] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0307 22:39:31.284097 208512 system_pods.go:61] "storage-provisioner" [dd205484-4bb1-4fe8-b527-1e8597023472] Running
I0307 22:39:31.284104 208512 system_pods.go:74] duration metric: took 4.129385401s to wait for pod list to return data ...
I0307 22:39:31.284120 208512 default_sa.go:34] waiting for default service account to be created ...
I0307 22:39:31.287403 208512 default_sa.go:45] found service account: "default"
I0307 22:39:31.287431 208512 default_sa.go:55] duration metric: took 3.30235ms for default service account to be created ...
I0307 22:39:31.287442 208512 system_pods.go:116] waiting for k8s-apps to be running ...
I0307 22:39:31.293986 208512 system_pods.go:86] 9 kube-system pods found
I0307 22:39:31.294017 208512 system_pods.go:89] "coredns-76f75df574-w5rmw" [0251e6d2-6b13-4f2a-be14-0f5f5c9f2d06] Running
I0307 22:39:31.294024 208512 system_pods.go:89] "etcd-no-preload-767597" [0c594181-bb51-41e5-81fa-757eb754f8c4] Running
I0307 22:39:31.294028 208512 system_pods.go:89] "kindnet-pgvkb" [af4ef8bb-b524-4d21-9b05-fae30994c410] Running
I0307 22:39:31.294032 208512 system_pods.go:89] "kube-apiserver-no-preload-767597" [49192b5e-9e73-458b-9662-7fdc410ccc89] Running
I0307 22:39:31.294037 208512 system_pods.go:89] "kube-controller-manager-no-preload-767597" [7f49d455-b0be-43fc-aed2-ea65addd5aaa] Running
I0307 22:39:31.294042 208512 system_pods.go:89] "kube-proxy-d69xl" [2b00fe4a-4082-49b2-afac-955aa21f2d85] Running
I0307 22:39:31.294047 208512 system_pods.go:89] "kube-scheduler-no-preload-767597" [e5152d4a-e849-4097-b447-6de2df64196a] Running
I0307 22:39:31.294054 208512 system_pods.go:89] "metrics-server-57f55c9bc5-wgs49" [87cee0d4-cd14-4683-8b66-946fbd076723] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0307 22:39:31.294062 208512 system_pods.go:89] "storage-provisioner" [dd205484-4bb1-4fe8-b527-1e8597023472] Running
I0307 22:39:31.294071 208512 system_pods.go:126] duration metric: took 6.624376ms to wait for k8s-apps to be running ...
I0307 22:39:31.294087 208512 system_svc.go:44] waiting for kubelet service to be running ....
I0307 22:39:31.294145 208512 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0307 22:39:31.306384 208512 system_svc.go:56] duration metric: took 12.287108ms WaitForService to wait for kubelet
I0307 22:39:31.306412 208512 kubeadm.go:576] duration metric: took 4m18.022773321s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0307 22:39:31.306434 208512 node_conditions.go:102] verifying NodePressure condition ...
I0307 22:39:31.310148 208512 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0307 22:39:31.310179 208512 node_conditions.go:123] node cpu capacity is 2
I0307 22:39:31.310191 208512 node_conditions.go:105] duration metric: took 3.751234ms to run NodePressure ...
I0307 22:39:31.310203 208512 start.go:240] waiting for startup goroutines ...
I0307 22:39:31.310210 208512 start.go:245] waiting for cluster config update ...
I0307 22:39:31.310221 208512 start.go:254] writing updated cluster config ...
I0307 22:39:31.310521 208512 ssh_runner.go:195] Run: rm -f paused
I0307 22:39:31.378749 208512 start.go:600] kubectl: 1.29.2, cluster: 1.29.0-rc.2 (minor skew: 0)
I0307 22:39:31.382202 208512 out.go:177] * Done! kubectl is now configured to use "no-preload-767597" cluster and "default" namespace by default
I0307 22:39:36.979366 203173 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0307 22:39:36.991646 203173 api_server.go:72] duration metric: took 5m52.144665067s to wait for apiserver process to appear ...
I0307 22:39:36.991674 203173 api_server.go:88] waiting for apiserver healthz status ...
I0307 22:39:36.991726 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0307 22:39:36.991797 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0307 22:39:37.043778 203173 cri.go:89] found id: "8b2ed0287cc5bbf594cda29d926ae828c7d6d12ad490285c6e855c8824388d29"
I0307 22:39:37.043817 203173 cri.go:89] found id: "cc2db588ff857bfb95417bfc8b125ca64e6caba952ba4acd81ec27522fde3127"
I0307 22:39:37.043823 203173 cri.go:89] found id: ""
I0307 22:39:37.043831 203173 logs.go:276] 2 containers: [8b2ed0287cc5bbf594cda29d926ae828c7d6d12ad490285c6e855c8824388d29 cc2db588ff857bfb95417bfc8b125ca64e6caba952ba4acd81ec27522fde3127]
I0307 22:39:37.043902 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.049541 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.054684 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0307 22:39:37.054809 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0307 22:39:37.100838 203173 cri.go:89] found id: "14afb08fcf0333a1d360d000f1fa3b158ae712b1b2a3e6c52b164c05245f920d"
I0307 22:39:37.100860 203173 cri.go:89] found id: "dabbb0b4fd2574e92c3a53182c494ec08df151f99bd21d27189df149b7f8961c"
I0307 22:39:37.100865 203173 cri.go:89] found id: ""
I0307 22:39:37.100873 203173 logs.go:276] 2 containers: [14afb08fcf0333a1d360d000f1fa3b158ae712b1b2a3e6c52b164c05245f920d dabbb0b4fd2574e92c3a53182c494ec08df151f99bd21d27189df149b7f8961c]
I0307 22:39:37.100932 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.104646 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.108148 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0307 22:39:37.108223 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0307 22:39:37.151349 203173 cri.go:89] found id: "413452dbe13bfb277303d92484791aa53ae9a198a089364135d2347bf8475623"
I0307 22:39:37.151380 203173 cri.go:89] found id: "a105c02644c9c901090c4c9792a32b0396cee09395513751eeb1be7fbf4b8477"
I0307 22:39:37.151386 203173 cri.go:89] found id: ""
I0307 22:39:37.151393 203173 logs.go:276] 2 containers: [413452dbe13bfb277303d92484791aa53ae9a198a089364135d2347bf8475623 a105c02644c9c901090c4c9792a32b0396cee09395513751eeb1be7fbf4b8477]
I0307 22:39:37.151449 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.155102 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.158773 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0307 22:39:37.158875 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0307 22:39:37.197623 203173 cri.go:89] found id: "157ece61e2d99f79b42530111727fc9798a3b91433c5d3a5cd83cefec75a6a67"
I0307 22:39:37.197647 203173 cri.go:89] found id: "2ca89421ca012456f503b4b92ac92a69bf6b0042461af4e2e3140e7adb8b27dc"
I0307 22:39:37.197652 203173 cri.go:89] found id: ""
I0307 22:39:37.197659 203173 logs.go:276] 2 containers: [157ece61e2d99f79b42530111727fc9798a3b91433c5d3a5cd83cefec75a6a67 2ca89421ca012456f503b4b92ac92a69bf6b0042461af4e2e3140e7adb8b27dc]
I0307 22:39:37.197711 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.201264 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.204706 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0307 22:39:37.204782 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0307 22:39:37.244484 203173 cri.go:89] found id: "7998095a37dd2896f96215e8ab5d29ae495d3dc1a00b119506f8ace55156b07a"
I0307 22:39:37.244508 203173 cri.go:89] found id: "f1df99d1a705a4556e4be13c16d400b99149438c96bfe6da863b8b041983b036"
I0307 22:39:37.244513 203173 cri.go:89] found id: ""
I0307 22:39:37.244520 203173 logs.go:276] 2 containers: [7998095a37dd2896f96215e8ab5d29ae495d3dc1a00b119506f8ace55156b07a f1df99d1a705a4556e4be13c16d400b99149438c96bfe6da863b8b041983b036]
I0307 22:39:37.244580 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.248425 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.252613 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0307 22:39:37.252752 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0307 22:39:37.296151 203173 cri.go:89] found id: "9ba0a9f80bc7b1866c7509e8df81dcc0d3e74b8702a84d7676660a9395cf59fc"
I0307 22:39:37.296177 203173 cri.go:89] found id: "bd7a60d8d4f26067debaaf5b2c23fe94dcfed76118b17104051bc8c755b35ce1"
I0307 22:39:37.296182 203173 cri.go:89] found id: ""
I0307 22:39:37.296189 203173 logs.go:276] 2 containers: [9ba0a9f80bc7b1866c7509e8df81dcc0d3e74b8702a84d7676660a9395cf59fc bd7a60d8d4f26067debaaf5b2c23fe94dcfed76118b17104051bc8c755b35ce1]
I0307 22:39:37.296344 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.300120 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.303560 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0307 22:39:37.303657 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0307 22:39:37.341312 203173 cri.go:89] found id: "2543aa094e87373b5f846e8bdc2bbadbdda2c55f6d326c6db6b9216375dde5e6"
I0307 22:39:37.341335 203173 cri.go:89] found id: "e9768721745ab392d0ad14d4055c5cf01cc780491a01953b4b45bf77d2d3b062"
I0307 22:39:37.341341 203173 cri.go:89] found id: ""
I0307 22:39:37.341348 203173 logs.go:276] 2 containers: [2543aa094e87373b5f846e8bdc2bbadbdda2c55f6d326c6db6b9216375dde5e6 e9768721745ab392d0ad14d4055c5cf01cc780491a01953b4b45bf77d2d3b062]
I0307 22:39:37.341404 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.344938 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.348625 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0307 22:39:37.348737 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0307 22:39:37.386014 203173 cri.go:89] found id: "426c41631cb95479682cbd7b19483427f710b2f7932b9e6d2bc0367710c2ca1d"
I0307 22:39:37.386037 203173 cri.go:89] found id: "f98ff695720f5ebea06fa188196a8a6393c29dfd0211d4a0ec784c54cbb9f906"
I0307 22:39:37.386042 203173 cri.go:89] found id: ""
I0307 22:39:37.386049 203173 logs.go:276] 2 containers: [426c41631cb95479682cbd7b19483427f710b2f7932b9e6d2bc0367710c2ca1d f98ff695720f5ebea06fa188196a8a6393c29dfd0211d4a0ec784c54cbb9f906]
I0307 22:39:37.386141 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.390014 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.393469 203173 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0307 22:39:37.393596 203173 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0307 22:39:37.459166 203173 cri.go:89] found id: "778e16c451c2e6a7fecd1d1b5d37778e92f50fd757af7d8812222cfa025fdc86"
I0307 22:39:37.459191 203173 cri.go:89] found id: ""
I0307 22:39:37.459199 203173 logs.go:276] 1 containers: [778e16c451c2e6a7fecd1d1b5d37778e92f50fd757af7d8812222cfa025fdc86]
I0307 22:39:37.459285 203173 ssh_runner.go:195] Run: which crictl
I0307 22:39:37.463408 203173 logs.go:123] Gathering logs for describe nodes ...
I0307 22:39:37.463433 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0307 22:39:37.633708 203173 logs.go:123] Gathering logs for kube-apiserver [cc2db588ff857bfb95417bfc8b125ca64e6caba952ba4acd81ec27522fde3127] ...
I0307 22:39:37.633777 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cc2db588ff857bfb95417bfc8b125ca64e6caba952ba4acd81ec27522fde3127"
I0307 22:39:37.699015 203173 logs.go:123] Gathering logs for etcd [dabbb0b4fd2574e92c3a53182c494ec08df151f99bd21d27189df149b7f8961c] ...
I0307 22:39:37.699048 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dabbb0b4fd2574e92c3a53182c494ec08df151f99bd21d27189df149b7f8961c"
I0307 22:39:37.740792 203173 logs.go:123] Gathering logs for kube-scheduler [157ece61e2d99f79b42530111727fc9798a3b91433c5d3a5cd83cefec75a6a67] ...
I0307 22:39:37.740824 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 157ece61e2d99f79b42530111727fc9798a3b91433c5d3a5cd83cefec75a6a67"
I0307 22:39:37.793158 203173 logs.go:123] Gathering logs for kindnet [2543aa094e87373b5f846e8bdc2bbadbdda2c55f6d326c6db6b9216375dde5e6] ...
I0307 22:39:37.793186 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2543aa094e87373b5f846e8bdc2bbadbdda2c55f6d326c6db6b9216375dde5e6"
I0307 22:39:37.845822 203173 logs.go:123] Gathering logs for kubelet ...
I0307 22:39:37.845849 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0307 22:39:37.901312 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:05 old-k8s-version-497253 kubelet[660]: E0307 22:34:05.261951 660 reflector.go:138] object-"kube-system"/"kindnet-token-ghqhd": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-ghqhd" is forbidden: User "system:node:old-k8s-version-497253" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-497253' and this object
W0307 22:39:37.908351 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:07 old-k8s-version-497253 kubelet[660]: E0307 22:34:07.162816 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0307 22:39:37.908549 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:07 old-k8s-version-497253 kubelet[660]: E0307 22:34:07.277655 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.911329 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:22 old-k8s-version-497253 kubelet[660]: E0307 22:34:22.936411 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0307 22:39:37.913515 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:36 old-k8s-version-497253 kubelet[660]: E0307 22:34:36.920792 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.913980 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:37 old-k8s-version-497253 kubelet[660]: E0307 22:34:37.462923 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.914311 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:38 old-k8s-version-497253 kubelet[660]: E0307 22:34:38.465991 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.914752 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:39 old-k8s-version-497253 kubelet[660]: E0307 22:34:39.469998 660 pod_workers.go:191] Error syncing pod f477a573-d9fd-4235-84a6-32e52bea48e1 ("storage-provisioner_kube-system(f477a573-d9fd-4235-84a6-32e52bea48e1)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(f477a573-d9fd-4235-84a6-32e52bea48e1)"
W0307 22:39:37.915080 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:41 old-k8s-version-497253 kubelet[660]: E0307 22:34:41.449013 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.918016 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:51 old-k8s-version-497253 kubelet[660]: E0307 22:34:51.926704 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0307 22:39:37.918607 203173 logs.go:138] Found kubelet problem: Mar 07 22:34:54 old-k8s-version-497253 kubelet[660]: E0307 22:34:54.505288 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.918933 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:01 old-k8s-version-497253 kubelet[660]: E0307 22:35:01.448994 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.919119 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:02 old-k8s-version-497253 kubelet[660]: E0307 22:35:02.915003 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.919448 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:12 old-k8s-version-497253 kubelet[660]: E0307 22:35:12.922852 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.919635 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:14 old-k8s-version-497253 kubelet[660]: E0307 22:35:14.914572 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.920224 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:25 old-k8s-version-497253 kubelet[660]: E0307 22:35:25.578672 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.920418 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:26 old-k8s-version-497253 kubelet[660]: E0307 22:35:26.918579 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.920747 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:31 old-k8s-version-497253 kubelet[660]: E0307 22:35:31.448901 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.923205 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:39 old-k8s-version-497253 kubelet[660]: E0307 22:35:39.938727 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0307 22:39:37.923532 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:46 old-k8s-version-497253 kubelet[660]: E0307 22:35:46.914538 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.923717 203173 logs.go:138] Found kubelet problem: Mar 07 22:35:53 old-k8s-version-497253 kubelet[660]: E0307 22:35:53.914358 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.924047 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:00 old-k8s-version-497253 kubelet[660]: E0307 22:36:00.917774 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.924231 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:05 old-k8s-version-497253 kubelet[660]: E0307 22:36:05.914412 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.924825 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:15 old-k8s-version-497253 kubelet[660]: E0307 22:36:15.682987 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.925010 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:18 old-k8s-version-497253 kubelet[660]: E0307 22:36:18.914367 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.925336 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:21 old-k8s-version-497253 kubelet[660]: E0307 22:36:21.449525 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.925522 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:31 old-k8s-version-497253 kubelet[660]: E0307 22:36:31.914470 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.925856 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:33 old-k8s-version-497253 kubelet[660]: E0307 22:36:33.914221 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.926040 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:42 old-k8s-version-497253 kubelet[660]: E0307 22:36:42.914696 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.926366 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:45 old-k8s-version-497253 kubelet[660]: E0307 22:36:45.914100 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.926550 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:57 old-k8s-version-497253 kubelet[660]: E0307 22:36:57.914372 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.926879 203173 logs.go:138] Found kubelet problem: Mar 07 22:36:58 old-k8s-version-497253 kubelet[660]: E0307 22:36:58.914093 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.927206 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:10 old-k8s-version-497253 kubelet[660]: E0307 22:37:10.914874 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.929692 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:10 old-k8s-version-497253 kubelet[660]: E0307 22:37:10.928532 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0307 22:39:37.929880 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:21 old-k8s-version-497253 kubelet[660]: E0307 22:37:21.914234 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.930207 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:23 old-k8s-version-497253 kubelet[660]: E0307 22:37:23.914014 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.930390 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:33 old-k8s-version-497253 kubelet[660]: E0307 22:37:33.914590 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.930976 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:37 old-k8s-version-497253 kubelet[660]: E0307 22:37:37.858788 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.931303 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:41 old-k8s-version-497253 kubelet[660]: E0307 22:37:41.449456 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.931488 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:46 old-k8s-version-497253 kubelet[660]: E0307 22:37:46.917492 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.931817 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:56 old-k8s-version-497253 kubelet[660]: E0307 22:37:56.914065 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.932001 203173 logs.go:138] Found kubelet problem: Mar 07 22:37:57 old-k8s-version-497253 kubelet[660]: E0307 22:37:57.915061 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.932185 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:09 old-k8s-version-497253 kubelet[660]: E0307 22:38:09.914552 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.932518 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:11 old-k8s-version-497253 kubelet[660]: E0307 22:38:11.913955 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.932704 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:23 old-k8s-version-497253 kubelet[660]: E0307 22:38:23.914295 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.933032 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:26 old-k8s-version-497253 kubelet[660]: E0307 22:38:26.914365 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.933216 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:35 old-k8s-version-497253 kubelet[660]: E0307 22:38:35.914352 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.933542 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:38 old-k8s-version-497253 kubelet[660]: E0307 22:38:38.914978 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.933726 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:48 old-k8s-version-497253 kubelet[660]: E0307 22:38:48.914308 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.934052 203173 logs.go:138] Found kubelet problem: Mar 07 22:38:50 old-k8s-version-497253 kubelet[660]: E0307 22:38:50.914584 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.934378 203173 logs.go:138] Found kubelet problem: Mar 07 22:39:01 old-k8s-version-497253 kubelet[660]: E0307 22:39:01.914578 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.934564 203173 logs.go:138] Found kubelet problem: Mar 07 22:39:03 old-k8s-version-497253 kubelet[660]: E0307 22:39:03.914427 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.934899 203173 logs.go:138] Found kubelet problem: Mar 07 22:39:15 old-k8s-version-497253 kubelet[660]: E0307 22:39:15.913973 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.935085 203173 logs.go:138] Found kubelet problem: Mar 07 22:39:16 old-k8s-version-497253 kubelet[660]: E0307 22:39:16.918241 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:37.935411 203173 logs.go:138] Found kubelet problem: Mar 07 22:39:26 old-k8s-version-497253 kubelet[660]: E0307 22:39:26.914096 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:37.935596 203173 logs.go:138] Found kubelet problem: Mar 07 22:39:29 old-k8s-version-497253 kubelet[660]: E0307 22:39:29.914280 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0307 22:39:37.935605 203173 logs.go:123] Gathering logs for etcd [14afb08fcf0333a1d360d000f1fa3b158ae712b1b2a3e6c52b164c05245f920d] ...
I0307 22:39:37.935619 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 14afb08fcf0333a1d360d000f1fa3b158ae712b1b2a3e6c52b164c05245f920d"
I0307 22:39:37.997943 203173 logs.go:123] Gathering logs for kube-controller-manager [9ba0a9f80bc7b1866c7509e8df81dcc0d3e74b8702a84d7676660a9395cf59fc] ...
I0307 22:39:37.997972 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9ba0a9f80bc7b1866c7509e8df81dcc0d3e74b8702a84d7676660a9395cf59fc"
I0307 22:39:38.115147 203173 logs.go:123] Gathering logs for dmesg ...
I0307 22:39:38.115183 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0307 22:39:38.133346 203173 logs.go:123] Gathering logs for coredns [a105c02644c9c901090c4c9792a32b0396cee09395513751eeb1be7fbf4b8477] ...
I0307 22:39:38.133379 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a105c02644c9c901090c4c9792a32b0396cee09395513751eeb1be7fbf4b8477"
I0307 22:39:38.172233 203173 logs.go:123] Gathering logs for kube-scheduler [2ca89421ca012456f503b4b92ac92a69bf6b0042461af4e2e3140e7adb8b27dc] ...
I0307 22:39:38.172264 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2ca89421ca012456f503b4b92ac92a69bf6b0042461af4e2e3140e7adb8b27dc"
I0307 22:39:38.215015 203173 logs.go:123] Gathering logs for kube-proxy [f1df99d1a705a4556e4be13c16d400b99149438c96bfe6da863b8b041983b036] ...
I0307 22:39:38.215047 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f1df99d1a705a4556e4be13c16d400b99149438c96bfe6da863b8b041983b036"
I0307 22:39:38.253945 203173 logs.go:123] Gathering logs for kindnet [e9768721745ab392d0ad14d4055c5cf01cc780491a01953b4b45bf77d2d3b062] ...
I0307 22:39:38.253974 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e9768721745ab392d0ad14d4055c5cf01cc780491a01953b4b45bf77d2d3b062"
I0307 22:39:38.298086 203173 logs.go:123] Gathering logs for storage-provisioner [426c41631cb95479682cbd7b19483427f710b2f7932b9e6d2bc0367710c2ca1d] ...
I0307 22:39:38.298117 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 426c41631cb95479682cbd7b19483427f710b2f7932b9e6d2bc0367710c2ca1d"
I0307 22:39:38.343935 203173 logs.go:123] Gathering logs for coredns [413452dbe13bfb277303d92484791aa53ae9a198a089364135d2347bf8475623] ...
I0307 22:39:38.343969 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 413452dbe13bfb277303d92484791aa53ae9a198a089364135d2347bf8475623"
I0307 22:39:38.382349 203173 logs.go:123] Gathering logs for kube-proxy [7998095a37dd2896f96215e8ab5d29ae495d3dc1a00b119506f8ace55156b07a] ...
I0307 22:39:38.382378 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7998095a37dd2896f96215e8ab5d29ae495d3dc1a00b119506f8ace55156b07a"
I0307 22:39:38.427494 203173 logs.go:123] Gathering logs for kube-controller-manager [bd7a60d8d4f26067debaaf5b2c23fe94dcfed76118b17104051bc8c755b35ce1] ...
I0307 22:39:38.427570 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bd7a60d8d4f26067debaaf5b2c23fe94dcfed76118b17104051bc8c755b35ce1"
I0307 22:39:38.491465 203173 logs.go:123] Gathering logs for storage-provisioner [f98ff695720f5ebea06fa188196a8a6393c29dfd0211d4a0ec784c54cbb9f906] ...
I0307 22:39:38.491536 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f98ff695720f5ebea06fa188196a8a6393c29dfd0211d4a0ec784c54cbb9f906"
I0307 22:39:38.532531 203173 logs.go:123] Gathering logs for kubernetes-dashboard [778e16c451c2e6a7fecd1d1b5d37778e92f50fd757af7d8812222cfa025fdc86] ...
I0307 22:39:38.532564 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 778e16c451c2e6a7fecd1d1b5d37778e92f50fd757af7d8812222cfa025fdc86"
I0307 22:39:38.577829 203173 logs.go:123] Gathering logs for containerd ...
I0307 22:39:38.577862 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0307 22:39:38.638480 203173 logs.go:123] Gathering logs for container status ...
I0307 22:39:38.638517 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0307 22:39:38.693638 203173 logs.go:123] Gathering logs for kube-apiserver [8b2ed0287cc5bbf594cda29d926ae828c7d6d12ad490285c6e855c8824388d29] ...
I0307 22:39:38.693667 203173 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8b2ed0287cc5bbf594cda29d926ae828c7d6d12ad490285c6e855c8824388d29"
I0307 22:39:38.764704 203173 out.go:304] Setting ErrFile to fd 2...
I0307 22:39:38.764734 203173 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0307 22:39:38.764785 203173 out.go:239] X Problems detected in kubelet:
W0307 22:39:38.764795 203173 out.go:239] Mar 07 22:39:03 old-k8s-version-497253 kubelet[660]: E0307 22:39:03.914427 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:38.764803 203173 out.go:239] Mar 07 22:39:15 old-k8s-version-497253 kubelet[660]: E0307 22:39:15.913973 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:38.764817 203173 out.go:239] Mar 07 22:39:16 old-k8s-version-497253 kubelet[660]: E0307 22:39:16.918241 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0307 22:39:38.764824 203173 out.go:239] Mar 07 22:39:26 old-k8s-version-497253 kubelet[660]: E0307 22:39:26.914096 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
W0307 22:39:38.764836 203173 out.go:239] Mar 07 22:39:29 old-k8s-version-497253 kubelet[660]: E0307 22:39:29.914280 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0307 22:39:38.764843 203173 out.go:304] Setting ErrFile to fd 2...
I0307 22:39:38.764849 203173 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 22:39:48.764963 203173 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0307 22:39:48.777388 203173 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0307 22:39:48.794117 203173 out.go:177]
W0307 22:39:48.797346 203173 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0307 22:39:48.797390 203173 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0307 22:39:48.797410 203173 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0307 22:39:48.797416 203173 out.go:239] *
W0307 22:39:48.798329 203173 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0307 22:39:48.800764 203173 out.go:177]
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
4436cb630d957 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 44d01011917d1 dashboard-metrics-scraper-8d5bb5db8-85hs8
426c41631cb95 ba04bb24b9575 4 minutes ago Running storage-provisioner 2 6653df91645aa storage-provisioner
778e16c451c2e 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 991993383d4fc kubernetes-dashboard-cd95d586-dsjvb
2543aa094e873 4740c1948d3fc 5 minutes ago Running kindnet-cni 1 e61176bb8cd1b kindnet-wjf8t
8348ba5b7e636 1611cd07b61d5 5 minutes ago Running busybox 1 5aeff1b1c30c7 busybox
f98ff695720f5 ba04bb24b9575 5 minutes ago Exited storage-provisioner 1 6653df91645aa storage-provisioner
7998095a37dd2 25a5233254979 5 minutes ago Running kube-proxy 1 7039632b6e451 kube-proxy-8s7l5
413452dbe13bf db91994f4ee8f 5 minutes ago Running coredns 1 f9ab0aadba161 coredns-74ff55c5b-jjsjg
14afb08fcf033 05b738aa1bc63 5 minutes ago Running etcd 1 a068fb6a57558 etcd-old-k8s-version-497253
157ece61e2d99 e7605f88f17d6 5 minutes ago Running kube-scheduler 1 9152ada8c00b2 kube-scheduler-old-k8s-version-497253
9ba0a9f80bc7b 1df8a2b116bd1 5 minutes ago Running kube-controller-manager 1 09141809c0920 kube-controller-manager-old-k8s-version-497253
8b2ed0287cc5b 2c08bbbc02d3a 5 minutes ago Running kube-apiserver 1 6b1c4b2e351b8 kube-apiserver-old-k8s-version-497253
643b7fa0bae9b 1611cd07b61d5 6 minutes ago Exited busybox 0 5eee39290bc57 busybox
a105c02644c9c db91994f4ee8f 7 minutes ago Exited coredns 0 05292a255b2c5 coredns-74ff55c5b-jjsjg
e9768721745ab 4740c1948d3fc 8 minutes ago Exited kindnet-cni 0 2019cc751ea77 kindnet-wjf8t
f1df99d1a705a 25a5233254979 8 minutes ago Exited kube-proxy 0 4d0a6e2e10291 kube-proxy-8s7l5
cc2db588ff857 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 9d722cf6ff2d1 kube-apiserver-old-k8s-version-497253
2ca89421ca012 e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 96e4810a8ace9 kube-scheduler-old-k8s-version-497253
bd7a60d8d4f26 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 cbadaf7de17c5 kube-controller-manager-old-k8s-version-497253
dabbb0b4fd257 05b738aa1bc63 8 minutes ago Exited etcd 0 ccdc32fabb99f etcd-old-k8s-version-497253
==> containerd <==
Mar 07 22:35:39 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:35:39.923699498Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Mar 07 22:35:39 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:35:39.936962378Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Mar 07 22:36:14 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:36:14.917347669Z" level=info msg="CreateContainer within sandbox \"44d01011917d15f9ec9eeccbe3872195fe11cfde5e4a9fe132e59ede77a89141\" for container &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:4,}"
Mar 07 22:36:14 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:36:14.935092775Z" level=info msg="CreateContainer within sandbox \"44d01011917d15f9ec9eeccbe3872195fe11cfde5e4a9fe132e59ede77a89141\" for &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:4,} returns container id \"d5b1fc3d305785db148edcf910073adc71bfca8139c58401f9a2e5075152e174\""
Mar 07 22:36:14 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:36:14.935826391Z" level=info msg="StartContainer for \"d5b1fc3d305785db148edcf910073adc71bfca8139c58401f9a2e5075152e174\""
Mar 07 22:36:15 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:36:15.013462514Z" level=info msg="StartContainer for \"d5b1fc3d305785db148edcf910073adc71bfca8139c58401f9a2e5075152e174\" returns successfully"
Mar 07 22:36:15 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:36:15.055714912Z" level=info msg="shim disconnected" id=d5b1fc3d305785db148edcf910073adc71bfca8139c58401f9a2e5075152e174
Mar 07 22:36:15 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:36:15.055785140Z" level=warning msg="cleaning up after shim disconnected" id=d5b1fc3d305785db148edcf910073adc71bfca8139c58401f9a2e5075152e174 namespace=k8s.io
Mar 07 22:36:15 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:36:15.055798087Z" level=info msg="cleaning up dead shim"
Mar 07 22:36:15 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:36:15.064581147Z" level=warning msg="cleanup warnings time=\"2024-03-07T22:36:15Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=3005 runtime=io.containerd.runc.v2\n"
Mar 07 22:36:15 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:36:15.685192143Z" level=info msg="RemoveContainer for \"b892029056eaffad6ab44b5906e57d535688d742cae5b351706314b99ed92d03\""
Mar 07 22:36:15 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:36:15.692914974Z" level=info msg="RemoveContainer for \"b892029056eaffad6ab44b5906e57d535688d742cae5b351706314b99ed92d03\" returns successfully"
Mar 07 22:37:10 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:37:10.918630972Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 07 22:37:10 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:37:10.924106833Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Mar 07 22:37:10 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:37:10.926122068Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Mar 07 22:37:36 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:37:36.918555423Z" level=info msg="CreateContainer within sandbox \"44d01011917d15f9ec9eeccbe3872195fe11cfde5e4a9fe132e59ede77a89141\" for container &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:5,}"
Mar 07 22:37:36 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:37:36.941292093Z" level=info msg="CreateContainer within sandbox \"44d01011917d15f9ec9eeccbe3872195fe11cfde5e4a9fe132e59ede77a89141\" for &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:5,} returns container id \"4436cb630d957568995c4d713a0f34f178beecbf0a05f492026f2c211f72997b\""
Mar 07 22:37:36 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:37:36.941955991Z" level=info msg="StartContainer for \"4436cb630d957568995c4d713a0f34f178beecbf0a05f492026f2c211f72997b\""
Mar 07 22:37:37 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:37:37.005805825Z" level=info msg="StartContainer for \"4436cb630d957568995c4d713a0f34f178beecbf0a05f492026f2c211f72997b\" returns successfully"
Mar 07 22:37:37 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:37:37.051827230Z" level=info msg="shim disconnected" id=4436cb630d957568995c4d713a0f34f178beecbf0a05f492026f2c211f72997b
Mar 07 22:37:37 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:37:37.051996288Z" level=warning msg="cleaning up after shim disconnected" id=4436cb630d957568995c4d713a0f34f178beecbf0a05f492026f2c211f72997b namespace=k8s.io
Mar 07 22:37:37 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:37:37.052015234Z" level=info msg="cleaning up dead shim"
Mar 07 22:37:37 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:37:37.060560182Z" level=warning msg="cleanup warnings time=\"2024-03-07T22:37:37Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=3235 runtime=io.containerd.runc.v2\n"
Mar 07 22:37:37 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:37:37.877927721Z" level=info msg="RemoveContainer for \"d5b1fc3d305785db148edcf910073adc71bfca8139c58401f9a2e5075152e174\""
Mar 07 22:37:37 old-k8s-version-497253 containerd[568]: time="2024-03-07T22:37:37.883426474Z" level=info msg="RemoveContainer for \"d5b1fc3d305785db148edcf910073adc71bfca8139c58401f9a2e5075152e174\" returns successfully"
==> coredns [413452dbe13bfb277303d92484791aa53ae9a198a089364135d2347bf8475623] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:57871 - 9601 "HINFO IN 2553362965738671866.3497325676005983756. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.02496585s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I0307 22:34:38.573711 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-03-07 22:34:08.573113987 +0000 UTC m=+0.032962542) (total time: 30.000503476s):
Trace[2019727887]: [30.000503476s] [30.000503476s] END
E0307 22:34:38.573740 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0307 22:34:38.574118 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-03-07 22:34:08.573664548 +0000 UTC m=+0.033513095) (total time: 30.000436211s):
Trace[939984059]: [30.000436211s] [30.000436211s] END
E0307 22:34:38.574194 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0307 22:34:38.574372 1 trace.go:116] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-03-07 22:34:08.57390188 +0000 UTC m=+0.033750435) (total time: 30.000458668s):
Trace[911902081]: [30.000458668s] [30.000458668s] END
E0307 22:34:38.574420 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> coredns [a105c02644c9c901090c4c9792a32b0396cee09395513751eeb1be7fbf4b8477] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:46430 - 30382 "HINFO IN 886684529790920993.5393081510785046323. udp 56 false 512" NXDOMAIN qr,rd,ra 56 0.022716021s
==> describe nodes <==
Name: old-k8s-version-497253
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-497253
kubernetes.io/os=linux
minikube.k8s.io/commit=3e3656b8cff33aafa60dd2a07a4b34bce666a6a6
minikube.k8s.io/name=old-k8s-version-497253
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_03_07T22_31_32_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Thu, 07 Mar 2024 22:31:28 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-497253
AcquireTime: <unset>
RenewTime: Thu, 07 Mar 2024 22:39:47 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Thu, 07 Mar 2024 22:34:56 +0000 Thu, 07 Mar 2024 22:31:21 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Thu, 07 Mar 2024 22:34:56 +0000 Thu, 07 Mar 2024 22:31:21 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Thu, 07 Mar 2024 22:34:56 +0000 Thu, 07 Mar 2024 22:31:21 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Thu, 07 Mar 2024 22:34:56 +0000 Thu, 07 Mar 2024 22:31:48 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-497253
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022496Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022496Ki
pods: 110
System Info:
Machine ID: c5a8e0ea18bc41b3af60da2f00850b6e
System UUID: c3622802-fd6d-46e5-9412-eb136d546444
Boot ID: 5a38287e-066f-43b8-a303-a60cdb318f8a
Kernel Version: 5.15.0-1055-aws
OS Image: Ubuntu 22.04.3 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.6.28
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m39s
kube-system coredns-74ff55c5b-jjsjg 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m3s
kube-system etcd-old-k8s-version-497253 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m11s
kube-system kindnet-wjf8t 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 8m3s
kube-system kube-apiserver-old-k8s-version-497253 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m11s
kube-system kube-controller-manager-old-k8s-version-497253 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m11s
kube-system kube-proxy-8s7l5 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m3s
kube-system kube-scheduler-old-k8s-version-497253 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m11s
kube-system metrics-server-9975d5f86-qmg9k 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m28s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m1s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-85hs8 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m27s
kubernetes-dashboard kubernetes-dashboard-cd95d586-dsjvb 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m27s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m31s (x4 over 8m31s) kubelet Node old-k8s-version-497253 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m31s (x5 over 8m31s) kubelet Node old-k8s-version-497253 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m31s (x4 over 8m31s) kubelet Node old-k8s-version-497253 status is now: NodeHasSufficientPID
Normal Starting 8m12s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m12s kubelet Node old-k8s-version-497253 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m12s kubelet Node old-k8s-version-497253 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m12s kubelet Node old-k8s-version-497253 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m11s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m3s kubelet Node old-k8s-version-497253 status is now: NodeReady
Normal Starting 8m2s kube-proxy Starting kube-proxy.
Normal Starting 5m59s kubelet Starting kubelet.
Normal NodeAllocatableEnforced 5m59s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 5m58s (x8 over 5m59s) kubelet Node old-k8s-version-497253 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m58s (x7 over 5m59s) kubelet Node old-k8s-version-497253 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m58s (x8 over 5m59s) kubelet Node old-k8s-version-497253 status is now: NodeHasSufficientPID
Normal Starting 5m42s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.000972] FS-Cache: N-cookie d=000000000f302b63{9p.inode} n=00000000837bca78
[ +0.001086] FS-Cache: N-key=[8] '8f385c0100000000'
[ +0.003138] FS-Cache: Duplicate cookie detected
[ +0.000724] FS-Cache: O-cookie c=00000006 [p=00000003 fl=226 nc=0 na=1]
[ +0.000996] FS-Cache: O-cookie d=000000000f302b63{9p.inode} n=00000000f001752e
[ +0.001185] FS-Cache: O-key=[8] '8f385c0100000000'
[ +0.000754] FS-Cache: N-cookie c=0000000d [p=00000003 fl=2 nc=0 na=1]
[ +0.000998] FS-Cache: N-cookie d=000000000f302b63{9p.inode} n=0000000098f86bc0
[ +0.001117] FS-Cache: N-key=[8] '8f385c0100000000'
[ +2.904901] FS-Cache: Duplicate cookie detected
[ +0.000775] FS-Cache: O-cookie c=00000004 [p=00000003 fl=226 nc=0 na=1]
[ +0.001027] FS-Cache: O-cookie d=000000000f302b63{9p.inode} n=00000000eacda38f
[ +0.001143] FS-Cache: O-key=[8] '8e385c0100000000'
[ +0.000817] FS-Cache: N-cookie c=0000000f [p=00000003 fl=2 nc=0 na=1]
[ +0.001005] FS-Cache: N-cookie d=000000000f302b63{9p.inode} n=00000000837bca78
[ +0.001169] FS-Cache: N-key=[8] '8e385c0100000000'
[ +0.298622] FS-Cache: Duplicate cookie detected
[ +0.000783] FS-Cache: O-cookie c=00000009 [p=00000003 fl=226 nc=0 na=1]
[ +0.001098] FS-Cache: O-cookie d=000000000f302b63{9p.inode} n=00000000804cecc5
[ +0.001206] FS-Cache: O-key=[8] '96385c0100000000'
[ +0.000727] FS-Cache: N-cookie c=00000010 [p=00000003 fl=2 nc=0 na=1]
[ +0.000984] FS-Cache: N-cookie d=000000000f302b63{9p.inode} n=000000001811317b
[ +0.001130] FS-Cache: N-key=[8] '96385c0100000000'
[Mar 7 22:00] hrtimer: interrupt took 15664673 ns
[Mar 7 22:23] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
==> etcd [14afb08fcf0333a1d360d000f1fa3b158ae712b1b2a3e6c52b164c05245f920d] <==
2024-03-07 22:35:48.330400 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:35:58.330224 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:36:08.330314 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:36:18.330234 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:36:28.330381 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:36:38.330334 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:36:48.330315 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:36:58.330444 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:37:08.330431 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:37:18.330276 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:37:28.330453 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:37:38.330270 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:37:48.330977 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:37:58.330358 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:38:08.330352 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:38:18.330345 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:38:28.330410 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:38:38.330780 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:38:48.330333 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:38:58.330300 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:39:08.330422 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:39:18.330484 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:39:28.330393 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:39:38.330533 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:39:48.330347 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [dabbb0b4fd2574e92c3a53182c494ec08df151f99bd21d27189df149b7f8961c] <==
2024-03-07 22:31:21.219064 I | etcdserver/membership: added member ea7e25599daad906 [https://192.168.76.2:2380] to cluster 6f20f2c4b2fb5f8a
raft2024/03/07 22:31:21 INFO: ea7e25599daad906 is starting a new election at term 1
raft2024/03/07 22:31:21 INFO: ea7e25599daad906 became candidate at term 2
raft2024/03/07 22:31:21 INFO: ea7e25599daad906 received MsgVoteResp from ea7e25599daad906 at term 2
raft2024/03/07 22:31:21 INFO: ea7e25599daad906 became leader at term 2
raft2024/03/07 22:31:21 INFO: raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2
2024-03-07 22:31:21.804097 I | etcdserver: setting up the initial cluster version to 3.4
2024-03-07 22:31:21.807948 N | etcdserver/membership: set the initial cluster version to 3.4
2024-03-07 22:31:21.808118 I | etcdserver/api: enabled capabilities for version 3.4
2024-03-07 22:31:21.808231 I | etcdserver: published {Name:old-k8s-version-497253 ClientURLs:[https://192.168.76.2:2379]} to cluster 6f20f2c4b2fb5f8a
2024-03-07 22:31:21.808450 I | embed: ready to serve client requests
2024-03-07 22:31:21.810286 I | embed: serving client requests on 192.168.76.2:2379
2024-03-07 22:31:21.812222 I | embed: ready to serve client requests
2024-03-07 22:31:21.816811 I | embed: serving client requests on 127.0.0.1:2379
2024-03-07 22:31:40.813658 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:31:50.581074 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:32:00.578784 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:32:10.578368 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:32:20.578621 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:32:30.578623 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:32:40.578332 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:32:50.578471 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:33:00.578434 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:33:10.578534 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-07 22:33:20.578488 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
22:39:51 up 1:22, 0 users, load average: 2.03, 1.91, 2.39
Linux old-k8s-version-497253 5.15.0-1055-aws #60~20.04.1-Ubuntu SMP Thu Feb 22 15:54:21 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.3 LTS"
==> kindnet [2543aa094e87373b5f846e8bdc2bbadbdda2c55f6d326c6db6b9216375dde5e6] <==
I0307 22:37:49.932951 1 main.go:227] handling current node
I0307 22:37:59.949388 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0307 22:37:59.949420 1 main.go:227] handling current node
I0307 22:38:09.963513 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0307 22:38:09.963545 1 main.go:227] handling current node
I0307 22:38:19.978061 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0307 22:38:19.978154 1 main.go:227] handling current node
I0307 22:38:29.994459 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0307 22:38:29.994553 1 main.go:227] handling current node
I0307 22:38:40.035937 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0307 22:38:40.036167 1 main.go:227] handling current node
I0307 22:38:50.064914 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0307 22:38:50.064940 1 main.go:227] handling current node
I0307 22:39:00.089742 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0307 22:39:00.089979 1 main.go:227] handling current node
I0307 22:39:10.101752 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0307 22:39:10.101782 1 main.go:227] handling current node
I0307 22:39:20.126768 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0307 22:39:20.127159 1 main.go:227] handling current node
I0307 22:39:30.131882 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0307 22:39:30.131913 1 main.go:227] handling current node
I0307 22:39:40.150512 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0307 22:39:40.150545 1 main.go:227] handling current node
I0307 22:39:50.155211 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0307 22:39:50.155240 1 main.go:227] handling current node
==> kindnet [e9768721745ab392d0ad14d4055c5cf01cc780491a01953b4b45bf77d2d3b062] <==
I0307 22:31:49.521476 1 main.go:107] hostIP = 192.168.76.2
podIP = 192.168.76.2
I0307 22:31:49.521576 1 main.go:116] setting mtu 1500 for CNI
I0307 22:31:49.521590 1 main.go:146] kindnetd IP family: "ipv4"
I0307 22:31:49.521600 1 main.go:150] noMask IPv4 subnets: [10.244.0.0/16]
I0307 22:31:49.818048 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0307 22:31:49.818084 1 main.go:227] handling current node
I0307 22:31:59.842544 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0307 22:31:59.842578 1 main.go:227] handling current node
I0307 22:32:09.862427 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0307 22:32:09.862459 1 main.go:227] handling current node
I0307 22:32:19.878608 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0307 22:32:19.878857 1 main.go:227] handling current node
I0307 22:32:29.896563 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0307 22:32:29.896592 1 main.go:227] handling current node
I0307 22:32:39.906023 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0307 22:32:39.906054 1 main.go:227] handling current node
I0307 22:32:49.916848 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0307 22:32:49.916879 1 main.go:227] handling current node
I0307 22:32:59.932381 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0307 22:32:59.932410 1 main.go:227] handling current node
I0307 22:33:09.947125 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0307 22:33:09.947155 1 main.go:227] handling current node
I0307 22:33:19.958833 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0307 22:33:19.958887 1 main.go:227] handling current node
==> kube-apiserver [8b2ed0287cc5bbf594cda29d926ae828c7d6d12ad490285c6e855c8824388d29] <==
I0307 22:36:35.837936 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0307 22:36:35.838030 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0307 22:37:08.966807 1 handler_proxy.go:102] no RequestInfo found in the context
E0307 22:37:08.966893 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0307 22:37:08.966907 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0307 22:37:18.442429 1 client.go:360] parsed scheme: "passthrough"
I0307 22:37:18.442474 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0307 22:37:18.442483 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0307 22:37:55.292524 1 client.go:360] parsed scheme: "passthrough"
I0307 22:37:55.292573 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0307 22:37:55.292586 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0307 22:38:27.183951 1 client.go:360] parsed scheme: "passthrough"
I0307 22:38:27.184000 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0307 22:38:27.184009 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0307 22:39:06.182900 1 handler_proxy.go:102] no RequestInfo found in the context
E0307 22:39:06.182972 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0307 22:39:06.182990 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0307 22:39:12.030008 1 client.go:360] parsed scheme: "passthrough"
I0307 22:39:12.030067 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0307 22:39:12.030076 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0307 22:39:46.045738 1 client.go:360] parsed scheme: "passthrough"
I0307 22:39:46.045781 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0307 22:39:46.045789 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [cc2db588ff857bfb95417bfc8b125ca64e6caba952ba4acd81ec27522fde3127] <==
I0307 22:31:29.087614 1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
I0307 22:31:29.087742 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I0307 22:31:29.124126 1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000
I0307 22:31:29.132254 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I0307 22:31:29.132320 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0307 22:31:29.575542 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0307 22:31:29.614450 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0307 22:31:29.765368 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
I0307 22:31:29.766573 1 controller.go:606] quota admission added evaluator for: endpoints
I0307 22:31:29.770980 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0307 22:31:30.764704 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0307 22:31:31.326101 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0307 22:31:31.379181 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0307 22:31:39.826963 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0307 22:31:48.183010 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0307 22:31:48.310857 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0307 22:31:57.698930 1 client.go:360] parsed scheme: "passthrough"
I0307 22:31:57.699137 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0307 22:31:57.699206 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0307 22:32:37.792862 1 client.go:360] parsed scheme: "passthrough"
I0307 22:32:37.792908 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0307 22:32:37.792916 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0307 22:33:18.151658 1 client.go:360] parsed scheme: "passthrough"
I0307 22:33:18.151928 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0307 22:33:18.151946 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [9ba0a9f80bc7b1866c7509e8df81dcc0d3e74b8702a84d7676660a9395cf59fc] <==
W0307 22:35:30.571467 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0307 22:35:56.542599 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0307 22:36:02.222012 1 request.go:655] Throttling request took 1.048285567s, request: GET:https://192.168.76.2:8443/apis/autoscaling/v1?timeout=32s
W0307 22:36:03.073522 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0307 22:36:27.050875 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0307 22:36:34.723933 1 request.go:655] Throttling request took 1.048325721s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0307 22:36:35.575650 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0307 22:36:57.552988 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0307 22:37:07.226187 1 request.go:655] Throttling request took 1.048242428s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0307 22:37:08.077702 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0307 22:37:28.055274 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0307 22:37:39.728368 1 request.go:655] Throttling request took 1.048475383s, request: GET:https://192.168.76.2:8443/apis/events.k8s.io/v1?timeout=32s
W0307 22:37:40.579770 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0307 22:37:58.557209 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0307 22:38:12.230291 1 request.go:655] Throttling request took 1.04828379s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0307 22:38:13.081711 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0307 22:38:29.058986 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0307 22:38:44.732237 1 request.go:655] Throttling request took 1.048479912s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0307 22:38:45.583795 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0307 22:38:59.560851 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0307 22:39:17.234378 1 request.go:655] Throttling request took 1.048577169s, request: GET:https://192.168.76.2:8443/apis/scheduling.k8s.io/v1?timeout=32s
W0307 22:39:18.086335 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0307 22:39:30.062908 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0307 22:39:49.737002 1 request.go:655] Throttling request took 1.048222555s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0307 22:39:50.588909 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-controller-manager [bd7a60d8d4f26067debaaf5b2c23fe94dcfed76118b17104051bc8c755b35ce1] <==
I0307 22:31:48.314241 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-jjsjg"
I0307 22:31:48.316223 1 range_allocator.go:373] Set node old-k8s-version-497253 PodCIDR to [10.244.0.0/24]
I0307 22:31:48.361151 1 shared_informer.go:247] Caches are synced for endpoint_slice
E0307 22:31:48.458759 1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
I0307 22:31:48.460947 1 shared_informer.go:247] Caches are synced for endpoint
I0307 22:31:48.461740 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-wjf8t"
I0307 22:31:48.463028 1 event.go:291] "Event occurred" object="kube-system/kube-scheduler-old-k8s-version-497253" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0307 22:31:48.489836 1 event.go:291] "Event occurred" object="kube-system/etcd-old-k8s-version-497253" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0307 22:31:48.496520 1 event.go:291] "Event occurred" object="kube-system/kube-apiserver-old-k8s-version-497253" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
E0307 22:31:48.510810 1 clusterroleaggregation_controller.go:181] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
I0307 22:31:48.511274 1 shared_informer.go:247] Caches are synced for endpoint_slice_mirroring
I0307 22:31:48.513925 1 shared_informer.go:247] Caches are synced for resource quota
I0307 22:31:48.526388 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-8s7l5"
I0307 22:31:48.541273 1 shared_informer.go:247] Caches are synced for resource quota
E0307 22:31:48.621831 1 daemon_controller.go:320] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"902430a6-f379-499b-913f-f3108b08012b", ResourceVersion:"263", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63845447491, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001872500), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001872520)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.
LabelSelector)(0x4001872540), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Gl
usterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0x40012cfc40), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001872
560), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeS
ource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001872580), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil),
AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.20.0", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0x40018725c0)}}, Resources:v1.R
esourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x40016ee480), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPo
licy:"Always", TerminationGracePeriodSeconds:(*int64)(0x400169ae68), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x4000a6e540), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), Runtime
ClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x4000286b30)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x400169aeb8)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest version and try again
I0307 22:31:48.635533 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
E0307 22:31:48.659559 1 daemon_controller.go:320] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"902430a6-f379-499b-913f-f3108b08012b", ResourceVersion:"411", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63845447491, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001f18580), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001f185a0)}, v1.ManagedFieldsEntry{Manager:"kube-co
ntroller-manager", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001f185c0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001f185e0)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0x4001f18600), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElastic
BlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0x4001f0e4c0), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSour
ce)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001f18620), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSo
urce)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001f18640), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil),
Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.20.0", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil),
WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001f18680)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"F
ile", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x4001d6fbc0), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4001ef89f8), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x4000342ee0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)
(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x400000f8a8)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4001ef8a48)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:1, NumberReady:0, ObservedGeneration:1, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:1, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest ve
rsion and try again
I0307 22:31:48.860784 1 shared_informer.go:247] Caches are synced for garbage collector
I0307 22:31:48.860810 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0307 22:31:48.935987 1 shared_informer.go:247] Caches are synced for garbage collector
I0307 22:31:49.951566 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0307 22:31:49.973763 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-v8qft"
I0307 22:31:53.262250 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I0307 22:33:22.280813 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
E0307 22:33:22.438444 1 clusterroleaggregation_controller.go:181] view failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "view": the object has been modified; please apply your changes to the latest version and try again
==> kube-proxy [7998095a37dd2896f96215e8ab5d29ae495d3dc1a00b119506f8ace55156b07a] <==
I0307 22:34:08.942252 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0307 22:34:08.942320 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0307 22:34:08.999961 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0307 22:34:09.000518 1 server_others.go:185] Using iptables Proxier.
I0307 22:34:09.010380 1 server.go:650] Version: v1.20.0
I0307 22:34:09.021099 1 config.go:315] Starting service config controller
I0307 22:34:09.021126 1 shared_informer.go:240] Waiting for caches to sync for service config
I0307 22:34:09.021160 1 config.go:224] Starting endpoint slice config controller
I0307 22:34:09.021164 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0307 22:34:09.121647 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0307 22:34:09.121713 1 shared_informer.go:247] Caches are synced for service config
==> kube-proxy [f1df99d1a705a4556e4be13c16d400b99149438c96bfe6da863b8b041983b036] <==
I0307 22:31:49.457770 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0307 22:31:49.457856 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0307 22:31:49.489685 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0307 22:31:49.489777 1 server_others.go:185] Using iptables Proxier.
I0307 22:31:49.490010 1 server.go:650] Version: v1.20.0
I0307 22:31:49.490568 1 config.go:315] Starting service config controller
I0307 22:31:49.490584 1 shared_informer.go:240] Waiting for caches to sync for service config
I0307 22:31:49.492710 1 config.go:224] Starting endpoint slice config controller
I0307 22:31:49.492720 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0307 22:31:49.590661 1 shared_informer.go:247] Caches are synced for service config
I0307 22:31:49.592838 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-scheduler [157ece61e2d99f79b42530111727fc9798a3b91433c5d3a5cd83cefec75a6a67] <==
I0307 22:34:00.206327 1 serving.go:331] Generated self-signed cert in-memory
W0307 22:34:05.149298 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0307 22:34:05.149331 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0307 22:34:05.149353 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0307 22:34:05.149358 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0307 22:34:05.392928 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0307 22:34:05.405077 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0307 22:34:05.405098 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0307 22:34:05.405123 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0307 22:34:05.508413 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [2ca89421ca012456f503b4b92ac92a69bf6b0042461af4e2e3140e7adb8b27dc] <==
W0307 22:31:28.239068 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0307 22:31:28.239076 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0307 22:31:28.239083 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0307 22:31:28.366324 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0307 22:31:28.368911 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0307 22:31:28.369074 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0307 22:31:28.369220 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0307 22:31:28.386542 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0307 22:31:28.393455 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0307 22:31:28.393547 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0307 22:31:28.395908 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0307 22:31:28.396208 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0307 22:31:28.400224 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0307 22:31:28.401886 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0307 22:31:28.401967 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0307 22:31:28.402039 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0307 22:31:28.402124 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0307 22:31:28.402504 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0307 22:31:28.408712 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0307 22:31:29.228992 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0307 22:31:29.260086 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0307 22:31:29.272690 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0307 22:31:29.352504 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0307 22:31:29.358003 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
I0307 22:31:29.969353 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Mar 07 22:38:11 old-k8s-version-497253 kubelet[660]: I0307 22:38:11.913564 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 4436cb630d957568995c4d713a0f34f178beecbf0a05f492026f2c211f72997b
Mar 07 22:38:11 old-k8s-version-497253 kubelet[660]: E0307 22:38:11.913955 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
Mar 07 22:38:23 old-k8s-version-497253 kubelet[660]: E0307 22:38:23.914295 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 07 22:38:26 old-k8s-version-497253 kubelet[660]: I0307 22:38:26.913609 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 4436cb630d957568995c4d713a0f34f178beecbf0a05f492026f2c211f72997b
Mar 07 22:38:26 old-k8s-version-497253 kubelet[660]: E0307 22:38:26.914365 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
Mar 07 22:38:35 old-k8s-version-497253 kubelet[660]: E0307 22:38:35.914352 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 07 22:38:38 old-k8s-version-497253 kubelet[660]: I0307 22:38:38.913663 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 4436cb630d957568995c4d713a0f34f178beecbf0a05f492026f2c211f72997b
Mar 07 22:38:38 old-k8s-version-497253 kubelet[660]: E0307 22:38:38.914978 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
Mar 07 22:38:48 old-k8s-version-497253 kubelet[660]: E0307 22:38:48.914308 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 07 22:38:50 old-k8s-version-497253 kubelet[660]: I0307 22:38:50.913753 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 4436cb630d957568995c4d713a0f34f178beecbf0a05f492026f2c211f72997b
Mar 07 22:38:50 old-k8s-version-497253 kubelet[660]: E0307 22:38:50.914584 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
Mar 07 22:39:01 old-k8s-version-497253 kubelet[660]: I0307 22:39:01.913784 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 4436cb630d957568995c4d713a0f34f178beecbf0a05f492026f2c211f72997b
Mar 07 22:39:01 old-k8s-version-497253 kubelet[660]: E0307 22:39:01.914578 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
Mar 07 22:39:03 old-k8s-version-497253 kubelet[660]: E0307 22:39:03.914427 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 07 22:39:15 old-k8s-version-497253 kubelet[660]: I0307 22:39:15.913566 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 4436cb630d957568995c4d713a0f34f178beecbf0a05f492026f2c211f72997b
Mar 07 22:39:15 old-k8s-version-497253 kubelet[660]: E0307 22:39:15.913973 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
Mar 07 22:39:16 old-k8s-version-497253 kubelet[660]: E0307 22:39:16.918241 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 07 22:39:26 old-k8s-version-497253 kubelet[660]: I0307 22:39:26.913685 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 4436cb630d957568995c4d713a0f34f178beecbf0a05f492026f2c211f72997b
Mar 07 22:39:26 old-k8s-version-497253 kubelet[660]: E0307 22:39:26.914096 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
Mar 07 22:39:29 old-k8s-version-497253 kubelet[660]: E0307 22:39:29.914280 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 07 22:39:37 old-k8s-version-497253 kubelet[660]: I0307 22:39:37.914696 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 4436cb630d957568995c4d713a0f34f178beecbf0a05f492026f2c211f72997b
Mar 07 22:39:37 old-k8s-version-497253 kubelet[660]: E0307 22:39:37.915177 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
Mar 07 22:39:42 old-k8s-version-497253 kubelet[660]: E0307 22:39:42.914820 660 pod_workers.go:191] Error syncing pod 1cd023e3-2966-4092-bcbd-4c5b6ca28aa3 ("metrics-server-9975d5f86-qmg9k_kube-system(1cd023e3-2966-4092-bcbd-4c5b6ca28aa3)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 07 22:39:49 old-k8s-version-497253 kubelet[660]: I0307 22:39:49.913585 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 4436cb630d957568995c4d713a0f34f178beecbf0a05f492026f2c211f72997b
Mar 07 22:39:49 old-k8s-version-497253 kubelet[660]: E0307 22:39:49.913915 660 pod_workers.go:191] Error syncing pod 14312bc8-5525-434e-b6f7-56306d708544 ("dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-85hs8_kubernetes-dashboard(14312bc8-5525-434e-b6f7-56306d708544)"
==> kubernetes-dashboard [778e16c451c2e6a7fecd1d1b5d37778e92f50fd757af7d8812222cfa025fdc86] <==
2024/03/07 22:34:31 Using namespace: kubernetes-dashboard
2024/03/07 22:34:31 Using in-cluster config to connect to apiserver
2024/03/07 22:34:31 Using secret token for csrf signing
2024/03/07 22:34:31 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/03/07 22:34:32 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/03/07 22:34:32 Successful initial request to the apiserver, version: v1.20.0
2024/03/07 22:34:32 Generating JWE encryption key
2024/03/07 22:34:32 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/03/07 22:34:32 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/03/07 22:34:32 Initializing JWE encryption key from synchronized object
2024/03/07 22:34:32 Creating in-cluster Sidecar client
2024/03/07 22:34:32 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/07 22:34:32 Serving insecurely on HTTP port: 9090
2024/03/07 22:35:02 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/07 22:35:32 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/07 22:36:02 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/07 22:36:32 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/07 22:37:02 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/07 22:37:32 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/07 22:38:02 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/07 22:38:32 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/07 22:39:02 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/07 22:39:32 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/07 22:34:31 Starting overwatch
==> storage-provisioner [426c41631cb95479682cbd7b19483427f710b2f7932b9e6d2bc0367710c2ca1d] <==
I0307 22:34:51.048361 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0307 22:34:51.069541 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0307 22:34:51.069598 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0307 22:35:08.542939 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0307 22:35:08.543181 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"b5039696-c59b-48fe-a02f-8301223acda1", APIVersion:"v1", ResourceVersion:"836", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-497253_43918d65-db2d-41ee-9e93-82b3f93a5562 became leader
I0307 22:35:08.543920 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-497253_43918d65-db2d-41ee-9e93-82b3f93a5562!
I0307 22:35:08.644136 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-497253_43918d65-db2d-41ee-9e93-82b3f93a5562!
==> storage-provisioner [f98ff695720f5ebea06fa188196a8a6393c29dfd0211d4a0ec784c54cbb9f906] <==
I0307 22:34:09.009846 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0307 22:34:39.012880 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-497253 -n old-k8s-version-497253
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-497253 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-qmg9k
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-497253 describe pod metrics-server-9975d5f86-qmg9k
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-497253 describe pod metrics-server-9975d5f86-qmg9k: exit status 1 (111.109909ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-qmg9k" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-497253 describe pod metrics-server-9975d5f86-qmg9k: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (375.58s)