=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-637516 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-637516 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m17.177907878s)
-- stdout --
* [old-k8s-version-637516] minikube v1.33.0 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=18773
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18773-4048231/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18773-4048231/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.30.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.0
* Using the docker driver based on existing profile
* Starting "old-k8s-version-637516" primary control-plane node in "old-k8s-version-637516" cluster
* Pulling base image v0.0.43-1713736339-18706 ...
* Restarting existing docker container for "old-k8s-version-637516" ...
* Preparing Kubernetes v1.20.0 on containerd 1.6.31 ...
* Verifying Kubernetes components...
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-637516 addons enable metrics-server
* Enabled addons: dashboard, storage-provisioner, metrics-server, default-storageclass
-- /stdout --
** stderr **
I0429 13:43:14.130108 46889 out.go:291] Setting OutFile to fd 1 ...
I0429 13:43:14.130303 46889 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0429 13:43:14.130313 46889 out.go:304] Setting ErrFile to fd 2...
I0429 13:43:14.130317 46889 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0429 13:43:14.130569 46889 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18773-4048231/.minikube/bin
I0429 13:43:14.131048 46889 out.go:298] Setting JSON to false
I0429 13:43:14.132095 46889 start.go:129] hostinfo: {"hostname":"ip-172-31-29-130","uptime":69939,"bootTime":1714328256,"procs":216,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
I0429 13:43:14.132203 46889 start.go:139] virtualization:
I0429 13:43:14.135124 46889 out.go:177] * [old-k8s-version-637516] minikube v1.33.0 on Ubuntu 20.04 (arm64)
I0429 13:43:14.138424 46889 out.go:177] - MINIKUBE_LOCATION=18773
I0429 13:43:14.138696 46889 notify.go:220] Checking for updates...
I0429 13:43:14.140730 46889 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0429 13:43:14.143205 46889 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18773-4048231/kubeconfig
I0429 13:43:14.145278 46889 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18773-4048231/.minikube
I0429 13:43:14.147406 46889 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0429 13:43:14.151660 46889 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0429 13:43:14.154132 46889 config.go:182] Loaded profile config "old-k8s-version-637516": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0429 13:43:14.156759 46889 out.go:177] * Kubernetes 1.30.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.0
I0429 13:43:14.158357 46889 driver.go:392] Setting default libvirt URI to qemu:///system
I0429 13:43:14.183061 46889 docker.go:122] docker version: linux-26.1.0:Docker Engine - Community
I0429 13:43:14.183176 46889 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0429 13:43:14.309678 46889 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:52 SystemTime:2024-04-29 13:43:14.295051945 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215105536 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:26.1.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1]] Warnings:<nil>}}
I0429 13:43:14.309793 46889 docker.go:295] overlay module found
I0429 13:43:14.313778 46889 out.go:177] * Using the docker driver based on existing profile
I0429 13:43:14.315853 46889 start.go:297] selected driver: docker
I0429 13:43:14.315873 46889 start.go:901] validating driver "docker" against &{Name:old-k8s-version-637516 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-637516 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0429 13:43:14.315991 46889 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0429 13:43:14.316706 46889 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0429 13:43:14.442046 46889 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:52 SystemTime:2024-04-29 13:43:14.4214341 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarch
64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215105536 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:26.1.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErrors
:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1]] Warnings:<nil>}}
I0429 13:43:14.442407 46889 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0429 13:43:14.442430 46889 cni.go:84] Creating CNI manager for ""
I0429 13:43:14.442440 46889 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0429 13:43:14.442485 46889 start.go:340] cluster config:
{Name:old-k8s-version-637516 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-637516 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0429 13:43:14.444937 46889 out.go:177] * Starting "old-k8s-version-637516" primary control-plane node in "old-k8s-version-637516" cluster
I0429 13:43:14.450547 46889 cache.go:121] Beginning downloading kic base image for docker with containerd
I0429 13:43:14.452887 46889 out.go:177] * Pulling base image v0.0.43-1713736339-18706 ...
I0429 13:43:14.456002 46889 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0429 13:43:14.456065 46889 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18773-4048231/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0429 13:43:14.456076 46889 cache.go:56] Caching tarball of preloaded images
I0429 13:43:14.456175 46889 preload.go:173] Found /home/jenkins/minikube-integration/18773-4048231/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0429 13:43:14.456185 46889 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0429 13:43:14.456343 46889 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e in local docker daemon
I0429 13:43:14.456667 46889 profile.go:143] Saving config to /home/jenkins/minikube-integration/18773-4048231/.minikube/profiles/old-k8s-version-637516/config.json ...
I0429 13:43:14.488357 46889 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e in local docker daemon, skipping pull
I0429 13:43:14.488381 46889 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e exists in daemon, skipping load
I0429 13:43:14.488398 46889 cache.go:194] Successfully downloaded all kic artifacts
I0429 13:43:14.488428 46889 start.go:360] acquireMachinesLock for old-k8s-version-637516: {Name:mkf3ead723ba964ce7121a7097e03b7d45581f57 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0429 13:43:14.488501 46889 start.go:364] duration metric: took 46.899µs to acquireMachinesLock for "old-k8s-version-637516"
I0429 13:43:14.488529 46889 start.go:96] Skipping create...Using existing machine configuration
I0429 13:43:14.488542 46889 fix.go:54] fixHost starting:
I0429 13:43:14.488806 46889 cli_runner.go:164] Run: docker container inspect old-k8s-version-637516 --format={{.State.Status}}
I0429 13:43:14.520582 46889 fix.go:112] recreateIfNeeded on old-k8s-version-637516: state=Stopped err=<nil>
W0429 13:43:14.520609 46889 fix.go:138] unexpected machine state, will restart: <nil>
I0429 13:43:14.524137 46889 out.go:177] * Restarting existing docker container for "old-k8s-version-637516" ...
I0429 13:43:14.525890 46889 cli_runner.go:164] Run: docker start old-k8s-version-637516
I0429 13:43:14.925124 46889 cli_runner.go:164] Run: docker container inspect old-k8s-version-637516 --format={{.State.Status}}
I0429 13:43:14.960788 46889 kic.go:430] container "old-k8s-version-637516" state is running.
I0429 13:43:14.961199 46889 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-637516
I0429 13:43:14.983336 46889 profile.go:143] Saving config to /home/jenkins/minikube-integration/18773-4048231/.minikube/profiles/old-k8s-version-637516/config.json ...
I0429 13:43:14.983575 46889 machine.go:94] provisionDockerMachine start ...
I0429 13:43:14.983644 46889 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-637516
I0429 13:43:15.008512 46889 main.go:141] libmachine: Using SSH client type: native
I0429 13:43:15.009207 46889 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 37324 <nil> <nil>}
I0429 13:43:15.009252 46889 main.go:141] libmachine: About to run SSH command:
hostname
I0429 13:43:15.011225 46889 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:55132->127.0.0.1:37324: read: connection reset by peer
I0429 13:43:18.211033 46889 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-637516
I0429 13:43:18.211056 46889 ubuntu.go:169] provisioning hostname "old-k8s-version-637516"
I0429 13:43:18.211138 46889 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-637516
I0429 13:43:18.261591 46889 main.go:141] libmachine: Using SSH client type: native
I0429 13:43:18.261834 46889 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 37324 <nil> <nil>}
I0429 13:43:18.261846 46889 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-637516 && echo "old-k8s-version-637516" | sudo tee /etc/hostname
I0429 13:43:18.471022 46889 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-637516
I0429 13:43:18.471103 46889 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-637516
I0429 13:43:18.506324 46889 main.go:141] libmachine: Using SSH client type: native
I0429 13:43:18.506581 46889 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 37324 <nil> <nil>}
I0429 13:43:18.506597 46889 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-637516' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-637516/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-637516' | sudo tee -a /etc/hosts;
fi
fi
I0429 13:43:18.698986 46889 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0429 13:43:18.699169 46889 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18773-4048231/.minikube CaCertPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18773-4048231/.minikube}
I0429 13:43:18.699193 46889 ubuntu.go:177] setting up certificates
I0429 13:43:18.699203 46889 provision.go:84] configureAuth start
I0429 13:43:18.699314 46889 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-637516
I0429 13:43:18.753782 46889 provision.go:143] copyHostCerts
I0429 13:43:18.753867 46889 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-4048231/.minikube/ca.pem, removing ...
I0429 13:43:18.753879 46889 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-4048231/.minikube/ca.pem
I0429 13:43:18.753977 46889 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-4048231/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18773-4048231/.minikube/ca.pem (1078 bytes)
I0429 13:43:18.754140 46889 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-4048231/.minikube/cert.pem, removing ...
I0429 13:43:18.754165 46889 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-4048231/.minikube/cert.pem
I0429 13:43:18.754203 46889 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-4048231/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18773-4048231/.minikube/cert.pem (1123 bytes)
I0429 13:43:18.754950 46889 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-4048231/.minikube/key.pem, removing ...
I0429 13:43:18.754966 46889 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-4048231/.minikube/key.pem
I0429 13:43:18.755022 46889 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-4048231/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18773-4048231/.minikube/key.pem (1675 bytes)
I0429 13:43:18.755108 46889 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18773-4048231/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18773-4048231/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18773-4048231/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-637516 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-637516]
I0429 13:43:19.163787 46889 provision.go:177] copyRemoteCerts
I0429 13:43:19.163992 46889 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0429 13:43:19.164139 46889 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-637516
I0429 13:43:19.211762 46889 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37324 SSHKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/machines/old-k8s-version-637516/id_rsa Username:docker}
I0429 13:43:19.335209 46889 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0429 13:43:19.402121 46889 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0429 13:43:19.455102 46889 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0429 13:43:19.492701 46889 provision.go:87] duration metric: took 793.485177ms to configureAuth
I0429 13:43:19.492731 46889 ubuntu.go:193] setting minikube options for container-runtime
I0429 13:43:19.492909 46889 config.go:182] Loaded profile config "old-k8s-version-637516": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0429 13:43:19.492921 46889 machine.go:97] duration metric: took 4.509338736s to provisionDockerMachine
I0429 13:43:19.492929 46889 start.go:293] postStartSetup for "old-k8s-version-637516" (driver="docker")
I0429 13:43:19.492939 46889 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0429 13:43:19.492996 46889 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0429 13:43:19.493038 46889 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-637516
I0429 13:43:19.526701 46889 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37324 SSHKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/machines/old-k8s-version-637516/id_rsa Username:docker}
I0429 13:43:19.623375 46889 ssh_runner.go:195] Run: cat /etc/os-release
I0429 13:43:19.627238 46889 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0429 13:43:19.627272 46889 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0429 13:43:19.627282 46889 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0429 13:43:19.627289 46889 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0429 13:43:19.627300 46889 filesync.go:126] Scanning /home/jenkins/minikube-integration/18773-4048231/.minikube/addons for local assets ...
I0429 13:43:19.627354 46889 filesync.go:126] Scanning /home/jenkins/minikube-integration/18773-4048231/.minikube/files for local assets ...
I0429 13:43:19.627449 46889 filesync.go:149] local asset: /home/jenkins/minikube-integration/18773-4048231/.minikube/files/etc/ssl/certs/40536392.pem -> 40536392.pem in /etc/ssl/certs
I0429 13:43:19.627562 46889 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0429 13:43:19.636649 46889 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/files/etc/ssl/certs/40536392.pem --> /etc/ssl/certs/40536392.pem (1708 bytes)
I0429 13:43:19.680508 46889 start.go:296] duration metric: took 187.563311ms for postStartSetup
I0429 13:43:19.680598 46889 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0429 13:43:19.680649 46889 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-637516
I0429 13:43:19.697824 46889 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37324 SSHKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/machines/old-k8s-version-637516/id_rsa Username:docker}
I0429 13:43:19.809530 46889 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0429 13:43:19.815346 46889 fix.go:56] duration metric: took 5.326803401s for fixHost
I0429 13:43:19.815374 46889 start.go:83] releasing machines lock for "old-k8s-version-637516", held for 5.326862278s
I0429 13:43:19.815446 46889 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-637516
I0429 13:43:19.831958 46889 ssh_runner.go:195] Run: cat /version.json
I0429 13:43:19.832016 46889 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-637516
I0429 13:43:19.831965 46889 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0429 13:43:19.832073 46889 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-637516
I0429 13:43:19.860037 46889 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37324 SSHKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/machines/old-k8s-version-637516/id_rsa Username:docker}
I0429 13:43:19.861400 46889 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37324 SSHKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/machines/old-k8s-version-637516/id_rsa Username:docker}
I0429 13:43:19.951543 46889 ssh_runner.go:195] Run: systemctl --version
I0429 13:43:20.096604 46889 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0429 13:43:20.104088 46889 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0429 13:43:20.132835 46889 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0429 13:43:20.132917 46889 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0429 13:43:20.142486 46889 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0429 13:43:20.142508 46889 start.go:494] detecting cgroup driver to use...
I0429 13:43:20.142541 46889 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0429 13:43:20.142595 46889 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0429 13:43:20.159390 46889 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0429 13:43:20.172746 46889 docker.go:217] disabling cri-docker service (if available) ...
I0429 13:43:20.172810 46889 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0429 13:43:20.188276 46889 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0429 13:43:20.201303 46889 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0429 13:43:20.304088 46889 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0429 13:43:20.391808 46889 docker.go:233] disabling docker service ...
I0429 13:43:20.391933 46889 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0429 13:43:20.405933 46889 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0429 13:43:20.417821 46889 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0429 13:43:20.512554 46889 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0429 13:43:20.599671 46889 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0429 13:43:20.611273 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0429 13:43:20.627966 46889 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0429 13:43:20.637761 46889 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0429 13:43:20.648034 46889 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0429 13:43:20.648121 46889 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0429 13:43:20.657988 46889 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0429 13:43:20.671937 46889 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0429 13:43:20.681500 46889 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0429 13:43:20.691325 46889 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0429 13:43:20.700451 46889 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0429 13:43:20.710557 46889 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0429 13:43:20.718744 46889 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0429 13:43:20.727076 46889 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0429 13:43:20.819689 46889 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0429 13:43:20.997023 46889 start.go:541] Will wait 60s for socket path /run/containerd/containerd.sock
I0429 13:43:20.997145 46889 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0429 13:43:21.001713 46889 start.go:562] Will wait 60s for crictl version
I0429 13:43:21.001819 46889 ssh_runner.go:195] Run: which crictl
I0429 13:43:21.006645 46889 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0429 13:43:21.047768 46889 start.go:578] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.6.31
RuntimeApiVersion: v1
I0429 13:43:21.047931 46889 ssh_runner.go:195] Run: containerd --version
I0429 13:43:21.072724 46889 ssh_runner.go:195] Run: containerd --version
I0429 13:43:21.097953 46889 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.6.31 ...
I0429 13:43:21.100223 46889 cli_runner.go:164] Run: docker network inspect old-k8s-version-637516 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0429 13:43:21.114590 46889 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0429 13:43:21.118253 46889 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0429 13:43:21.129215 46889 kubeadm.go:877] updating cluster {Name:old-k8s-version-637516 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-637516 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0429 13:43:21.129375 46889 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0429 13:43:21.129445 46889 ssh_runner.go:195] Run: sudo crictl images --output json
I0429 13:43:21.165023 46889 containerd.go:627] all images are preloaded for containerd runtime.
I0429 13:43:21.165051 46889 containerd.go:534] Images already preloaded, skipping extraction
I0429 13:43:21.165114 46889 ssh_runner.go:195] Run: sudo crictl images --output json
I0429 13:43:21.202194 46889 containerd.go:627] all images are preloaded for containerd runtime.
I0429 13:43:21.202216 46889 cache_images.go:84] Images are preloaded, skipping loading
I0429 13:43:21.202224 46889 kubeadm.go:928] updating node { 192.168.76.2 8443 v1.20.0 containerd true true} ...
I0429 13:43:21.202341 46889 kubeadm.go:940] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-637516 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-637516 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0429 13:43:21.202415 46889 ssh_runner.go:195] Run: sudo crictl info
I0429 13:43:21.239211 46889 cni.go:84] Creating CNI manager for ""
I0429 13:43:21.239236 46889 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0429 13:43:21.239253 46889 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0429 13:43:21.239273 46889 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-637516 NodeName:old-k8s-version-637516 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0429 13:43:21.239402 46889 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-637516"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0429 13:43:21.239477 46889 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0429 13:43:21.248276 46889 binaries.go:44] Found k8s binaries, skipping transfer
I0429 13:43:21.248347 46889 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0429 13:43:21.257064 46889 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0429 13:43:21.274947 46889 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0429 13:43:21.292589 46889 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0429 13:43:21.310418 46889 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0429 13:43:21.313665 46889 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0429 13:43:21.324283 46889 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0429 13:43:21.412331 46889 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0429 13:43:21.426226 46889 certs.go:68] Setting up /home/jenkins/minikube-integration/18773-4048231/.minikube/profiles/old-k8s-version-637516 for IP: 192.168.76.2
I0429 13:43:21.426294 46889 certs.go:194] generating shared ca certs ...
I0429 13:43:21.426329 46889 certs.go:226] acquiring lock for ca certs: {Name:mk185bf624537c6ccc90f82e9e112f86a219193f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0429 13:43:21.426493 46889 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18773-4048231/.minikube/ca.key
I0429 13:43:21.426569 46889 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18773-4048231/.minikube/proxy-client-ca.key
I0429 13:43:21.426603 46889 certs.go:256] generating profile certs ...
I0429 13:43:21.426730 46889 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18773-4048231/.minikube/profiles/old-k8s-version-637516/client.key
I0429 13:43:21.426850 46889 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/18773-4048231/.minikube/profiles/old-k8s-version-637516/apiserver.key.cb713877
I0429 13:43:21.426920 46889 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18773-4048231/.minikube/profiles/old-k8s-version-637516/proxy-client.key
I0429 13:43:21.427068 46889 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-4048231/.minikube/certs/4053639.pem (1338 bytes)
W0429 13:43:21.427123 46889 certs.go:480] ignoring /home/jenkins/minikube-integration/18773-4048231/.minikube/certs/4053639_empty.pem, impossibly tiny 0 bytes
I0429 13:43:21.427147 46889 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-4048231/.minikube/certs/ca-key.pem (1679 bytes)
I0429 13:43:21.427203 46889 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-4048231/.minikube/certs/ca.pem (1078 bytes)
I0429 13:43:21.427250 46889 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-4048231/.minikube/certs/cert.pem (1123 bytes)
I0429 13:43:21.427290 46889 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-4048231/.minikube/certs/key.pem (1675 bytes)
I0429 13:43:21.427375 46889 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-4048231/.minikube/files/etc/ssl/certs/40536392.pem (1708 bytes)
I0429 13:43:21.428076 46889 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0429 13:43:21.455273 46889 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0429 13:43:21.480834 46889 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0429 13:43:21.510112 46889 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0429 13:43:21.534630 46889 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/profiles/old-k8s-version-637516/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0429 13:43:21.560098 46889 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/profiles/old-k8s-version-637516/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0429 13:43:21.585636 46889 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/profiles/old-k8s-version-637516/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0429 13:43:21.611721 46889 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/profiles/old-k8s-version-637516/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0429 13:43:21.636178 46889 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/files/etc/ssl/certs/40536392.pem --> /usr/share/ca-certificates/40536392.pem (1708 bytes)
I0429 13:43:21.660839 46889 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0429 13:43:21.684870 46889 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/certs/4053639.pem --> /usr/share/ca-certificates/4053639.pem (1338 bytes)
I0429 13:43:21.709199 46889 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0429 13:43:21.727942 46889 ssh_runner.go:195] Run: openssl version
I0429 13:43:21.734097 46889 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/4053639.pem && ln -fs /usr/share/ca-certificates/4053639.pem /etc/ssl/certs/4053639.pem"
I0429 13:43:21.743761 46889 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/4053639.pem
I0429 13:43:21.747348 46889 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 29 13:05 /usr/share/ca-certificates/4053639.pem
I0429 13:43:21.747419 46889 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/4053639.pem
I0429 13:43:21.754427 46889 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/4053639.pem /etc/ssl/certs/51391683.0"
I0429 13:43:21.763377 46889 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/40536392.pem && ln -fs /usr/share/ca-certificates/40536392.pem /etc/ssl/certs/40536392.pem"
I0429 13:43:21.772953 46889 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/40536392.pem
I0429 13:43:21.776666 46889 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 29 13:05 /usr/share/ca-certificates/40536392.pem
I0429 13:43:21.776737 46889 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/40536392.pem
I0429 13:43:21.783732 46889 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/40536392.pem /etc/ssl/certs/3ec20f2e.0"
I0429 13:43:21.792862 46889 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0429 13:43:21.802217 46889 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0429 13:43:21.805796 46889 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 29 12:59 /usr/share/ca-certificates/minikubeCA.pem
I0429 13:43:21.805865 46889 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0429 13:43:21.812838 46889 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0429 13:43:21.822056 46889 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0429 13:43:21.825733 46889 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0429 13:43:21.832642 46889 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0429 13:43:21.839791 46889 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0429 13:43:21.846933 46889 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0429 13:43:21.854223 46889 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0429 13:43:21.861187 46889 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0429 13:43:21.868183 46889 kubeadm.go:391] StartCluster: {Name:old-k8s-version-637516 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-637516 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0429 13:43:21.868338 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0429 13:43:21.868424 46889 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0429 13:43:21.905678 46889 cri.go:89] found id: "ceace251a3f285f11b13a433c49367b13d702752ff40ae66e2e8b3ac72bf71b2"
I0429 13:43:21.905750 46889 cri.go:89] found id: "a5cfd5bb8f0ed7a05537e05ebd53400321ab1920ff861bde8bfd37f0df224181"
I0429 13:43:21.905770 46889 cri.go:89] found id: "2d56c26090f29460a7f6de0be95e5742db6f734116e1e0b8060dba86b11a18c5"
I0429 13:43:21.905795 46889 cri.go:89] found id: "afe201cf19cd54f9626556f9fb2af59a62b57b2fc3870087ea49951763023e6a"
I0429 13:43:21.905821 46889 cri.go:89] found id: "92695848292c9dcf5fb37f9b7432bba3fafa7483ced7559a57ab1206427c21f3"
I0429 13:43:21.905839 46889 cri.go:89] found id: "eebb19d675cf51320fc9b8f9626a50880eba8fff7e0cae674a7b0477d516f3c9"
I0429 13:43:21.905857 46889 cri.go:89] found id: "487a468a367155648e2599415872a829294e36e2f52064e34362ae63b9dc2b51"
I0429 13:43:21.905877 46889 cri.go:89] found id: "676b344d21c39a7b716ddccc155a37537ba17d9d55bded00344944a3b5251ae1"
I0429 13:43:21.905904 46889 cri.go:89] found id: ""
I0429 13:43:21.905983 46889 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0429 13:43:21.918349 46889 cri.go:116] JSON = null
W0429 13:43:21.918398 46889 kubeadm.go:398] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0429 13:43:21.918496 46889 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0429 13:43:21.927702 46889 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0429 13:43:21.927724 46889 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0429 13:43:21.927730 46889 kubeadm.go:587] restartPrimaryControlPlane start ...
I0429 13:43:21.927810 46889 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0429 13:43:21.936381 46889 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0429 13:43:21.936852 46889 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-637516" does not appear in /home/jenkins/minikube-integration/18773-4048231/kubeconfig
I0429 13:43:21.936956 46889 kubeconfig.go:62] /home/jenkins/minikube-integration/18773-4048231/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-637516" cluster setting kubeconfig missing "old-k8s-version-637516" context setting]
I0429 13:43:21.937219 46889 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-4048231/kubeconfig: {Name:mk99307e7393ce97359527fd48eaac92355b4aa7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0429 13:43:21.938395 46889 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0429 13:43:21.947182 46889 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.76.2
I0429 13:43:21.947221 46889 kubeadm.go:591] duration metric: took 19.484792ms to restartPrimaryControlPlane
I0429 13:43:21.947231 46889 kubeadm.go:393] duration metric: took 79.057711ms to StartCluster
I0429 13:43:21.947247 46889 settings.go:142] acquiring lock: {Name:mk1ad2799378a4d44dee4747f8fba3052ff08735 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0429 13:43:21.947313 46889 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/18773-4048231/kubeconfig
I0429 13:43:21.947981 46889 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-4048231/kubeconfig: {Name:mk99307e7393ce97359527fd48eaac92355b4aa7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0429 13:43:21.948179 46889 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0429 13:43:21.951014 46889 out.go:177] * Verifying Kubernetes components...
I0429 13:43:21.948459 46889 config.go:182] Loaded profile config "old-k8s-version-637516": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0429 13:43:21.948471 46889 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0429 13:43:21.953291 46889 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0429 13:43:21.951135 46889 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-637516"
I0429 13:43:21.953413 46889 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-637516"
W0429 13:43:21.953431 46889 addons.go:243] addon storage-provisioner should already be in state true
I0429 13:43:21.951219 46889 addons.go:69] Setting dashboard=true in profile "old-k8s-version-637516"
I0429 13:43:21.953461 46889 addons.go:234] Setting addon dashboard=true in "old-k8s-version-637516"
I0429 13:43:21.951224 46889 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-637516"
W0429 13:43:21.953469 46889 addons.go:243] addon dashboard should already be in state true
I0429 13:43:21.953480 46889 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-637516"
I0429 13:43:21.953491 46889 host.go:66] Checking if "old-k8s-version-637516" exists ...
I0429 13:43:21.953769 46889 cli_runner.go:164] Run: docker container inspect old-k8s-version-637516 --format={{.State.Status}}
I0429 13:43:21.953897 46889 cli_runner.go:164] Run: docker container inspect old-k8s-version-637516 --format={{.State.Status}}
I0429 13:43:21.953462 46889 host.go:66] Checking if "old-k8s-version-637516" exists ...
I0429 13:43:21.956303 46889 cli_runner.go:164] Run: docker container inspect old-k8s-version-637516 --format={{.State.Status}}
I0429 13:43:21.951229 46889 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-637516"
I0429 13:43:21.956508 46889 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-637516"
W0429 13:43:21.956519 46889 addons.go:243] addon metrics-server should already be in state true
I0429 13:43:21.956548 46889 host.go:66] Checking if "old-k8s-version-637516" exists ...
I0429 13:43:21.956935 46889 cli_runner.go:164] Run: docker container inspect old-k8s-version-637516 --format={{.State.Status}}
I0429 13:43:21.987158 46889 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-637516"
W0429 13:43:21.987184 46889 addons.go:243] addon default-storageclass should already be in state true
I0429 13:43:21.987209 46889 host.go:66] Checking if "old-k8s-version-637516" exists ...
I0429 13:43:21.987629 46889 cli_runner.go:164] Run: docker container inspect old-k8s-version-637516 --format={{.State.Status}}
I0429 13:43:22.036445 46889 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0429 13:43:22.038535 46889 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0429 13:43:22.041056 46889 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0429 13:43:22.043461 46889 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0429 13:43:22.043486 46889 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0429 13:43:22.043557 46889 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-637516
I0429 13:43:22.041109 46889 addons.go:426] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0429 13:43:22.046970 46889 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0429 13:43:22.047052 46889 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-637516
I0429 13:43:22.041120 46889 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0429 13:43:22.049413 46889 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0429 13:43:22.049441 46889 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0429 13:43:22.049520 46889 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-637516
I0429 13:43:22.056763 46889 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0429 13:43:22.056787 46889 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0429 13:43:22.056849 46889 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-637516
I0429 13:43:22.078959 46889 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37324 SSHKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/machines/old-k8s-version-637516/id_rsa Username:docker}
I0429 13:43:22.104933 46889 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0429 13:43:22.108454 46889 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37324 SSHKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/machines/old-k8s-version-637516/id_rsa Username:docker}
I0429 13:43:22.110067 46889 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37324 SSHKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/machines/old-k8s-version-637516/id_rsa Username:docker}
I0429 13:43:22.125109 46889 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37324 SSHKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/machines/old-k8s-version-637516/id_rsa Username:docker}
I0429 13:43:22.127687 46889 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-637516" to be "Ready" ...
I0429 13:43:22.238303 46889 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0429 13:43:22.238384 46889 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0429 13:43:22.251284 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0429 13:43:22.265224 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0429 13:43:22.271872 46889 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0429 13:43:22.271942 46889 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0429 13:43:22.286434 46889 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0429 13:43:22.286503 46889 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0429 13:43:22.319914 46889 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0429 13:43:22.319984 46889 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0429 13:43:22.367693 46889 addons.go:426] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0429 13:43:22.367802 46889 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0429 13:43:22.384899 46889 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0429 13:43:22.384968 46889 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
W0429 13:43:22.431773 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:22.431851 46889 retry.go:31] will retry after 289.795034ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0429 13:43:22.435029 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:22.435127 46889 retry.go:31] will retry after 362.856893ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:22.437232 46889 addons.go:426] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0429 13:43:22.437257 46889 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0429 13:43:22.438388 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0429 13:43:22.466098 46889 addons.go:426] installing /etc/kubernetes/addons/dashboard-role.yaml
I0429 13:43:22.466126 46889 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0429 13:43:22.510881 46889 addons.go:426] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0429 13:43:22.510912 46889 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0429 13:43:22.546078 46889 addons.go:426] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0429 13:43:22.546103 46889 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
W0429 13:43:22.560829 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:22.560859 46889 retry.go:31] will retry after 350.508748ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:22.565691 46889 addons.go:426] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0429 13:43:22.565761 46889 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0429 13:43:22.583782 46889 addons.go:426] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0429 13:43:22.583809 46889 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0429 13:43:22.606664 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0429 13:43:22.705437 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:22.705470 46889 retry.go:31] will retry after 138.989767ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:22.722853 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0429 13:43:22.798129 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0429 13:43:22.828485 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:22.828513 46889 retry.go:31] will retry after 329.421683ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:22.844818 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0429 13:43:22.912191 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0429 13:43:22.999395 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:22.999425 46889 retry.go:31] will retry after 470.457131ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0429 13:43:22.999279 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:22.999520 46889 retry.go:31] will retry after 441.771589ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0429 13:43:23.054279 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:23.054311 46889 retry.go:31] will retry after 407.823311ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:23.159049 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0429 13:43:23.244556 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:23.244598 46889 retry.go:31] will retry after 294.90695ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:23.442030 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0429 13:43:23.462614 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0429 13:43:23.470909 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0429 13:43:23.540012 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0429 13:43:23.662845 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:23.662960 46889 retry.go:31] will retry after 409.482938ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0429 13:43:23.756994 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:23.757031 46889 retry.go:31] will retry after 531.498531ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0429 13:43:23.814054 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:23.814086 46889 retry.go:31] will retry after 485.618143ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0429 13:43:23.828437 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:23.828529 46889 retry.go:31] will retry after 903.829947ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:24.072988 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0429 13:43:24.128641 46889 node_ready.go:53] error getting node "old-k8s-version-637516": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-637516": dial tcp 192.168.76.2:8443: connect: connection refused
W0429 13:43:24.163789 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:24.163824 46889 retry.go:31] will retry after 591.238496ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:24.289162 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0429 13:43:24.300694 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0429 13:43:24.419565 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:24.419606 46889 retry.go:31] will retry after 1.147721483s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0429 13:43:24.453884 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:24.453913 46889 retry.go:31] will retry after 639.209941ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:24.732722 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0429 13:43:24.755978 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0429 13:43:24.896194 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:24.896237 46889 retry.go:31] will retry after 814.633769ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0429 13:43:24.923233 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:24.923274 46889 retry.go:31] will retry after 1.562542221s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:25.093789 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0429 13:43:25.192369 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:25.192407 46889 retry.go:31] will retry after 1.021419377s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:25.567793 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0429 13:43:25.642276 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:25.642307 46889 retry.go:31] will retry after 851.558151ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:25.711470 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0429 13:43:25.813875 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:25.813910 46889 retry.go:31] will retry after 1.90294183s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:26.214912 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0429 13:43:26.375933 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:26.375963 46889 retry.go:31] will retry after 2.555193489s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:26.486286 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0429 13:43:26.494298 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0429 13:43:26.628858 46889 node_ready.go:53] error getting node "old-k8s-version-637516": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-637516": dial tcp 192.168.76.2:8443: connect: connection refused
W0429 13:43:26.734249 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:26.734279 46889 retry.go:31] will retry after 2.748378251s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0429 13:43:26.754436 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:26.754469 46889 retry.go:31] will retry after 2.353989424s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:27.717849 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0429 13:43:27.794940 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:27.794968 46889 retry.go:31] will retry after 3.510517427s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:28.931690 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0429 13:43:29.009130 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:29.009163 46889 retry.go:31] will retry after 2.230320925s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:29.109319 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0429 13:43:29.129017 46889 node_ready.go:53] error getting node "old-k8s-version-637516": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-637516": dial tcp 192.168.76.2:8443: connect: connection refused
W0429 13:43:29.208562 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:29.208596 46889 retry.go:31] will retry after 2.391696414s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:29.483068 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0429 13:43:29.570496 46889 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:29.570533 46889 retry.go:31] will retry after 3.092689117s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 13:43:31.129114 46889 node_ready.go:53] error getting node "old-k8s-version-637516": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-637516": dial tcp 192.168.76.2:8443: connect: connection refused
I0429 13:43:31.240487 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0429 13:43:31.305638 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0429 13:43:31.601162 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0429 13:43:32.663809 46889 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0429 13:43:42.024129 46889 node_ready.go:49] node "old-k8s-version-637516" has status "Ready":"True"
I0429 13:43:42.024163 46889 node_ready.go:38] duration metric: took 19.896440686s for node "old-k8s-version-637516" to be "Ready" ...
I0429 13:43:42.024175 46889 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0429 13:43:42.176100 46889 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-lcl72" in "kube-system" namespace to be "Ready" ...
I0429 13:43:42.213528 46889 pod_ready.go:92] pod "coredns-74ff55c5b-lcl72" in "kube-system" namespace has status "Ready":"True"
I0429 13:43:42.213561 46889 pod_ready.go:81] duration metric: took 37.415313ms for pod "coredns-74ff55c5b-lcl72" in "kube-system" namespace to be "Ready" ...
I0429 13:43:42.213576 46889 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-637516" in "kube-system" namespace to be "Ready" ...
I0429 13:43:43.153157 46889 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (11.912598078s)
I0429 13:43:43.155323 46889 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-637516 addons enable metrics-server
I0429 13:43:43.153359 46889 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (11.847693281s)
I0429 13:43:43.153454 46889 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (11.552254708s)
I0429 13:43:43.153546 46889 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (10.489703651s)
I0429 13:43:43.157382 46889 addons.go:470] Verifying addon metrics-server=true in "old-k8s-version-637516"
I0429 13:43:43.168359 46889 out.go:177] * Enabled addons: dashboard, storage-provisioner, metrics-server, default-storageclass
I0429 13:43:43.170617 46889 addons.go:505] duration metric: took 21.222138176s for enable addons: enabled=[dashboard storage-provisioner metrics-server default-storageclass]
I0429 13:43:44.225466 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:43:46.228837 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:43:48.236155 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:43:50.720532 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:43:52.721162 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:43:55.220856 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:43:57.228119 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:43:59.720327 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:01.766437 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:04.220813 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:06.225644 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:08.720831 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:10.720988 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:13.220566 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:15.220880 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:17.719826 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:20.219884 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:22.719684 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:25.220598 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:27.719830 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:29.720988 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:32.220891 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:34.721112 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:37.220453 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:39.224106 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:41.720645 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:44.220070 46889 pod_ready.go:102] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:45.223395 46889 pod_ready.go:92] pod "etcd-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"True"
I0429 13:44:45.223428 46889 pod_ready.go:81] duration metric: took 1m3.009843577s for pod "etcd-old-k8s-version-637516" in "kube-system" namespace to be "Ready" ...
I0429 13:44:45.223482 46889 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-637516" in "kube-system" namespace to be "Ready" ...
I0429 13:44:45.235965 46889 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"True"
I0429 13:44:45.235989 46889 pod_ready.go:81] duration metric: took 12.482422ms for pod "kube-apiserver-old-k8s-version-637516" in "kube-system" namespace to be "Ready" ...
I0429 13:44:45.236003 46889 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-637516" in "kube-system" namespace to be "Ready" ...
I0429 13:44:46.244068 46889 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"True"
I0429 13:44:46.244094 46889 pod_ready.go:81] duration metric: took 1.00808316s for pod "kube-controller-manager-old-k8s-version-637516" in "kube-system" namespace to be "Ready" ...
I0429 13:44:46.244107 46889 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-vqvz9" in "kube-system" namespace to be "Ready" ...
I0429 13:44:46.252369 46889 pod_ready.go:92] pod "kube-proxy-vqvz9" in "kube-system" namespace has status "Ready":"True"
I0429 13:44:46.252393 46889 pod_ready.go:81] duration metric: took 8.278285ms for pod "kube-proxy-vqvz9" in "kube-system" namespace to be "Ready" ...
I0429 13:44:46.252405 46889 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-637516" in "kube-system" namespace to be "Ready" ...
I0429 13:44:48.259366 46889 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:50.758556 46889 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:52.758957 46889 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:55.259130 46889 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:57.259646 46889 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:59.260482 46889 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:01.759039 46889 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:03.760878 46889 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:05.761246 46889 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:07.259644 46889 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"True"
I0429 13:45:07.259674 46889 pod_ready.go:81] duration metric: took 21.007258891s for pod "kube-scheduler-old-k8s-version-637516" in "kube-system" namespace to be "Ready" ...
I0429 13:45:07.259687 46889 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace to be "Ready" ...
I0429 13:45:09.266750 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:11.767076 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:14.266084 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:16.268283 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:18.765832 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:21.265522 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:23.267042 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:25.268120 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:27.773072 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:30.265959 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:32.279584 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:34.765777 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:37.266136 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:39.266444 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:41.766224 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:44.265827 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:46.778473 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:49.266291 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:51.765990 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:54.266385 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:56.266703 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:58.766020 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:01.266408 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:03.268438 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:05.765712 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:08.265823 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:10.767055 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:13.265300 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:15.266602 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:17.766600 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:20.265568 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:22.266916 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:24.765419 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:26.765466 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:28.766368 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:30.766841 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:33.265686 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:35.265738 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:37.266337 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:39.266780 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:41.766138 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:44.266146 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:46.266373 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:48.271532 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:50.765849 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:53.267090 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:55.766570 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:58.266145 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:00.279814 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:02.766362 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:04.768920 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:07.265957 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:09.765714 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:11.766055 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:13.766195 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:16.265916 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:18.267250 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:20.766414 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:23.275169 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:25.766313 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:28.266512 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:30.765688 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:32.765884 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:34.766413 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:36.766520 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:39.266880 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:41.766480 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:44.266497 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:46.766591 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:49.266180 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:51.765842 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:53.803685 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:56.266376 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:58.766240 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:00.768307 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:03.266231 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:05.266664 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:07.765258 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:09.765652 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:12.266221 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:14.266533 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:16.766191 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:19.268466 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:21.765904 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:24.266340 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:26.765975 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:28.766878 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:31.265168 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:33.766220 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:36.266902 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:38.766387 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:41.266575 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:43.765349 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:46.265648 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:48.771839 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:51.265770 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:53.267458 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:55.765281 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:57.765726 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:59.765838 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:49:02.265615 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:49:04.765522 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:49:06.765736 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:49:07.265941 46889 pod_ready.go:81] duration metric: took 4m0.00619779s for pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace to be "Ready" ...
E0429 13:49:07.265966 46889 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0429 13:49:07.265975 46889 pod_ready.go:38] duration metric: took 5m25.241788145s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0429 13:49:07.265990 46889 api_server.go:52] waiting for apiserver process to appear ...
I0429 13:49:07.266035 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0429 13:49:07.266100 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0429 13:49:07.319128 46889 cri.go:89] found id: "6f49514fe6938949387be25147dcb0463b2b9ae15ee83e14cae5c70460c06a68"
I0429 13:49:07.319155 46889 cri.go:89] found id: "92695848292c9dcf5fb37f9b7432bba3fafa7483ced7559a57ab1206427c21f3"
I0429 13:49:07.319161 46889 cri.go:89] found id: ""
I0429 13:49:07.319168 46889 logs.go:276] 2 containers: [6f49514fe6938949387be25147dcb0463b2b9ae15ee83e14cae5c70460c06a68 92695848292c9dcf5fb37f9b7432bba3fafa7483ced7559a57ab1206427c21f3]
I0429 13:49:07.319234 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.323642 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.327311 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0429 13:49:07.327397 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0429 13:49:07.367816 46889 cri.go:89] found id: "d822d5375019aa8b6fdae088edca5093130b82835432dd2833a71ae56c9a1753"
I0429 13:49:07.367836 46889 cri.go:89] found id: "487a468a367155648e2599415872a829294e36e2f52064e34362ae63b9dc2b51"
I0429 13:49:07.367841 46889 cri.go:89] found id: ""
I0429 13:49:07.367848 46889 logs.go:276] 2 containers: [d822d5375019aa8b6fdae088edca5093130b82835432dd2833a71ae56c9a1753 487a468a367155648e2599415872a829294e36e2f52064e34362ae63b9dc2b51]
I0429 13:49:07.367914 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.372145 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.376346 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0429 13:49:07.376435 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0429 13:49:07.434170 46889 cri.go:89] found id: "99aafd29fea02a0255847f0185b6468d29d23dead19e79879c006c7b1030f5b5"
I0429 13:49:07.434198 46889 cri.go:89] found id: "ceace251a3f285f11b13a433c49367b13d702752ff40ae66e2e8b3ac72bf71b2"
I0429 13:49:07.434204 46889 cri.go:89] found id: ""
I0429 13:49:07.434212 46889 logs.go:276] 2 containers: [99aafd29fea02a0255847f0185b6468d29d23dead19e79879c006c7b1030f5b5 ceace251a3f285f11b13a433c49367b13d702752ff40ae66e2e8b3ac72bf71b2]
I0429 13:49:07.434278 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.440463 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.444669 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0429 13:49:07.444744 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0429 13:49:07.484806 46889 cri.go:89] found id: "4b9d2030c82b4b99a0f1aa9c220a7d550fa28b6799c689551c3e01a257cf14fe"
I0429 13:49:07.484830 46889 cri.go:89] found id: "676b344d21c39a7b716ddccc155a37537ba17d9d55bded00344944a3b5251ae1"
I0429 13:49:07.484835 46889 cri.go:89] found id: ""
I0429 13:49:07.484843 46889 logs.go:276] 2 containers: [4b9d2030c82b4b99a0f1aa9c220a7d550fa28b6799c689551c3e01a257cf14fe 676b344d21c39a7b716ddccc155a37537ba17d9d55bded00344944a3b5251ae1]
I0429 13:49:07.484902 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.488851 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.492226 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0429 13:49:07.492303 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0429 13:49:07.536632 46889 cri.go:89] found id: "ac0d7e8ff20e394f5786d75b39f6d09a8343e15d46a71c3ba119572cf16daac8"
I0429 13:49:07.536717 46889 cri.go:89] found id: "afe201cf19cd54f9626556f9fb2af59a62b57b2fc3870087ea49951763023e6a"
I0429 13:49:07.536735 46889 cri.go:89] found id: ""
I0429 13:49:07.536744 46889 logs.go:276] 2 containers: [ac0d7e8ff20e394f5786d75b39f6d09a8343e15d46a71c3ba119572cf16daac8 afe201cf19cd54f9626556f9fb2af59a62b57b2fc3870087ea49951763023e6a]
I0429 13:49:07.536810 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.540566 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.544205 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0429 13:49:07.544308 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0429 13:49:07.586363 46889 cri.go:89] found id: "46b329f549c16117b457f7dc74e36a56f69621b977c14a4225023ad5189c1e6f"
I0429 13:49:07.586387 46889 cri.go:89] found id: "eebb19d675cf51320fc9b8f9626a50880eba8fff7e0cae674a7b0477d516f3c9"
I0429 13:49:07.586392 46889 cri.go:89] found id: ""
I0429 13:49:07.586400 46889 logs.go:276] 2 containers: [46b329f549c16117b457f7dc74e36a56f69621b977c14a4225023ad5189c1e6f eebb19d675cf51320fc9b8f9626a50880eba8fff7e0cae674a7b0477d516f3c9]
I0429 13:49:07.586466 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.590576 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.594012 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0429 13:49:07.594087 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0429 13:49:07.643343 46889 cri.go:89] found id: "b9ff1e04cc2c14075223ed4143af7eab578112a95cd911df71fd61fe781efe9d"
I0429 13:49:07.643415 46889 cri.go:89] found id: "2d56c26090f29460a7f6de0be95e5742db6f734116e1e0b8060dba86b11a18c5"
I0429 13:49:07.643432 46889 cri.go:89] found id: ""
I0429 13:49:07.643454 46889 logs.go:276] 2 containers: [b9ff1e04cc2c14075223ed4143af7eab578112a95cd911df71fd61fe781efe9d 2d56c26090f29460a7f6de0be95e5742db6f734116e1e0b8060dba86b11a18c5]
I0429 13:49:07.643519 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.647310 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.650895 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0429 13:49:07.650976 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0429 13:49:07.692477 46889 cri.go:89] found id: "1171f7bf9e312d4e83e31789284ded3b56c8733f0f86756b847094cf17e199fc"
I0429 13:49:07.692556 46889 cri.go:89] found id: ""
I0429 13:49:07.692570 46889 logs.go:276] 1 containers: [1171f7bf9e312d4e83e31789284ded3b56c8733f0f86756b847094cf17e199fc]
I0429 13:49:07.692636 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.696513 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0429 13:49:07.696588 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0429 13:49:07.736604 46889 cri.go:89] found id: "b8faf4156978f8c5ec933471c71bdc73a0b442e4b837e3bdabab95ad9cf09146"
I0429 13:49:07.736626 46889 cri.go:89] found id: "9eb815c958691521a891ce6a646a8fe229c3c32994b0bd94e3911286c5e1a6d4"
I0429 13:49:07.736632 46889 cri.go:89] found id: ""
I0429 13:49:07.736639 46889 logs.go:276] 2 containers: [b8faf4156978f8c5ec933471c71bdc73a0b442e4b837e3bdabab95ad9cf09146 9eb815c958691521a891ce6a646a8fe229c3c32994b0bd94e3911286c5e1a6d4]
I0429 13:49:07.736701 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.740688 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.744245 46889 logs.go:123] Gathering logs for coredns [ceace251a3f285f11b13a433c49367b13d702752ff40ae66e2e8b3ac72bf71b2] ...
I0429 13:49:07.744270 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ceace251a3f285f11b13a433c49367b13d702752ff40ae66e2e8b3ac72bf71b2"
I0429 13:49:07.792535 46889 logs.go:123] Gathering logs for dmesg ...
I0429 13:49:07.792567 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0429 13:49:07.813587 46889 logs.go:123] Gathering logs for kube-apiserver [92695848292c9dcf5fb37f9b7432bba3fafa7483ced7559a57ab1206427c21f3] ...
I0429 13:49:07.813617 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 92695848292c9dcf5fb37f9b7432bba3fafa7483ced7559a57ab1206427c21f3"
I0429 13:49:07.870937 46889 logs.go:123] Gathering logs for coredns [99aafd29fea02a0255847f0185b6468d29d23dead19e79879c006c7b1030f5b5] ...
I0429 13:49:07.870971 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 99aafd29fea02a0255847f0185b6468d29d23dead19e79879c006c7b1030f5b5"
I0429 13:49:07.924127 46889 logs.go:123] Gathering logs for kube-scheduler [4b9d2030c82b4b99a0f1aa9c220a7d550fa28b6799c689551c3e01a257cf14fe] ...
I0429 13:49:07.924155 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4b9d2030c82b4b99a0f1aa9c220a7d550fa28b6799c689551c3e01a257cf14fe"
I0429 13:49:07.971460 46889 logs.go:123] Gathering logs for kube-scheduler [676b344d21c39a7b716ddccc155a37537ba17d9d55bded00344944a3b5251ae1] ...
I0429 13:49:07.971492 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 676b344d21c39a7b716ddccc155a37537ba17d9d55bded00344944a3b5251ae1"
I0429 13:49:08.020657 46889 logs.go:123] Gathering logs for storage-provisioner [9eb815c958691521a891ce6a646a8fe229c3c32994b0bd94e3911286c5e1a6d4] ...
I0429 13:49:08.020690 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9eb815c958691521a891ce6a646a8fe229c3c32994b0bd94e3911286c5e1a6d4"
I0429 13:49:08.062079 46889 logs.go:123] Gathering logs for kube-apiserver [6f49514fe6938949387be25147dcb0463b2b9ae15ee83e14cae5c70460c06a68] ...
I0429 13:49:08.062108 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6f49514fe6938949387be25147dcb0463b2b9ae15ee83e14cae5c70460c06a68"
I0429 13:49:08.131183 46889 logs.go:123] Gathering logs for etcd [487a468a367155648e2599415872a829294e36e2f52064e34362ae63b9dc2b51] ...
I0429 13:49:08.131225 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 487a468a367155648e2599415872a829294e36e2f52064e34362ae63b9dc2b51"
I0429 13:49:08.184979 46889 logs.go:123] Gathering logs for kube-proxy [ac0d7e8ff20e394f5786d75b39f6d09a8343e15d46a71c3ba119572cf16daac8] ...
I0429 13:49:08.185009 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ac0d7e8ff20e394f5786d75b39f6d09a8343e15d46a71c3ba119572cf16daac8"
I0429 13:49:08.233437 46889 logs.go:123] Gathering logs for kube-proxy [afe201cf19cd54f9626556f9fb2af59a62b57b2fc3870087ea49951763023e6a] ...
I0429 13:49:08.233467 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 afe201cf19cd54f9626556f9fb2af59a62b57b2fc3870087ea49951763023e6a"
I0429 13:49:08.299373 46889 logs.go:123] Gathering logs for kindnet [b9ff1e04cc2c14075223ed4143af7eab578112a95cd911df71fd61fe781efe9d] ...
I0429 13:49:08.299402 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b9ff1e04cc2c14075223ed4143af7eab578112a95cd911df71fd61fe781efe9d"
I0429 13:49:08.347036 46889 logs.go:123] Gathering logs for kindnet [2d56c26090f29460a7f6de0be95e5742db6f734116e1e0b8060dba86b11a18c5] ...
I0429 13:49:08.347066 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2d56c26090f29460a7f6de0be95e5742db6f734116e1e0b8060dba86b11a18c5"
I0429 13:49:08.399470 46889 logs.go:123] Gathering logs for storage-provisioner [b8faf4156978f8c5ec933471c71bdc73a0b442e4b837e3bdabab95ad9cf09146] ...
I0429 13:49:08.399500 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b8faf4156978f8c5ec933471c71bdc73a0b442e4b837e3bdabab95ad9cf09146"
I0429 13:49:08.438967 46889 logs.go:123] Gathering logs for container status ...
I0429 13:49:08.439037 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0429 13:49:08.485269 46889 logs.go:123] Gathering logs for kubelet ...
I0429 13:49:08.485297 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0429 13:49:08.542300 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857623 659 reflector.go:138] object-"default"/"default-token-nlkvk": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-nlkvk" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:08.542562 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857721 659 reflector.go:138] object-"kube-system"/"kube-proxy-token-6ww95": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-6ww95" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:08.542773 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857791 659 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:08.542985 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857856 659 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:08.543217 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857908 659 reflector.go:138] object-"kube-system"/"storage-provisioner-token-d45m7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-d45m7" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:08.543429 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857965 659 reflector.go:138] object-"kube-system"/"kindnet-token-kb54z": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-kb54z" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:08.543681 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.858021 659 reflector.go:138] object-"kube-system"/"coredns-token-8fhcc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-8fhcc" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:08.543910 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.858109 659 reflector.go:138] object-"kube-system"/"metrics-server-token-5dph5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-5dph5" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:08.552068 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:43 old-k8s-version-637516 kubelet[659]: E0429 13:43:43.774651 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0429 13:49:08.552403 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:44 old-k8s-version-637516 kubelet[659]: E0429 13:43:44.097901 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.557193 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:55 old-k8s-version-637516 kubelet[659]: E0429 13:43:55.958973 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0429 13:49:08.558862 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:09 old-k8s-version-637516 kubelet[659]: E0429 13:44:09.944369 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.559656 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:14 old-k8s-version-637516 kubelet[659]: E0429 13:44:14.326723 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.560224 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:15 old-k8s-version-637516 kubelet[659]: E0429 13:44:15.330554 659 pod_workers.go:191] Error syncing pod 768c1e4c-85ee-4968-9c8c-df33fac74bf3 ("storage-provisioner_kube-system(768c1e4c-85ee-4968-9c8c-df33fac74bf3)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(768c1e4c-85ee-4968-9c8c-df33fac74bf3)"
W0429 13:49:08.560552 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:15 old-k8s-version-637516 kubelet[659]: E0429 13:44:15.349369 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.560878 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:16 old-k8s-version-637516 kubelet[659]: E0429 13:44:16.353332 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.563657 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:24 old-k8s-version-637516 kubelet[659]: E0429 13:44:24.940536 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0429 13:49:08.564374 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:28 old-k8s-version-637516 kubelet[659]: E0429 13:44:28.387652 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.564701 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:35 old-k8s-version-637516 kubelet[659]: E0429 13:44:35.903409 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.564882 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:36 old-k8s-version-637516 kubelet[659]: E0429 13:44:36.931263 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.565207 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:46 old-k8s-version-637516 kubelet[659]: E0429 13:44:46.931347 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.565396 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:48 old-k8s-version-637516 kubelet[659]: E0429 13:44:48.931189 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.565978 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:59 old-k8s-version-637516 kubelet[659]: E0429 13:44:59.455798 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.566161 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:00 old-k8s-version-637516 kubelet[659]: E0429 13:45:00.931323 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.566485 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:05 old-k8s-version-637516 kubelet[659]: E0429 13:45:05.903931 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.568942 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:13 old-k8s-version-637516 kubelet[659]: E0429 13:45:13.944072 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0429 13:49:08.569269 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:16 old-k8s-version-637516 kubelet[659]: E0429 13:45:16.930872 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.569454 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:25 old-k8s-version-637516 kubelet[659]: E0429 13:45:25.931864 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.569796 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:27 old-k8s-version-637516 kubelet[659]: E0429 13:45:27.931269 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.570110 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:39 old-k8s-version-637516 kubelet[659]: E0429 13:45:39.933057 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.570563 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:40 old-k8s-version-637516 kubelet[659]: E0429 13:45:40.548936 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.570903 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:45 old-k8s-version-637516 kubelet[659]: E0429 13:45:45.903448 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.571091 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:51 old-k8s-version-637516 kubelet[659]: E0429 13:45:51.935180 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.571422 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:00 old-k8s-version-637516 kubelet[659]: E0429 13:46:00.931055 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.571606 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:04 old-k8s-version-637516 kubelet[659]: E0429 13:46:04.931269 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.571930 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:11 old-k8s-version-637516 kubelet[659]: E0429 13:46:11.931371 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.572117 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:15 old-k8s-version-637516 kubelet[659]: E0429 13:46:15.931701 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.572439 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:26 old-k8s-version-637516 kubelet[659]: E0429 13:46:26.931099 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.572624 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:29 old-k8s-version-637516 kubelet[659]: E0429 13:46:29.932102 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.572949 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:39 old-k8s-version-637516 kubelet[659]: E0429 13:46:39.931852 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.575406 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:44 old-k8s-version-637516 kubelet[659]: E0429 13:46:44.939309 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0429 13:49:08.575737 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:52 old-k8s-version-637516 kubelet[659]: E0429 13:46:52.930774 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.575921 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:56 old-k8s-version-637516 kubelet[659]: E0429 13:46:56.931506 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.576514 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:05 old-k8s-version-637516 kubelet[659]: E0429 13:47:05.770364 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.576837 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:06 old-k8s-version-637516 kubelet[659]: E0429 13:47:06.773003 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.577020 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:08 old-k8s-version-637516 kubelet[659]: E0429 13:47:08.931577 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.577205 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:19 old-k8s-version-637516 kubelet[659]: E0429 13:47:19.935693 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.577530 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:19 old-k8s-version-637516 kubelet[659]: E0429 13:47:19.937549 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.577715 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:31 old-k8s-version-637516 kubelet[659]: E0429 13:47:31.936395 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.578038 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:34 old-k8s-version-637516 kubelet[659]: E0429 13:47:34.930862 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.578222 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:44 old-k8s-version-637516 kubelet[659]: E0429 13:47:44.931375 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.578550 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:47 old-k8s-version-637516 kubelet[659]: E0429 13:47:47.930873 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.578735 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:59 old-k8s-version-637516 kubelet[659]: E0429 13:47:59.931717 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.579070 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:01 old-k8s-version-637516 kubelet[659]: E0429 13:48:01.931616 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.579258 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:10 old-k8s-version-637516 kubelet[659]: E0429 13:48:10.931290 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.579579 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:14 old-k8s-version-637516 kubelet[659]: E0429 13:48:14.931904 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.579763 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:21 old-k8s-version-637516 kubelet[659]: E0429 13:48:21.931833 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.580086 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:27 old-k8s-version-637516 kubelet[659]: E0429 13:48:27.931422 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.580272 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:35 old-k8s-version-637516 kubelet[659]: E0429 13:48:35.931483 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.580596 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:42 old-k8s-version-637516 kubelet[659]: E0429 13:48:42.930864 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.580779 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:48 old-k8s-version-637516 kubelet[659]: E0429 13:48:48.932975 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.581109 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:56 old-k8s-version-637516 kubelet[659]: E0429 13:48:56.930900 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.581294 46889 logs.go:138] Found kubelet problem: Apr 29 13:49:01 old-k8s-version-637516 kubelet[659]: E0429 13:49:01.931193 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.581617 46889 logs.go:138] Found kubelet problem: Apr 29 13:49:07 old-k8s-version-637516 kubelet[659]: E0429 13:49:07.931524 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
I0429 13:49:08.581628 46889 logs.go:123] Gathering logs for etcd [d822d5375019aa8b6fdae088edca5093130b82835432dd2833a71ae56c9a1753] ...
I0429 13:49:08.581643 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d822d5375019aa8b6fdae088edca5093130b82835432dd2833a71ae56c9a1753"
I0429 13:49:08.646262 46889 logs.go:123] Gathering logs for kube-controller-manager [eebb19d675cf51320fc9b8f9626a50880eba8fff7e0cae674a7b0477d516f3c9] ...
I0429 13:49:08.646294 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 eebb19d675cf51320fc9b8f9626a50880eba8fff7e0cae674a7b0477d516f3c9"
I0429 13:49:08.737593 46889 logs.go:123] Gathering logs for kubernetes-dashboard [1171f7bf9e312d4e83e31789284ded3b56c8733f0f86756b847094cf17e199fc] ...
I0429 13:49:08.737648 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1171f7bf9e312d4e83e31789284ded3b56c8733f0f86756b847094cf17e199fc"
I0429 13:49:08.781099 46889 logs.go:123] Gathering logs for containerd ...
I0429 13:49:08.781125 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0429 13:49:08.839315 46889 logs.go:123] Gathering logs for describe nodes ...
I0429 13:49:08.839351 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0429 13:49:08.997479 46889 logs.go:123] Gathering logs for kube-controller-manager [46b329f549c16117b457f7dc74e36a56f69621b977c14a4225023ad5189c1e6f] ...
I0429 13:49:08.997509 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 46b329f549c16117b457f7dc74e36a56f69621b977c14a4225023ad5189c1e6f"
I0429 13:49:09.057965 46889 out.go:304] Setting ErrFile to fd 2...
I0429 13:49:09.058451 46889 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0429 13:49:09.058508 46889 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0429 13:49:09.058521 46889 out.go:239] Apr 29 13:48:42 old-k8s-version-637516 kubelet[659]: E0429 13:48:42.930864 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
Apr 29 13:48:42 old-k8s-version-637516 kubelet[659]: E0429 13:48:42.930864 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:09.058535 46889 out.go:239] Apr 29 13:48:48 old-k8s-version-637516 kubelet[659]: E0429 13:48:48.932975 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 29 13:48:48 old-k8s-version-637516 kubelet[659]: E0429 13:48:48.932975 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:09.058550 46889 out.go:239] Apr 29 13:48:56 old-k8s-version-637516 kubelet[659]: E0429 13:48:56.930900 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
Apr 29 13:48:56 old-k8s-version-637516 kubelet[659]: E0429 13:48:56.930900 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:09.058561 46889 out.go:239] Apr 29 13:49:01 old-k8s-version-637516 kubelet[659]: E0429 13:49:01.931193 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 29 13:49:01 old-k8s-version-637516 kubelet[659]: E0429 13:49:01.931193 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:09.058567 46889 out.go:239] Apr 29 13:49:07 old-k8s-version-637516 kubelet[659]: E0429 13:49:07.931524 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
Apr 29 13:49:07 old-k8s-version-637516 kubelet[659]: E0429 13:49:07.931524 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
I0429 13:49:09.058576 46889 out.go:304] Setting ErrFile to fd 2...
I0429 13:49:09.058583 46889 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0429 13:49:19.059776 46889 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0429 13:49:19.072176 46889 api_server.go:72] duration metric: took 5m57.123959415s to wait for apiserver process to appear ...
I0429 13:49:19.072201 46889 api_server.go:88] waiting for apiserver healthz status ...
I0429 13:49:19.072237 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0429 13:49:19.072304 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0429 13:49:19.117329 46889 cri.go:89] found id: "6f49514fe6938949387be25147dcb0463b2b9ae15ee83e14cae5c70460c06a68"
I0429 13:49:19.117352 46889 cri.go:89] found id: "92695848292c9dcf5fb37f9b7432bba3fafa7483ced7559a57ab1206427c21f3"
I0429 13:49:19.117358 46889 cri.go:89] found id: ""
I0429 13:49:19.117365 46889 logs.go:276] 2 containers: [6f49514fe6938949387be25147dcb0463b2b9ae15ee83e14cae5c70460c06a68 92695848292c9dcf5fb37f9b7432bba3fafa7483ced7559a57ab1206427c21f3]
I0429 13:49:19.117426 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.121265 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.125007 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0429 13:49:19.125084 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0429 13:49:19.164316 46889 cri.go:89] found id: "d822d5375019aa8b6fdae088edca5093130b82835432dd2833a71ae56c9a1753"
I0429 13:49:19.164338 46889 cri.go:89] found id: "487a468a367155648e2599415872a829294e36e2f52064e34362ae63b9dc2b51"
I0429 13:49:19.164343 46889 cri.go:89] found id: ""
I0429 13:49:19.164350 46889 logs.go:276] 2 containers: [d822d5375019aa8b6fdae088edca5093130b82835432dd2833a71ae56c9a1753 487a468a367155648e2599415872a829294e36e2f52064e34362ae63b9dc2b51]
I0429 13:49:19.164409 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.168251 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.171813 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0429 13:49:19.171889 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0429 13:49:19.215794 46889 cri.go:89] found id: "99aafd29fea02a0255847f0185b6468d29d23dead19e79879c006c7b1030f5b5"
I0429 13:49:19.215819 46889 cri.go:89] found id: "ceace251a3f285f11b13a433c49367b13d702752ff40ae66e2e8b3ac72bf71b2"
I0429 13:49:19.215825 46889 cri.go:89] found id: ""
I0429 13:49:19.215832 46889 logs.go:276] 2 containers: [99aafd29fea02a0255847f0185b6468d29d23dead19e79879c006c7b1030f5b5 ceace251a3f285f11b13a433c49367b13d702752ff40ae66e2e8b3ac72bf71b2]
I0429 13:49:19.215902 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.220344 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.223935 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0429 13:49:19.224020 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0429 13:49:19.273990 46889 cri.go:89] found id: "4b9d2030c82b4b99a0f1aa9c220a7d550fa28b6799c689551c3e01a257cf14fe"
I0429 13:49:19.274019 46889 cri.go:89] found id: "676b344d21c39a7b716ddccc155a37537ba17d9d55bded00344944a3b5251ae1"
I0429 13:49:19.274024 46889 cri.go:89] found id: ""
I0429 13:49:19.274032 46889 logs.go:276] 2 containers: [4b9d2030c82b4b99a0f1aa9c220a7d550fa28b6799c689551c3e01a257cf14fe 676b344d21c39a7b716ddccc155a37537ba17d9d55bded00344944a3b5251ae1]
I0429 13:49:19.274091 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.278053 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.281807 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0429 13:49:19.281889 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0429 13:49:19.321020 46889 cri.go:89] found id: "ac0d7e8ff20e394f5786d75b39f6d09a8343e15d46a71c3ba119572cf16daac8"
I0429 13:49:19.321091 46889 cri.go:89] found id: "afe201cf19cd54f9626556f9fb2af59a62b57b2fc3870087ea49951763023e6a"
I0429 13:49:19.321109 46889 cri.go:89] found id: ""
I0429 13:49:19.321132 46889 logs.go:276] 2 containers: [ac0d7e8ff20e394f5786d75b39f6d09a8343e15d46a71c3ba119572cf16daac8 afe201cf19cd54f9626556f9fb2af59a62b57b2fc3870087ea49951763023e6a]
I0429 13:49:19.321198 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.324913 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.328754 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0429 13:49:19.328862 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0429 13:49:19.375633 46889 cri.go:89] found id: "46b329f549c16117b457f7dc74e36a56f69621b977c14a4225023ad5189c1e6f"
I0429 13:49:19.375656 46889 cri.go:89] found id: "eebb19d675cf51320fc9b8f9626a50880eba8fff7e0cae674a7b0477d516f3c9"
I0429 13:49:19.375662 46889 cri.go:89] found id: ""
I0429 13:49:19.375670 46889 logs.go:276] 2 containers: [46b329f549c16117b457f7dc74e36a56f69621b977c14a4225023ad5189c1e6f eebb19d675cf51320fc9b8f9626a50880eba8fff7e0cae674a7b0477d516f3c9]
I0429 13:49:19.375728 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.379800 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.383818 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0429 13:49:19.383891 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0429 13:49:19.425795 46889 cri.go:89] found id: "b9ff1e04cc2c14075223ed4143af7eab578112a95cd911df71fd61fe781efe9d"
I0429 13:49:19.425817 46889 cri.go:89] found id: "2d56c26090f29460a7f6de0be95e5742db6f734116e1e0b8060dba86b11a18c5"
I0429 13:49:19.425822 46889 cri.go:89] found id: ""
I0429 13:49:19.425830 46889 logs.go:276] 2 containers: [b9ff1e04cc2c14075223ed4143af7eab578112a95cd911df71fd61fe781efe9d 2d56c26090f29460a7f6de0be95e5742db6f734116e1e0b8060dba86b11a18c5]
I0429 13:49:19.425906 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.429984 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.433830 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0429 13:49:19.433926 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0429 13:49:19.480409 46889 cri.go:89] found id: "b8faf4156978f8c5ec933471c71bdc73a0b442e4b837e3bdabab95ad9cf09146"
I0429 13:49:19.480430 46889 cri.go:89] found id: "9eb815c958691521a891ce6a646a8fe229c3c32994b0bd94e3911286c5e1a6d4"
I0429 13:49:19.480435 46889 cri.go:89] found id: ""
I0429 13:49:19.480442 46889 logs.go:276] 2 containers: [b8faf4156978f8c5ec933471c71bdc73a0b442e4b837e3bdabab95ad9cf09146 9eb815c958691521a891ce6a646a8fe229c3c32994b0bd94e3911286c5e1a6d4]
I0429 13:49:19.480520 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.484761 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.488349 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0429 13:49:19.488471 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0429 13:49:19.529429 46889 cri.go:89] found id: "1171f7bf9e312d4e83e31789284ded3b56c8733f0f86756b847094cf17e199fc"
I0429 13:49:19.529450 46889 cri.go:89] found id: ""
I0429 13:49:19.529458 46889 logs.go:276] 1 containers: [1171f7bf9e312d4e83e31789284ded3b56c8733f0f86756b847094cf17e199fc]
I0429 13:49:19.529517 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.533222 46889 logs.go:123] Gathering logs for kubelet ...
I0429 13:49:19.533311 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0429 13:49:19.586870 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857623 659 reflector.go:138] object-"default"/"default-token-nlkvk": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-nlkvk" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:19.587142 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857721 659 reflector.go:138] object-"kube-system"/"kube-proxy-token-6ww95": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-6ww95" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:19.587364 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857791 659 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:19.587584 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857856 659 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:19.587813 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857908 659 reflector.go:138] object-"kube-system"/"storage-provisioner-token-d45m7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-d45m7" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:19.588029 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857965 659 reflector.go:138] object-"kube-system"/"kindnet-token-kb54z": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-kb54z" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:19.588253 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.858021 659 reflector.go:138] object-"kube-system"/"coredns-token-8fhcc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-8fhcc" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:19.588486 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.858109 659 reflector.go:138] object-"kube-system"/"metrics-server-token-5dph5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-5dph5" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:19.597319 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:43 old-k8s-version-637516 kubelet[659]: E0429 13:43:43.774651 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0429 13:49:19.597758 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:44 old-k8s-version-637516 kubelet[659]: E0429 13:43:44.097901 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.604496 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:55 old-k8s-version-637516 kubelet[659]: E0429 13:43:55.958973 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0429 13:49:19.606484 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:09 old-k8s-version-637516 kubelet[659]: E0429 13:44:09.944369 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.607960 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:14 old-k8s-version-637516 kubelet[659]: E0429 13:44:14.326723 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.608597 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:15 old-k8s-version-637516 kubelet[659]: E0429 13:44:15.330554 659 pod_workers.go:191] Error syncing pod 768c1e4c-85ee-4968-9c8c-df33fac74bf3 ("storage-provisioner_kube-system(768c1e4c-85ee-4968-9c8c-df33fac74bf3)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(768c1e4c-85ee-4968-9c8c-df33fac74bf3)"
W0429 13:49:19.608943 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:15 old-k8s-version-637516 kubelet[659]: E0429 13:44:15.349369 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.609303 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:16 old-k8s-version-637516 kubelet[659]: E0429 13:44:16.353332 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.612778 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:24 old-k8s-version-637516 kubelet[659]: E0429 13:44:24.940536 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0429 13:49:19.614099 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:28 old-k8s-version-637516 kubelet[659]: E0429 13:44:28.387652 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.614892 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:35 old-k8s-version-637516 kubelet[659]: E0429 13:44:35.903409 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.615112 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:36 old-k8s-version-637516 kubelet[659]: E0429 13:44:36.931263 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.615471 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:46 old-k8s-version-637516 kubelet[659]: E0429 13:44:46.931347 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.615689 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:48 old-k8s-version-637516 kubelet[659]: E0429 13:44:48.931189 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.616348 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:59 old-k8s-version-637516 kubelet[659]: E0429 13:44:59.455798 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.616547 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:00 old-k8s-version-637516 kubelet[659]: E0429 13:45:00.931323 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.616912 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:05 old-k8s-version-637516 kubelet[659]: E0429 13:45:05.903931 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.619862 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:13 old-k8s-version-637516 kubelet[659]: E0429 13:45:13.944072 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0429 13:49:19.620206 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:16 old-k8s-version-637516 kubelet[659]: E0429 13:45:16.930872 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.620412 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:25 old-k8s-version-637516 kubelet[659]: E0429 13:45:25.931864 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.620770 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:27 old-k8s-version-637516 kubelet[659]: E0429 13:45:27.931269 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.621114 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:39 old-k8s-version-637516 kubelet[659]: E0429 13:45:39.933057 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.621625 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:40 old-k8s-version-637516 kubelet[659]: E0429 13:45:40.548936 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.622053 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:45 old-k8s-version-637516 kubelet[659]: E0429 13:45:45.903448 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.622246 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:51 old-k8s-version-637516 kubelet[659]: E0429 13:45:51.935180 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.622615 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:00 old-k8s-version-637516 kubelet[659]: E0429 13:46:00.931055 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.622857 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:04 old-k8s-version-637516 kubelet[659]: E0429 13:46:04.931269 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.623248 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:11 old-k8s-version-637516 kubelet[659]: E0429 13:46:11.931371 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.623454 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:15 old-k8s-version-637516 kubelet[659]: E0429 13:46:15.931701 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.623817 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:26 old-k8s-version-637516 kubelet[659]: E0429 13:46:26.931099 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.624015 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:29 old-k8s-version-637516 kubelet[659]: E0429 13:46:29.932102 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.624384 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:39 old-k8s-version-637516 kubelet[659]: E0429 13:46:39.931852 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.627390 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:44 old-k8s-version-637516 kubelet[659]: E0429 13:46:44.939309 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0429 13:49:19.627857 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:52 old-k8s-version-637516 kubelet[659]: E0429 13:46:52.930774 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.628212 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:56 old-k8s-version-637516 kubelet[659]: E0429 13:46:56.931506 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.628996 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:05 old-k8s-version-637516 kubelet[659]: E0429 13:47:05.770364 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.629367 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:06 old-k8s-version-637516 kubelet[659]: E0429 13:47:06.773003 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.629566 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:08 old-k8s-version-637516 kubelet[659]: E0429 13:47:08.931577 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.629771 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:19 old-k8s-version-637516 kubelet[659]: E0429 13:47:19.935693 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.630107 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:19 old-k8s-version-637516 kubelet[659]: E0429 13:47:19.937549 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.630303 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:31 old-k8s-version-637516 kubelet[659]: E0429 13:47:31.936395 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.630636 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:34 old-k8s-version-637516 kubelet[659]: E0429 13:47:34.930862 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.630852 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:44 old-k8s-version-637516 kubelet[659]: E0429 13:47:44.931375 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.631206 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:47 old-k8s-version-637516 kubelet[659]: E0429 13:47:47.930873 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.631462 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:59 old-k8s-version-637516 kubelet[659]: E0429 13:47:59.931717 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.631973 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:01 old-k8s-version-637516 kubelet[659]: E0429 13:48:01.931616 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.632192 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:10 old-k8s-version-637516 kubelet[659]: E0429 13:48:10.931290 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.632583 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:14 old-k8s-version-637516 kubelet[659]: E0429 13:48:14.931904 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.632782 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:21 old-k8s-version-637516 kubelet[659]: E0429 13:48:21.931833 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.633135 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:27 old-k8s-version-637516 kubelet[659]: E0429 13:48:27.931422 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.633341 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:35 old-k8s-version-637516 kubelet[659]: E0429 13:48:35.931483 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.633749 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:42 old-k8s-version-637516 kubelet[659]: E0429 13:48:42.930864 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.633949 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:48 old-k8s-version-637516 kubelet[659]: E0429 13:48:48.932975 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.634308 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:56 old-k8s-version-637516 kubelet[659]: E0429 13:48:56.930900 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.634509 46889 logs.go:138] Found kubelet problem: Apr 29 13:49:01 old-k8s-version-637516 kubelet[659]: E0429 13:49:01.931193 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.634914 46889 logs.go:138] Found kubelet problem: Apr 29 13:49:07 old-k8s-version-637516 kubelet[659]: E0429 13:49:07.931524 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.635125 46889 logs.go:138] Found kubelet problem: Apr 29 13:49:15 old-k8s-version-637516 kubelet[659]: E0429 13:49:15.931441 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.635474 46889 logs.go:138] Found kubelet problem: Apr 29 13:49:18 old-k8s-version-637516 kubelet[659]: E0429 13:49:18.930903 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
I0429 13:49:19.635485 46889 logs.go:123] Gathering logs for dmesg ...
I0429 13:49:19.635503 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0429 13:49:19.657344 46889 logs.go:123] Gathering logs for kube-apiserver [6f49514fe6938949387be25147dcb0463b2b9ae15ee83e14cae5c70460c06a68] ...
I0429 13:49:19.657423 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6f49514fe6938949387be25147dcb0463b2b9ae15ee83e14cae5c70460c06a68"
I0429 13:49:19.719004 46889 logs.go:123] Gathering logs for kube-apiserver [92695848292c9dcf5fb37f9b7432bba3fafa7483ced7559a57ab1206427c21f3] ...
I0429 13:49:19.719052 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 92695848292c9dcf5fb37f9b7432bba3fafa7483ced7559a57ab1206427c21f3"
I0429 13:49:19.806575 46889 logs.go:123] Gathering logs for kube-controller-manager [eebb19d675cf51320fc9b8f9626a50880eba8fff7e0cae674a7b0477d516f3c9] ...
I0429 13:49:19.806617 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 eebb19d675cf51320fc9b8f9626a50880eba8fff7e0cae674a7b0477d516f3c9"
I0429 13:49:19.889606 46889 logs.go:123] Gathering logs for kindnet [b9ff1e04cc2c14075223ed4143af7eab578112a95cd911df71fd61fe781efe9d] ...
I0429 13:49:19.889644 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b9ff1e04cc2c14075223ed4143af7eab578112a95cd911df71fd61fe781efe9d"
I0429 13:49:19.967054 46889 logs.go:123] Gathering logs for containerd ...
I0429 13:49:19.967084 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0429 13:49:20.037676 46889 logs.go:123] Gathering logs for etcd [d822d5375019aa8b6fdae088edca5093130b82835432dd2833a71ae56c9a1753] ...
I0429 13:49:20.037715 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d822d5375019aa8b6fdae088edca5093130b82835432dd2833a71ae56c9a1753"
I0429 13:49:20.112367 46889 logs.go:123] Gathering logs for kube-controller-manager [46b329f549c16117b457f7dc74e36a56f69621b977c14a4225023ad5189c1e6f] ...
I0429 13:49:20.112398 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 46b329f549c16117b457f7dc74e36a56f69621b977c14a4225023ad5189c1e6f"
I0429 13:49:20.208661 46889 logs.go:123] Gathering logs for container status ...
I0429 13:49:20.208701 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0429 13:49:20.272829 46889 logs.go:123] Gathering logs for etcd [487a468a367155648e2599415872a829294e36e2f52064e34362ae63b9dc2b51] ...
I0429 13:49:20.272858 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 487a468a367155648e2599415872a829294e36e2f52064e34362ae63b9dc2b51"
I0429 13:49:20.340554 46889 logs.go:123] Gathering logs for coredns [ceace251a3f285f11b13a433c49367b13d702752ff40ae66e2e8b3ac72bf71b2] ...
I0429 13:49:20.340584 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ceace251a3f285f11b13a433c49367b13d702752ff40ae66e2e8b3ac72bf71b2"
I0429 13:49:20.400540 46889 logs.go:123] Gathering logs for kube-scheduler [4b9d2030c82b4b99a0f1aa9c220a7d550fa28b6799c689551c3e01a257cf14fe] ...
I0429 13:49:20.400570 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4b9d2030c82b4b99a0f1aa9c220a7d550fa28b6799c689551c3e01a257cf14fe"
I0429 13:49:20.467457 46889 logs.go:123] Gathering logs for kube-proxy [ac0d7e8ff20e394f5786d75b39f6d09a8343e15d46a71c3ba119572cf16daac8] ...
I0429 13:49:20.467487 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ac0d7e8ff20e394f5786d75b39f6d09a8343e15d46a71c3ba119572cf16daac8"
I0429 13:49:20.533617 46889 logs.go:123] Gathering logs for kindnet [2d56c26090f29460a7f6de0be95e5742db6f734116e1e0b8060dba86b11a18c5] ...
I0429 13:49:20.533645 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2d56c26090f29460a7f6de0be95e5742db6f734116e1e0b8060dba86b11a18c5"
I0429 13:49:20.589267 46889 logs.go:123] Gathering logs for storage-provisioner [9eb815c958691521a891ce6a646a8fe229c3c32994b0bd94e3911286c5e1a6d4] ...
I0429 13:49:20.589292 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9eb815c958691521a891ce6a646a8fe229c3c32994b0bd94e3911286c5e1a6d4"
I0429 13:49:20.652417 46889 logs.go:123] Gathering logs for kubernetes-dashboard [1171f7bf9e312d4e83e31789284ded3b56c8733f0f86756b847094cf17e199fc] ...
I0429 13:49:20.652445 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1171f7bf9e312d4e83e31789284ded3b56c8733f0f86756b847094cf17e199fc"
I0429 13:49:20.711073 46889 logs.go:123] Gathering logs for describe nodes ...
I0429 13:49:20.711109 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0429 13:49:20.907160 46889 logs.go:123] Gathering logs for coredns [99aafd29fea02a0255847f0185b6468d29d23dead19e79879c006c7b1030f5b5] ...
I0429 13:49:20.907190 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 99aafd29fea02a0255847f0185b6468d29d23dead19e79879c006c7b1030f5b5"
I0429 13:49:20.969335 46889 logs.go:123] Gathering logs for kube-scheduler [676b344d21c39a7b716ddccc155a37537ba17d9d55bded00344944a3b5251ae1] ...
I0429 13:49:20.969363 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 676b344d21c39a7b716ddccc155a37537ba17d9d55bded00344944a3b5251ae1"
I0429 13:49:21.049073 46889 logs.go:123] Gathering logs for kube-proxy [afe201cf19cd54f9626556f9fb2af59a62b57b2fc3870087ea49951763023e6a] ...
I0429 13:49:21.049105 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 afe201cf19cd54f9626556f9fb2af59a62b57b2fc3870087ea49951763023e6a"
I0429 13:49:21.141297 46889 logs.go:123] Gathering logs for storage-provisioner [b8faf4156978f8c5ec933471c71bdc73a0b442e4b837e3bdabab95ad9cf09146] ...
I0429 13:49:21.141326 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b8faf4156978f8c5ec933471c71bdc73a0b442e4b837e3bdabab95ad9cf09146"
I0429 13:49:21.198979 46889 out.go:304] Setting ErrFile to fd 2...
I0429 13:49:21.199009 46889 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0429 13:49:21.199064 46889 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0429 13:49:21.199077 46889 out.go:239] Apr 29 13:48:56 old-k8s-version-637516 kubelet[659]: E0429 13:48:56.930900 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
Apr 29 13:48:56 old-k8s-version-637516 kubelet[659]: E0429 13:48:56.930900 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:21.199099 46889 out.go:239] Apr 29 13:49:01 old-k8s-version-637516 kubelet[659]: E0429 13:49:01.931193 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 29 13:49:01 old-k8s-version-637516 kubelet[659]: E0429 13:49:01.931193 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:21.199114 46889 out.go:239] Apr 29 13:49:07 old-k8s-version-637516 kubelet[659]: E0429 13:49:07.931524 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
Apr 29 13:49:07 old-k8s-version-637516 kubelet[659]: E0429 13:49:07.931524 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:21.199121 46889 out.go:239] Apr 29 13:49:15 old-k8s-version-637516 kubelet[659]: E0429 13:49:15.931441 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 29 13:49:15 old-k8s-version-637516 kubelet[659]: E0429 13:49:15.931441 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:21.199130 46889 out.go:239] Apr 29 13:49:18 old-k8s-version-637516 kubelet[659]: E0429 13:49:18.930903 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
Apr 29 13:49:18 old-k8s-version-637516 kubelet[659]: E0429 13:49:18.930903 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
I0429 13:49:21.199137 46889 out.go:304] Setting ErrFile to fd 2...
I0429 13:49:21.199144 46889 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0429 13:49:31.200585 46889 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0429 13:49:31.217733 46889 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0429 13:49:31.220690 46889 out.go:177]
W0429 13:49:31.223397 46889 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0429 13:49:31.223436 46889 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0429 13:49:31.223460 46889 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0429 13:49:31.223465 46889 out.go:239] *
*
W0429 13:49:31.224421 46889 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0429 13:49:31.228021 46889 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-637516 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-637516
helpers_test.go:235: (dbg) docker inspect old-k8s-version-637516:
-- stdout --
[
{
"Id": "ef76b52f09423d035638ef3e8b40edcd5e3722f7d831bfcf8ade4e334a8499b5",
"Created": "2024-04-29T13:40:29.697130165Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 47109,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-04-29T13:43:14.91808968Z",
"FinishedAt": "2024-04-29T13:43:13.489555904Z"
},
"Image": "sha256:c9315e0f61546d7b9630cf89252fa7f614fc966830e816cca5333df5c944376f",
"ResolvConfPath": "/var/lib/docker/containers/ef76b52f09423d035638ef3e8b40edcd5e3722f7d831bfcf8ade4e334a8499b5/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/ef76b52f09423d035638ef3e8b40edcd5e3722f7d831bfcf8ade4e334a8499b5/hostname",
"HostsPath": "/var/lib/docker/containers/ef76b52f09423d035638ef3e8b40edcd5e3722f7d831bfcf8ade4e334a8499b5/hosts",
"LogPath": "/var/lib/docker/containers/ef76b52f09423d035638ef3e8b40edcd5e3722f7d831bfcf8ade4e334a8499b5/ef76b52f09423d035638ef3e8b40edcd5e3722f7d831bfcf8ade4e334a8499b5-json.log",
"Name": "/old-k8s-version-637516",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-637516:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-637516",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/235b21b42b819657a8f49fb5e9af629f3853b4976e0b58a9e8aad3fb74d90002-init/diff:/var/lib/docker/overlay2/96b00c7b130388d989e01825e7cbbd94a0ef2060684b706b07a3801be0a2e59d/diff",
"MergedDir": "/var/lib/docker/overlay2/235b21b42b819657a8f49fb5e9af629f3853b4976e0b58a9e8aad3fb74d90002/merged",
"UpperDir": "/var/lib/docker/overlay2/235b21b42b819657a8f49fb5e9af629f3853b4976e0b58a9e8aad3fb74d90002/diff",
"WorkDir": "/var/lib/docker/overlay2/235b21b42b819657a8f49fb5e9af629f3853b4976e0b58a9e8aad3fb74d90002/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-637516",
"Source": "/var/lib/docker/volumes/old-k8s-version-637516/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-637516",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-637516",
"name.minikube.sigs.k8s.io": "old-k8s-version-637516",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "a1197bd957f7856056c328f5bb4ac351964a8d662996fee0f3433a655d010d99",
"SandboxKey": "/var/run/docker/netns/a1197bd957f7",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "37324"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "37323"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "37320"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "37322"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "37321"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-637516": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:4c:02",
"NetworkID": "5385f324face2a34e81afc6add20b63975f7b00dce81b7c36b1fc88bbcc16378",
"EndpointID": "d010bc409e2dd7dc9a726bc8f871e686a34e7f81a993356cfa5a15cdf65d86af",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DriverOpts": null,
"DNSNames": [
"old-k8s-version-637516",
"ef76b52f0942"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-637516 -n old-k8s-version-637516
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-637516 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-637516 logs -n 25: (2.017261026s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| start | -p pause-634683 | pause-634683 | jenkins | v1.33.0 | 29 Apr 24 13:39 UTC | 29 Apr 24 13:39 UTC |
| | --alsologtostderr | | | | | |
| | -v=1 --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| pause | -p pause-634683 | pause-634683 | jenkins | v1.33.0 | 29 Apr 24 13:39 UTC | 29 Apr 24 13:39 UTC |
| | --alsologtostderr -v=5 | | | | | |
| unpause | -p pause-634683 | pause-634683 | jenkins | v1.33.0 | 29 Apr 24 13:39 UTC | 29 Apr 24 13:39 UTC |
| | --alsologtostderr -v=5 | | | | | |
| pause | -p pause-634683 | pause-634683 | jenkins | v1.33.0 | 29 Apr 24 13:39 UTC | 29 Apr 24 13:39 UTC |
| | --alsologtostderr -v=5 | | | | | |
| delete | -p pause-634683 | pause-634683 | jenkins | v1.33.0 | 29 Apr 24 13:39 UTC | 29 Apr 24 13:39 UTC |
| | --alsologtostderr -v=5 | | | | | |
| delete | -p pause-634683 | pause-634683 | jenkins | v1.33.0 | 29 Apr 24 13:39 UTC | 29 Apr 24 13:39 UTC |
| start | -p cert-expiration-493491 | cert-expiration-493491 | jenkins | v1.33.0 | 29 Apr 24 13:39 UTC | 29 Apr 24 13:40 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-env-230376 | force-systemd-env-230376 | jenkins | v1.33.0 | 29 Apr 24 13:39 UTC | 29 Apr 24 13:39 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-env-230376 | force-systemd-env-230376 | jenkins | v1.33.0 | 29 Apr 24 13:39 UTC | 29 Apr 24 13:39 UTC |
| start | -p cert-options-393305 | cert-options-393305 | jenkins | v1.33.0 | 29 Apr 24 13:39 UTC | 29 Apr 24 13:40 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-393305 ssh | cert-options-393305 | jenkins | v1.33.0 | 29 Apr 24 13:40 UTC | 29 Apr 24 13:40 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-393305 -- sudo | cert-options-393305 | jenkins | v1.33.0 | 29 Apr 24 13:40 UTC | 29 Apr 24 13:40 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-393305 | cert-options-393305 | jenkins | v1.33.0 | 29 Apr 24 13:40 UTC | 29 Apr 24 13:40 UTC |
| start | -p old-k8s-version-637516 | old-k8s-version-637516 | jenkins | v1.33.0 | 29 Apr 24 13:40 UTC | 29 Apr 24 13:42 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p old-k8s-version-637516 | old-k8s-version-637516 | jenkins | v1.33.0 | 29 Apr 24 13:43 UTC | 29 Apr 24 13:43 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-637516 | old-k8s-version-637516 | jenkins | v1.33.0 | 29 Apr 24 13:43 UTC | 29 Apr 24 13:43 UTC |
| | --alsologtostderr -v=3 | | | | | |
| start | -p cert-expiration-493491 | cert-expiration-493491 | jenkins | v1.33.0 | 29 Apr 24 13:43 UTC | 29 Apr 24 13:43 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| addons | enable dashboard -p old-k8s-version-637516 | old-k8s-version-637516 | jenkins | v1.33.0 | 29 Apr 24 13:43 UTC | 29 Apr 24 13:43 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-637516 | old-k8s-version-637516 | jenkins | v1.33.0 | 29 Apr 24 13:43 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| delete | -p cert-expiration-493491 | cert-expiration-493491 | jenkins | v1.33.0 | 29 Apr 24 13:43 UTC | 29 Apr 24 13:43 UTC |
| start | -p no-preload-452985 | no-preload-452985 | jenkins | v1.33.0 | 29 Apr 24 13:43 UTC | 29 Apr 24 13:44 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.30.0 | | | | | |
| addons | enable metrics-server -p no-preload-452985 | no-preload-452985 | jenkins | v1.33.0 | 29 Apr 24 13:44 UTC | 29 Apr 24 13:44 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-452985 | no-preload-452985 | jenkins | v1.33.0 | 29 Apr 24 13:44 UTC | 29 Apr 24 13:44 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-452985 | no-preload-452985 | jenkins | v1.33.0 | 29 Apr 24 13:44 UTC | 29 Apr 24 13:44 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-452985 | no-preload-452985 | jenkins | v1.33.0 | 29 Apr 24 13:44 UTC | 29 Apr 24 13:49 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.30.0 | | | | | |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/04/29 13:44:58
Running on machine: ip-172-31-29-130
Binary: Built with gc go1.22.1 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0429 13:44:58.380692 54341 out.go:291] Setting OutFile to fd 1 ...
I0429 13:44:58.380855 54341 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0429 13:44:58.380866 54341 out.go:304] Setting ErrFile to fd 2...
I0429 13:44:58.380872 54341 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0429 13:44:58.381141 54341 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18773-4048231/.minikube/bin
I0429 13:44:58.381521 54341 out.go:298] Setting JSON to false
I0429 13:44:58.382677 54341 start.go:129] hostinfo: {"hostname":"ip-172-31-29-130","uptime":70043,"bootTime":1714328256,"procs":237,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
I0429 13:44:58.382753 54341 start.go:139] virtualization:
I0429 13:44:58.386292 54341 out.go:177] * [no-preload-452985] minikube v1.33.0 on Ubuntu 20.04 (arm64)
I0429 13:44:58.389023 54341 out.go:177] - MINIKUBE_LOCATION=18773
I0429 13:44:58.390764 54341 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0429 13:44:58.389162 54341 notify.go:220] Checking for updates...
I0429 13:44:58.394868 54341 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18773-4048231/kubeconfig
I0429 13:44:58.397001 54341 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18773-4048231/.minikube
I0429 13:44:58.399309 54341 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0429 13:44:58.401199 54341 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0429 13:44:58.403617 54341 config.go:182] Loaded profile config "no-preload-452985": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.0
I0429 13:44:58.404173 54341 driver.go:392] Setting default libvirt URI to qemu:///system
I0429 13:44:58.423764 54341 docker.go:122] docker version: linux-26.1.0:Docker Engine - Community
I0429 13:44:58.423883 54341 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0429 13:44:58.496521 54341 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:41 OomKillDisable:true NGoroutines:52 SystemTime:2024-04-29 13:44:58.486447173 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215105536 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:26.1.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1]] Warnings:<nil>}}
I0429 13:44:58.496638 54341 docker.go:295] overlay module found
I0429 13:44:58.499757 54341 out.go:177] * Using the docker driver based on existing profile
I0429 13:44:58.501379 54341 start.go:297] selected driver: docker
I0429 13:44:58.501393 54341 start.go:901] validating driver "docker" against &{Name:no-preload-452985 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:no-preload-452985 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false Mount
String:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0429 13:44:58.501537 54341 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0429 13:44:58.502192 54341 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0429 13:44:58.556417 54341 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:41 OomKillDisable:true NGoroutines:52 SystemTime:2024-04-29 13:44:58.547514254 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215105536 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:26.1.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1]] Warnings:<nil>}}
I0429 13:44:58.556767 54341 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0429 13:44:58.556825 54341 cni.go:84] Creating CNI manager for ""
I0429 13:44:58.556843 54341 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0429 13:44:58.556887 54341 start.go:340] cluster config:
{Name:no-preload-452985 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:no-preload-452985 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Moun
tIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0429 13:44:58.559019 54341 out.go:177] * Starting "no-preload-452985" primary control-plane node in "no-preload-452985" cluster
I0429 13:44:58.560780 54341 cache.go:121] Beginning downloading kic base image for docker with containerd
I0429 13:44:58.562587 54341 out.go:177] * Pulling base image v0.0.43-1713736339-18706 ...
I0429 13:44:58.564532 54341 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime containerd
I0429 13:44:58.564622 54341 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e in local docker daemon
I0429 13:44:58.564669 54341 profile.go:143] Saving config to /home/jenkins/minikube-integration/18773-4048231/.minikube/profiles/no-preload-452985/config.json ...
I0429 13:44:58.565046 54341 cache.go:107] acquiring lock: {Name:mk7d6d31159dceff353f1531b35a17ecd6c14962 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0429 13:44:58.565187 54341 cache.go:115] /home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
I0429 13:44:58.565201 54341 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 160.168µs
I0429 13:44:58.565231 54341 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
I0429 13:44:58.565249 54341 cache.go:107] acquiring lock: {Name:mk3982a3103454382626b75e0f647003d24d28a7 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0429 13:44:58.565288 54341 cache.go:115] /home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.30.0 exists
I0429 13:44:58.565359 54341 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.30.0" -> "/home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.30.0" took 50.681µs
I0429 13:44:58.565372 54341 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.30.0 -> /home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.30.0 succeeded
I0429 13:44:58.565413 54341 cache.go:107] acquiring lock: {Name:mkaf6d997825817ef4e7be413bae500c36704279 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0429 13:44:58.565463 54341 cache.go:115] /home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.30.0 exists
I0429 13:44:58.565469 54341 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.30.0" -> "/home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.30.0" took 59.551µs
I0429 13:44:58.565476 54341 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.30.0 -> /home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.30.0 succeeded
I0429 13:44:58.565486 54341 cache.go:107] acquiring lock: {Name:mk335d03e1f072869c943293a854605c919ccee0 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0429 13:44:58.565450 54341 cache.go:107] acquiring lock: {Name:mk5031ecfb2b8e06434be76c2a00e90721692d0b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0429 13:44:58.565525 54341 cache.go:115] /home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.12-0 exists
I0429 13:44:58.565530 54341 cache.go:96] cache image "registry.k8s.io/etcd:3.5.12-0" -> "/home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.12-0" took 45.455µs
I0429 13:44:58.565539 54341 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.12-0 -> /home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.12-0 succeeded
I0429 13:44:58.565549 54341 cache.go:107] acquiring lock: {Name:mkef725b8b36ffdecc03e80266dc9f41801ace06 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0429 13:44:58.565615 54341 cache.go:115] /home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9 exists
I0429 13:44:58.565630 54341 cache.go:96] cache image "registry.k8s.io/pause:3.9" -> "/home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9" took 186.866µs
I0429 13:44:58.565639 54341 cache.go:80] save to tar file registry.k8s.io/pause:3.9 -> /home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9 succeeded
I0429 13:44:58.565632 54341 cache.go:107] acquiring lock: {Name:mk1773741f9a21bb01b76df1b4a5b8e0dab0c5b2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0429 13:44:58.565668 54341 cache.go:115] /home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.30.0 exists
I0429 13:44:58.565682 54341 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.30.0" -> "/home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.30.0" took 44.741µs
I0429 13:44:58.565691 54341 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.30.0 -> /home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.30.0 succeeded
I0429 13:44:58.565619 54341 cache.go:115] /home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 exists
I0429 13:44:58.565688 54341 cache.go:107] acquiring lock: {Name:mke1c5a6f261abd81a686490035aeeac2bc8796b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0429 13:44:58.565746 54341 cache.go:115] /home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.30.0 exists
I0429 13:44:58.565753 54341 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.30.0" -> "/home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.30.0" took 67.724µs
I0429 13:44:58.565760 54341 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.30.0 -> /home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.30.0 succeeded
I0429 13:44:58.565699 54341 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1" took 151.43µs
I0429 13:44:58.565767 54341 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /home/jenkins/minikube-integration/18773-4048231/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
I0429 13:44:58.565773 54341 cache.go:87] Successfully saved all images to host disk.
I0429 13:44:58.581081 54341 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e in local docker daemon, skipping pull
I0429 13:44:58.581105 54341 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e exists in daemon, skipping load
I0429 13:44:58.581128 54341 cache.go:194] Successfully downloaded all kic artifacts
I0429 13:44:58.581157 54341 start.go:360] acquireMachinesLock for no-preload-452985: {Name:mk0ee0c33aaa2323842b42cdf7ed13d3ccf1738d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0429 13:44:58.581215 54341 start.go:364] duration metric: took 41.213µs to acquireMachinesLock for "no-preload-452985"
I0429 13:44:58.581236 54341 start.go:96] Skipping create...Using existing machine configuration
I0429 13:44:58.581247 54341 fix.go:54] fixHost starting:
I0429 13:44:58.581509 54341 cli_runner.go:164] Run: docker container inspect no-preload-452985 --format={{.State.Status}}
I0429 13:44:58.597546 54341 fix.go:112] recreateIfNeeded on no-preload-452985: state=Stopped err=<nil>
W0429 13:44:58.598395 54341 fix.go:138] unexpected machine state, will restart: <nil>
I0429 13:44:58.602881 54341 out.go:177] * Restarting existing docker container for "no-preload-452985" ...
I0429 13:44:55.259130 46889 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:57.259646 46889 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:44:58.604938 54341 cli_runner.go:164] Run: docker start no-preload-452985
I0429 13:44:58.979192 54341 cli_runner.go:164] Run: docker container inspect no-preload-452985 --format={{.State.Status}}
I0429 13:44:59.005591 54341 kic.go:430] container "no-preload-452985" state is running.
I0429 13:44:59.006000 54341 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-452985
I0429 13:44:59.039987 54341 profile.go:143] Saving config to /home/jenkins/minikube-integration/18773-4048231/.minikube/profiles/no-preload-452985/config.json ...
I0429 13:44:59.040900 54341 machine.go:94] provisionDockerMachine start ...
I0429 13:44:59.041222 54341 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-452985
I0429 13:44:59.067779 54341 main.go:141] libmachine: Using SSH client type: native
I0429 13:44:59.068056 54341 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 37334 <nil> <nil>}
I0429 13:44:59.068066 54341 main.go:141] libmachine: About to run SSH command:
hostname
I0429 13:44:59.068780 54341 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0429 13:45:02.199972 54341 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-452985
I0429 13:45:02.200000 54341 ubuntu.go:169] provisioning hostname "no-preload-452985"
I0429 13:45:02.200091 54341 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-452985
I0429 13:45:02.232379 54341 main.go:141] libmachine: Using SSH client type: native
I0429 13:45:02.232625 54341 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 37334 <nil> <nil>}
I0429 13:45:02.232635 54341 main.go:141] libmachine: About to run SSH command:
sudo hostname no-preload-452985 && echo "no-preload-452985" | sudo tee /etc/hostname
I0429 13:45:02.376699 54341 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-452985
I0429 13:45:02.376790 54341 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-452985
I0429 13:45:02.395269 54341 main.go:141] libmachine: Using SSH client type: native
I0429 13:45:02.395535 54341 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 37334 <nil> <nil>}
I0429 13:45:02.395556 54341 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-452985' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-452985/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-452985' | sudo tee -a /etc/hosts;
fi
fi
I0429 13:45:02.520143 54341 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0429 13:45:02.520170 54341 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18773-4048231/.minikube CaCertPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18773-4048231/.minikube}
I0429 13:45:02.520202 54341 ubuntu.go:177] setting up certificates
I0429 13:45:02.520212 54341 provision.go:84] configureAuth start
I0429 13:45:02.520275 54341 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-452985
I0429 13:45:02.541413 54341 provision.go:143] copyHostCerts
I0429 13:45:02.541528 54341 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-4048231/.minikube/cert.pem, removing ...
I0429 13:45:02.541544 54341 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-4048231/.minikube/cert.pem
I0429 13:45:02.541620 54341 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-4048231/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18773-4048231/.minikube/cert.pem (1123 bytes)
I0429 13:45:02.541729 54341 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-4048231/.minikube/key.pem, removing ...
I0429 13:45:02.541740 54341 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-4048231/.minikube/key.pem
I0429 13:45:02.541767 54341 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-4048231/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18773-4048231/.minikube/key.pem (1675 bytes)
I0429 13:45:02.541830 54341 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-4048231/.minikube/ca.pem, removing ...
I0429 13:45:02.541838 54341 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-4048231/.minikube/ca.pem
I0429 13:45:02.541864 54341 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-4048231/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18773-4048231/.minikube/ca.pem (1078 bytes)
I0429 13:45:02.541923 54341 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18773-4048231/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18773-4048231/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18773-4048231/.minikube/certs/ca-key.pem org=jenkins.no-preload-452985 san=[127.0.0.1 192.168.85.2 localhost minikube no-preload-452985]
I0429 13:45:02.662128 54341 provision.go:177] copyRemoteCerts
I0429 13:45:02.662206 54341 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0429 13:45:02.662249 54341 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-452985
I0429 13:45:02.681441 54341 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37334 SSHKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/machines/no-preload-452985/id_rsa Username:docker}
I0429 13:45:02.776084 54341 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0429 13:45:02.801415 54341 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0429 13:45:02.828607 54341 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0429 13:45:02.853472 54341 provision.go:87] duration metric: took 333.247025ms to configureAuth
I0429 13:45:02.853498 54341 ubuntu.go:193] setting minikube options for container-runtime
I0429 13:45:02.853697 54341 config.go:182] Loaded profile config "no-preload-452985": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.0
I0429 13:45:02.853711 54341 machine.go:97] duration metric: took 3.812796901s to provisionDockerMachine
I0429 13:45:02.853719 54341 start.go:293] postStartSetup for "no-preload-452985" (driver="docker")
I0429 13:45:02.853729 54341 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0429 13:45:02.853786 54341 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0429 13:45:02.853834 54341 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-452985
I0429 13:45:02.873001 54341 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37334 SSHKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/machines/no-preload-452985/id_rsa Username:docker}
I0429 13:45:02.964259 54341 ssh_runner.go:195] Run: cat /etc/os-release
I0429 13:45:02.967678 54341 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0429 13:45:02.967713 54341 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0429 13:45:02.967748 54341 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0429 13:45:02.967762 54341 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0429 13:45:02.967774 54341 filesync.go:126] Scanning /home/jenkins/minikube-integration/18773-4048231/.minikube/addons for local assets ...
I0429 13:45:02.967849 54341 filesync.go:126] Scanning /home/jenkins/minikube-integration/18773-4048231/.minikube/files for local assets ...
I0429 13:45:02.967950 54341 filesync.go:149] local asset: /home/jenkins/minikube-integration/18773-4048231/.minikube/files/etc/ssl/certs/40536392.pem -> 40536392.pem in /etc/ssl/certs
I0429 13:45:02.968081 54341 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0429 13:45:02.977078 54341 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/files/etc/ssl/certs/40536392.pem --> /etc/ssl/certs/40536392.pem (1708 bytes)
I0429 13:45:03.014348 54341 start.go:296] duration metric: took 160.613688ms for postStartSetup
I0429 13:45:03.014505 54341 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0429 13:45:03.014560 54341 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-452985
I0429 13:45:03.033523 54341 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37334 SSHKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/machines/no-preload-452985/id_rsa Username:docker}
I0429 13:45:03.120265 54341 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0429 13:45:03.124821 54341 fix.go:56] duration metric: took 4.543571334s for fixHost
I0429 13:45:03.124889 54341 start.go:83] releasing machines lock for "no-preload-452985", held for 4.54366487s
I0429 13:45:03.124987 54341 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-452985
I0429 13:45:03.142526 54341 ssh_runner.go:195] Run: cat /version.json
I0429 13:45:03.142582 54341 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-452985
I0429 13:45:03.142887 54341 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0429 13:45:03.142947 54341 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-452985
I0429 13:45:03.164804 54341 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37334 SSHKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/machines/no-preload-452985/id_rsa Username:docker}
I0429 13:45:03.170215 54341 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37334 SSHKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/machines/no-preload-452985/id_rsa Username:docker}
I0429 13:45:03.256477 54341 ssh_runner.go:195] Run: systemctl --version
I0429 13:44:59.260482 46889 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:01.759039 46889 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:03.760878 46889 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:03.388151 54341 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0429 13:45:03.392893 54341 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0429 13:45:03.411326 54341 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0429 13:45:03.411482 54341 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0429 13:45:03.427079 54341 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0429 13:45:03.427105 54341 start.go:494] detecting cgroup driver to use...
I0429 13:45:03.427173 54341 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0429 13:45:03.427245 54341 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0429 13:45:03.441846 54341 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0429 13:45:03.453987 54341 docker.go:217] disabling cri-docker service (if available) ...
I0429 13:45:03.454101 54341 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0429 13:45:03.471774 54341 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0429 13:45:03.483648 54341 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0429 13:45:03.570017 54341 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0429 13:45:03.677451 54341 docker.go:233] disabling docker service ...
I0429 13:45:03.677535 54341 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0429 13:45:03.691629 54341 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0429 13:45:03.705356 54341 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0429 13:45:03.820420 54341 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0429 13:45:03.920117 54341 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0429 13:45:03.936925 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0429 13:45:03.954412 54341 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0429 13:45:03.966958 54341 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0429 13:45:03.977367 54341 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0429 13:45:03.977437 54341 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0429 13:45:03.987913 54341 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0429 13:45:03.998546 54341 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0429 13:45:04.012966 54341 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0429 13:45:04.025423 54341 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0429 13:45:04.035564 54341 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0429 13:45:04.045871 54341 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0429 13:45:04.056918 54341 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0429 13:45:04.069168 54341 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0429 13:45:04.079102 54341 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0429 13:45:04.087901 54341 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0429 13:45:04.183723 54341 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0429 13:45:04.353923 54341 start.go:541] Will wait 60s for socket path /run/containerd/containerd.sock
I0429 13:45:04.354083 54341 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0429 13:45:04.358577 54341 start.go:562] Will wait 60s for crictl version
I0429 13:45:04.358684 54341 ssh_runner.go:195] Run: which crictl
I0429 13:45:04.362442 54341 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0429 13:45:04.403463 54341 start.go:578] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.6.31
RuntimeApiVersion: v1
I0429 13:45:04.403579 54341 ssh_runner.go:195] Run: containerd --version
I0429 13:45:04.435652 54341 ssh_runner.go:195] Run: containerd --version
I0429 13:45:04.463810 54341 out.go:177] * Preparing Kubernetes v1.30.0 on containerd 1.6.31 ...
I0429 13:45:04.466151 54341 cli_runner.go:164] Run: docker network inspect no-preload-452985 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0429 13:45:04.503593 54341 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0429 13:45:04.507428 54341 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0429 13:45:04.521312 54341 kubeadm.go:877] updating cluster {Name:no-preload-452985 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:no-preload-452985 Namespace:default APIServerHAVIP: APIServerName:minikubeCA API
ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenk
ins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0429 13:45:04.521434 54341 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime containerd
I0429 13:45:04.521484 54341 ssh_runner.go:195] Run: sudo crictl images --output json
I0429 13:45:04.559642 54341 containerd.go:627] all images are preloaded for containerd runtime.
I0429 13:45:04.559664 54341 cache_images.go:84] Images are preloaded, skipping loading
I0429 13:45:04.559672 54341 kubeadm.go:928] updating node { 192.168.85.2 8443 v1.30.0 containerd true true} ...
I0429 13:45:04.559772 54341 kubeadm.go:940] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.30.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=no-preload-452985 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.30.0 ClusterName:no-preload-452985 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0429 13:45:04.559848 54341 ssh_runner.go:195] Run: sudo crictl info
I0429 13:45:04.600126 54341 cni.go:84] Creating CNI manager for ""
I0429 13:45:04.600154 54341 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0429 13:45:04.600168 54341 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0429 13:45:04.600194 54341 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.30.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-452985 NodeName:no-preload-452985 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodP
ath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0429 13:45:04.600333 54341 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "no-preload-452985"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.30.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0429 13:45:04.600412 54341 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0
I0429 13:45:04.614508 54341 binaries.go:44] Found k8s binaries, skipping transfer
I0429 13:45:04.614582 54341 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0429 13:45:04.624958 54341 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (321 bytes)
I0429 13:45:04.645822 54341 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0429 13:45:04.664809 54341 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2171 bytes)
I0429 13:45:04.684289 54341 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0429 13:45:04.688214 54341 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0429 13:45:04.700047 54341 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0429 13:45:04.785643 54341 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0429 13:45:04.801926 54341 certs.go:68] Setting up /home/jenkins/minikube-integration/18773-4048231/.minikube/profiles/no-preload-452985 for IP: 192.168.85.2
I0429 13:45:04.801949 54341 certs.go:194] generating shared ca certs ...
I0429 13:45:04.801966 54341 certs.go:226] acquiring lock for ca certs: {Name:mk185bf624537c6ccc90f82e9e112f86a219193f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0429 13:45:04.802157 54341 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18773-4048231/.minikube/ca.key
I0429 13:45:04.802222 54341 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18773-4048231/.minikube/proxy-client-ca.key
I0429 13:45:04.802237 54341 certs.go:256] generating profile certs ...
I0429 13:45:04.802356 54341 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18773-4048231/.minikube/profiles/no-preload-452985/client.key
I0429 13:45:04.802470 54341 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/18773-4048231/.minikube/profiles/no-preload-452985/apiserver.key.7eb269fc
I0429 13:45:04.802545 54341 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18773-4048231/.minikube/profiles/no-preload-452985/proxy-client.key
I0429 13:45:04.802686 54341 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-4048231/.minikube/certs/4053639.pem (1338 bytes)
W0429 13:45:04.802735 54341 certs.go:480] ignoring /home/jenkins/minikube-integration/18773-4048231/.minikube/certs/4053639_empty.pem, impossibly tiny 0 bytes
I0429 13:45:04.802749 54341 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-4048231/.minikube/certs/ca-key.pem (1679 bytes)
I0429 13:45:04.802787 54341 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-4048231/.minikube/certs/ca.pem (1078 bytes)
I0429 13:45:04.802855 54341 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-4048231/.minikube/certs/cert.pem (1123 bytes)
I0429 13:45:04.802891 54341 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-4048231/.minikube/certs/key.pem (1675 bytes)
I0429 13:45:04.802956 54341 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-4048231/.minikube/files/etc/ssl/certs/40536392.pem (1708 bytes)
I0429 13:45:04.804070 54341 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0429 13:45:04.839285 54341 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0429 13:45:04.867275 54341 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0429 13:45:04.896859 54341 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0429 13:45:04.922751 54341 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/profiles/no-preload-452985/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0429 13:45:04.952949 54341 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/profiles/no-preload-452985/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0429 13:45:04.989463 54341 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/profiles/no-preload-452985/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0429 13:45:05.035054 54341 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/profiles/no-preload-452985/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0429 13:45:05.071695 54341 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0429 13:45:05.104436 54341 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/certs/4053639.pem --> /usr/share/ca-certificates/4053639.pem (1338 bytes)
I0429 13:45:05.136004 54341 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-4048231/.minikube/files/etc/ssl/certs/40536392.pem --> /usr/share/ca-certificates/40536392.pem (1708 bytes)
I0429 13:45:05.163949 54341 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0429 13:45:05.185765 54341 ssh_runner.go:195] Run: openssl version
I0429 13:45:05.193807 54341 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0429 13:45:05.204337 54341 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0429 13:45:05.208101 54341 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 29 12:59 /usr/share/ca-certificates/minikubeCA.pem
I0429 13:45:05.208188 54341 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0429 13:45:05.215483 54341 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0429 13:45:05.224897 54341 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/4053639.pem && ln -fs /usr/share/ca-certificates/4053639.pem /etc/ssl/certs/4053639.pem"
I0429 13:45:05.235255 54341 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/4053639.pem
I0429 13:45:05.240432 54341 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 29 13:05 /usr/share/ca-certificates/4053639.pem
I0429 13:45:05.240526 54341 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/4053639.pem
I0429 13:45:05.248266 54341 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/4053639.pem /etc/ssl/certs/51391683.0"
I0429 13:45:05.260392 54341 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/40536392.pem && ln -fs /usr/share/ca-certificates/40536392.pem /etc/ssl/certs/40536392.pem"
I0429 13:45:05.272101 54341 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/40536392.pem
I0429 13:45:05.275803 54341 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 29 13:05 /usr/share/ca-certificates/40536392.pem
I0429 13:45:05.275893 54341 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/40536392.pem
I0429 13:45:05.282927 54341 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/40536392.pem /etc/ssl/certs/3ec20f2e.0"
I0429 13:45:05.292166 54341 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0429 13:45:05.295849 54341 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0429 13:45:05.302569 54341 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0429 13:45:05.309666 54341 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0429 13:45:05.317646 54341 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0429 13:45:05.324321 54341 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0429 13:45:05.331208 54341 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0429 13:45:05.338176 54341 kubeadm.go:391] StartCluster: {Name:no-preload-452985 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:no-preload-452985 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins
:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0429 13:45:05.338284 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0429 13:45:05.338371 54341 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0429 13:45:05.379401 54341 cri.go:89] found id: "9424f2b14afbbf14dc6034f77898c6d50797b2d72c6bfc7e4f2abbf792b13510"
I0429 13:45:05.379481 54341 cri.go:89] found id: "3c7c4fb800f0fb3702325ff5f5658941d615bbeb528e0ace8320ca9d937313fb"
I0429 13:45:05.379501 54341 cri.go:89] found id: "71ee0b98eaa938ced40f2539a0b4d2d1c89bdc517dfb31e9f901a2784d3581cc"
I0429 13:45:05.379534 54341 cri.go:89] found id: "5aecd138f90559d169394f79f0ad05b606433fa4b4ec072c13e9835835ce17a1"
I0429 13:45:05.379543 54341 cri.go:89] found id: "773300bb56a3cf480debfc1708df63d242912d955ed2878e344f290b3e135636"
I0429 13:45:05.379547 54341 cri.go:89] found id: "8479fc16ba8a689c95a90d6010d6cd7e41e3ef515bbf558657fcbcb4ce4fad8d"
I0429 13:45:05.379550 54341 cri.go:89] found id: "318cce7a1b0f2a614f1194bbaa431bfa0f983bbdae38b64ee888c61540c28705"
I0429 13:45:05.379554 54341 cri.go:89] found id: "337dae6815a9bc77d4d0cda01280f06fcdd445b632c003e045a5effec947091b"
I0429 13:45:05.379557 54341 cri.go:89] found id: ""
I0429 13:45:05.379619 54341 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0429 13:45:05.395018 54341 cri.go:116] JSON = null
W0429 13:45:05.395069 54341 kubeadm.go:398] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0429 13:45:05.395133 54341 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0429 13:45:05.405942 54341 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0429 13:45:05.405970 54341 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0429 13:45:05.405976 54341 kubeadm.go:587] restartPrimaryControlPlane start ...
I0429 13:45:05.406044 54341 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0429 13:45:05.418018 54341 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0429 13:45:05.418828 54341 kubeconfig.go:47] verify endpoint returned: get endpoint: "no-preload-452985" does not appear in /home/jenkins/minikube-integration/18773-4048231/kubeconfig
I0429 13:45:05.419154 54341 kubeconfig.go:62] /home/jenkins/minikube-integration/18773-4048231/kubeconfig needs updating (will repair): [kubeconfig missing "no-preload-452985" cluster setting kubeconfig missing "no-preload-452985" context setting]
I0429 13:45:05.419763 54341 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-4048231/kubeconfig: {Name:mk99307e7393ce97359527fd48eaac92355b4aa7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0429 13:45:05.421780 54341 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0429 13:45:05.433911 54341 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.85.2
I0429 13:45:05.433984 54341 kubeadm.go:591] duration metric: took 28.00231ms to restartPrimaryControlPlane
I0429 13:45:05.434012 54341 kubeadm.go:393] duration metric: took 95.846309ms to StartCluster
I0429 13:45:05.434044 54341 settings.go:142] acquiring lock: {Name:mk1ad2799378a4d44dee4747f8fba3052ff08735 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0429 13:45:05.434140 54341 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/18773-4048231/kubeconfig
I0429 13:45:05.435230 54341 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-4048231/kubeconfig: {Name:mk99307e7393ce97359527fd48eaac92355b4aa7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0429 13:45:05.435506 54341 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0429 13:45:05.439571 54341 out.go:177] * Verifying Kubernetes components...
I0429 13:45:05.435777 54341 config.go:182] Loaded profile config "no-preload-452985": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.0
I0429 13:45:05.435791 54341 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0429 13:45:05.442344 54341 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0429 13:45:05.439812 54341 addons.go:69] Setting storage-provisioner=true in profile "no-preload-452985"
I0429 13:45:05.439820 54341 addons.go:69] Setting dashboard=true in profile "no-preload-452985"
I0429 13:45:05.439823 54341 addons.go:69] Setting default-storageclass=true in profile "no-preload-452985"
I0429 13:45:05.439831 54341 addons.go:69] Setting metrics-server=true in profile "no-preload-452985"
I0429 13:45:05.442562 54341 addons.go:234] Setting addon storage-provisioner=true in "no-preload-452985"
W0429 13:45:05.442712 54341 addons.go:243] addon storage-provisioner should already be in state true
I0429 13:45:05.442768 54341 host.go:66] Checking if "no-preload-452985" exists ...
I0429 13:45:05.443291 54341 cli_runner.go:164] Run: docker container inspect no-preload-452985 --format={{.State.Status}}
I0429 13:45:05.442599 54341 addons.go:234] Setting addon dashboard=true in "no-preload-452985"
W0429 13:45:05.443430 54341 addons.go:243] addon dashboard should already be in state true
I0429 13:45:05.443475 54341 host.go:66] Checking if "no-preload-452985" exists ...
I0429 13:45:05.443856 54341 cli_runner.go:164] Run: docker container inspect no-preload-452985 --format={{.State.Status}}
I0429 13:45:05.442637 54341 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-452985"
I0429 13:45:05.442697 54341 addons.go:234] Setting addon metrics-server=true in "no-preload-452985"
W0429 13:45:05.447251 54341 addons.go:243] addon metrics-server should already be in state true
I0429 13:45:05.447286 54341 host.go:66] Checking if "no-preload-452985" exists ...
I0429 13:45:05.447508 54341 cli_runner.go:164] Run: docker container inspect no-preload-452985 --format={{.State.Status}}
I0429 13:45:05.447729 54341 cli_runner.go:164] Run: docker container inspect no-preload-452985 --format={{.State.Status}}
I0429 13:45:05.477337 54341 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0429 13:45:05.479516 54341 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0429 13:45:05.479539 54341 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0429 13:45:05.479609 54341 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-452985
I0429 13:45:05.505046 54341 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0429 13:45:05.507978 54341 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0429 13:45:05.510472 54341 addons.go:426] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0429 13:45:05.510496 54341 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0429 13:45:05.510572 54341 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-452985
I0429 13:45:05.522087 54341 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0429 13:45:05.515922 54341 addons.go:234] Setting addon default-storageclass=true in "no-preload-452985"
W0429 13:45:05.525117 54341 addons.go:243] addon default-storageclass should already be in state true
I0429 13:45:05.525158 54341 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0429 13:45:05.525185 54341 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0429 13:45:05.525253 54341 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-452985
I0429 13:45:05.525162 54341 host.go:66] Checking if "no-preload-452985" exists ...
I0429 13:45:05.525753 54341 cli_runner.go:164] Run: docker container inspect no-preload-452985 --format={{.State.Status}}
I0429 13:45:05.557617 54341 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37334 SSHKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/machines/no-preload-452985/id_rsa Username:docker}
I0429 13:45:05.575983 54341 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37334 SSHKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/machines/no-preload-452985/id_rsa Username:docker}
I0429 13:45:05.586853 54341 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37334 SSHKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/machines/no-preload-452985/id_rsa Username:docker}
I0429 13:45:05.589365 54341 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0429 13:45:05.589386 54341 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0429 13:45:05.589467 54341 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-452985
I0429 13:45:05.622394 54341 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37334 SSHKeyPath:/home/jenkins/minikube-integration/18773-4048231/.minikube/machines/no-preload-452985/id_rsa Username:docker}
I0429 13:45:05.672767 54341 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0429 13:45:05.779898 54341 node_ready.go:35] waiting up to 6m0s for node "no-preload-452985" to be "Ready" ...
I0429 13:45:05.842421 54341 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0429 13:45:05.897078 54341 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0429 13:45:05.897156 54341 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0429 13:45:05.901771 54341 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0429 13:45:05.901843 54341 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0429 13:45:05.956021 54341 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0429 13:45:05.956090 54341 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0429 13:45:05.974444 54341 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0429 13:45:05.997772 54341 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0429 13:45:05.997862 54341 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0429 13:45:06.073955 54341 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0429 13:45:06.074033 54341 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0429 13:45:06.188155 54341 addons.go:426] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0429 13:45:06.188232 54341 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0429 13:45:06.239841 54341 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0429 13:45:06.331157 54341 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0429 13:45:06.331230 54341 retry.go:31] will retry after 349.825897ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0429 13:45:06.426026 54341 addons.go:426] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0429 13:45:06.426060 54341 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0429 13:45:06.532125 54341 addons.go:426] installing /etc/kubernetes/addons/dashboard-role.yaml
I0429 13:45:06.532198 54341 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0429 13:45:06.569376 54341 addons.go:426] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0429 13:45:06.569447 54341 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0429 13:45:06.598695 54341 addons.go:426] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0429 13:45:06.598765 54341 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0429 13:45:06.642269 54341 addons.go:426] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0429 13:45:06.642339 54341 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0429 13:45:06.681572 54341 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0429 13:45:06.696001 54341 addons.go:426] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0429 13:45:06.696070 54341 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0429 13:45:06.814656 54341 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0429 13:45:05.761246 46889 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:07.259644 46889 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-637516" in "kube-system" namespace has status "Ready":"True"
I0429 13:45:07.259674 46889 pod_ready.go:81] duration metric: took 21.007258891s for pod "kube-scheduler-old-k8s-version-637516" in "kube-system" namespace to be "Ready" ...
I0429 13:45:07.259687 46889 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace to be "Ready" ...
I0429 13:45:10.642557 54341 node_ready.go:49] node "no-preload-452985" has status "Ready":"True"
I0429 13:45:10.642586 54341 node_ready.go:38] duration metric: took 4.862604679s for node "no-preload-452985" to be "Ready" ...
I0429 13:45:10.642596 54341 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0429 13:45:10.756213 54341 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-g8jz9" in "kube-system" namespace to be "Ready" ...
I0429 13:45:10.805270 54341 pod_ready.go:92] pod "coredns-7db6d8ff4d-g8jz9" in "kube-system" namespace has status "Ready":"True"
I0429 13:45:10.805350 54341 pod_ready.go:81] duration metric: took 49.065073ms for pod "coredns-7db6d8ff4d-g8jz9" in "kube-system" namespace to be "Ready" ...
I0429 13:45:10.805376 54341 pod_ready.go:78] waiting up to 6m0s for pod "etcd-no-preload-452985" in "kube-system" namespace to be "Ready" ...
I0429 13:45:10.814530 54341 pod_ready.go:92] pod "etcd-no-preload-452985" in "kube-system" namespace has status "Ready":"True"
I0429 13:45:10.814603 54341 pod_ready.go:81] duration metric: took 9.208205ms for pod "etcd-no-preload-452985" in "kube-system" namespace to be "Ready" ...
I0429 13:45:10.814631 54341 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-no-preload-452985" in "kube-system" namespace to be "Ready" ...
I0429 13:45:10.823943 54341 pod_ready.go:92] pod "kube-apiserver-no-preload-452985" in "kube-system" namespace has status "Ready":"True"
I0429 13:45:10.824015 54341 pod_ready.go:81] duration metric: took 9.364335ms for pod "kube-apiserver-no-preload-452985" in "kube-system" namespace to be "Ready" ...
I0429 13:45:10.824040 54341 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-no-preload-452985" in "kube-system" namespace to be "Ready" ...
I0429 13:45:10.829742 54341 pod_ready.go:92] pod "kube-controller-manager-no-preload-452985" in "kube-system" namespace has status "Ready":"True"
I0429 13:45:10.829826 54341 pod_ready.go:81] duration metric: took 5.764047ms for pod "kube-controller-manager-no-preload-452985" in "kube-system" namespace to be "Ready" ...
I0429 13:45:10.829866 54341 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-68dsj" in "kube-system" namespace to be "Ready" ...
I0429 13:45:10.845758 54341 pod_ready.go:92] pod "kube-proxy-68dsj" in "kube-system" namespace has status "Ready":"True"
I0429 13:45:10.845830 54341 pod_ready.go:81] duration metric: took 15.925292ms for pod "kube-proxy-68dsj" in "kube-system" namespace to be "Ready" ...
I0429 13:45:10.845856 54341 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-no-preload-452985" in "kube-system" namespace to be "Ready" ...
I0429 13:45:10.919998 54341 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (4.945467616s)
I0429 13:45:11.245579 54341 pod_ready.go:92] pod "kube-scheduler-no-preload-452985" in "kube-system" namespace has status "Ready":"True"
I0429 13:45:11.245641 54341 pod_ready.go:81] duration metric: took 399.764211ms for pod "kube-scheduler-no-preload-452985" in "kube-system" namespace to be "Ready" ...
I0429 13:45:11.245667 54341 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace to be "Ready" ...
I0429 13:45:13.259163 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:13.361528 54341 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.121648296s)
I0429 13:45:13.361627 54341 addons.go:470] Verifying addon metrics-server=true in "no-preload-452985"
I0429 13:45:13.426012 54341 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (6.744359488s)
I0429 13:45:13.598656 54341 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (6.783904809s)
I0429 13:45:13.601050 54341 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p no-preload-452985 addons enable metrics-server
I0429 13:45:13.603190 54341 out.go:177] * Enabled addons: default-storageclass, metrics-server, storage-provisioner, dashboard
I0429 13:45:09.266750 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:11.767076 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:13.604855 54341 addons.go:505] duration metric: took 8.16906219s for enable addons: enabled=[default-storageclass metrics-server storage-provisioner dashboard]
I0429 13:45:15.752773 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:18.252862 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:14.266084 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:16.268283 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:18.765832 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:20.752422 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:23.256308 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:21.265522 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:23.267042 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:25.752608 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:28.252313 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:25.268120 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:27.773072 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:30.252920 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:32.253011 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:30.265959 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:32.279584 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:34.752461 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:36.754742 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:34.765777 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:37.266136 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:39.251270 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:41.751770 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:39.266444 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:41.766224 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:43.755433 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:46.251832 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:44.265827 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:46.778473 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:48.752015 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:50.752543 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:52.753231 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:49.266291 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:51.765990 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:55.251242 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:57.252425 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:54.266385 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:56.266703 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:58.766020 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:45:59.752193 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:01.754991 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:01.266408 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:03.268438 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:04.251252 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:06.252149 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:08.252223 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:05.765712 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:08.265823 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:10.754884 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:13.254972 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:10.767055 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:13.265300 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:15.751701 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:18.251721 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:15.266602 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:17.766600 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:20.252492 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:22.751551 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:20.265568 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:22.266916 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:24.751925 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:26.752253 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:24.765419 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:26.765466 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:28.766368 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:29.251154 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:31.251344 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:33.253800 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:30.766841 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:33.265686 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:35.751955 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:38.251879 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:35.265738 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:37.266337 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:40.252728 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:42.757039 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:39.266780 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:41.766138 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:45.252755 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:47.751779 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:44.266146 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:46.266373 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:48.271532 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:49.752022 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:51.752476 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:50.765849 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:53.267090 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:53.754888 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:56.251107 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:58.252300 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:55.766570 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:46:58.266145 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:00.271471 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:02.751607 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:00.279814 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:02.766362 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:04.751797 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:06.751861 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:04.768920 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:07.265957 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:09.251714 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:11.252698 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:09.765714 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:11.766055 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:13.766195 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:13.751839 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:15.752204 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:18.251584 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:16.265916 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:18.267250 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:20.757764 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:23.252163 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:20.766414 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:23.275169 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:25.752047 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:28.251479 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:25.766313 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:28.266512 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:30.251625 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:32.252230 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:30.765688 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:32.765884 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:34.751290 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:36.751626 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:34.766413 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:36.766520 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:38.752033 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:40.757851 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:43.251438 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:39.266880 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:41.766480 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:45.252547 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:47.751500 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:44.266497 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:46.766591 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:50.252188 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:52.752377 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:49.266180 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:51.765842 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:53.803685 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:55.251332 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:57.251922 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:56.266376 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:58.766240 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:47:59.752088 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:01.752202 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:00.768307 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:03.266231 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:04.252708 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:06.752440 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:05.266664 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:07.765258 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:09.251309 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:11.751751 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:09.765652 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:12.266221 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:13.753245 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:16.252128 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:18.252446 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:14.266533 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:16.766191 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:20.752234 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:23.251387 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:19.268466 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:21.765904 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:25.252327 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:27.752179 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:24.266340 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:26.765975 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:28.766878 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:30.252049 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:32.751011 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:31.265168 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:33.766220 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:34.751447 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:36.751761 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:36.266902 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:38.766387 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:39.251485 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:41.251766 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:43.251979 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:41.266575 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:43.765349 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:45.252385 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:47.751975 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:46.265648 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:48.771839 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:49.752004 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:52.251596 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:51.265770 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:53.267458 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:54.251744 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:56.253046 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:55.765281 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:57.765726 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:58.753318 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:49:01.253156 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:48:59.765838 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:49:02.265615 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:49:03.751773 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:49:05.752218 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:49:07.752762 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:49:04.765522 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:49:06.765736 46889 pod_ready.go:102] pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace has status "Ready":"False"
I0429 13:49:07.265941 46889 pod_ready.go:81] duration metric: took 4m0.00619779s for pod "metrics-server-9975d5f86-x5gln" in "kube-system" namespace to be "Ready" ...
E0429 13:49:07.265966 46889 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0429 13:49:07.265975 46889 pod_ready.go:38] duration metric: took 5m25.241788145s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0429 13:49:07.265990 46889 api_server.go:52] waiting for apiserver process to appear ...
I0429 13:49:07.266035 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0429 13:49:07.266100 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0429 13:49:07.319128 46889 cri.go:89] found id: "6f49514fe6938949387be25147dcb0463b2b9ae15ee83e14cae5c70460c06a68"
I0429 13:49:07.319155 46889 cri.go:89] found id: "92695848292c9dcf5fb37f9b7432bba3fafa7483ced7559a57ab1206427c21f3"
I0429 13:49:07.319161 46889 cri.go:89] found id: ""
I0429 13:49:07.319168 46889 logs.go:276] 2 containers: [6f49514fe6938949387be25147dcb0463b2b9ae15ee83e14cae5c70460c06a68 92695848292c9dcf5fb37f9b7432bba3fafa7483ced7559a57ab1206427c21f3]
I0429 13:49:07.319234 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.323642 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.327311 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0429 13:49:07.327397 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0429 13:49:07.367816 46889 cri.go:89] found id: "d822d5375019aa8b6fdae088edca5093130b82835432dd2833a71ae56c9a1753"
I0429 13:49:07.367836 46889 cri.go:89] found id: "487a468a367155648e2599415872a829294e36e2f52064e34362ae63b9dc2b51"
I0429 13:49:07.367841 46889 cri.go:89] found id: ""
I0429 13:49:07.367848 46889 logs.go:276] 2 containers: [d822d5375019aa8b6fdae088edca5093130b82835432dd2833a71ae56c9a1753 487a468a367155648e2599415872a829294e36e2f52064e34362ae63b9dc2b51]
I0429 13:49:07.367914 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.372145 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.376346 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0429 13:49:07.376435 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0429 13:49:07.434170 46889 cri.go:89] found id: "99aafd29fea02a0255847f0185b6468d29d23dead19e79879c006c7b1030f5b5"
I0429 13:49:07.434198 46889 cri.go:89] found id: "ceace251a3f285f11b13a433c49367b13d702752ff40ae66e2e8b3ac72bf71b2"
I0429 13:49:07.434204 46889 cri.go:89] found id: ""
I0429 13:49:07.434212 46889 logs.go:276] 2 containers: [99aafd29fea02a0255847f0185b6468d29d23dead19e79879c006c7b1030f5b5 ceace251a3f285f11b13a433c49367b13d702752ff40ae66e2e8b3ac72bf71b2]
I0429 13:49:07.434278 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.440463 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.444669 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0429 13:49:07.444744 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0429 13:49:07.484806 46889 cri.go:89] found id: "4b9d2030c82b4b99a0f1aa9c220a7d550fa28b6799c689551c3e01a257cf14fe"
I0429 13:49:07.484830 46889 cri.go:89] found id: "676b344d21c39a7b716ddccc155a37537ba17d9d55bded00344944a3b5251ae1"
I0429 13:49:07.484835 46889 cri.go:89] found id: ""
I0429 13:49:07.484843 46889 logs.go:276] 2 containers: [4b9d2030c82b4b99a0f1aa9c220a7d550fa28b6799c689551c3e01a257cf14fe 676b344d21c39a7b716ddccc155a37537ba17d9d55bded00344944a3b5251ae1]
I0429 13:49:07.484902 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.488851 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.492226 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0429 13:49:07.492303 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0429 13:49:07.536632 46889 cri.go:89] found id: "ac0d7e8ff20e394f5786d75b39f6d09a8343e15d46a71c3ba119572cf16daac8"
I0429 13:49:07.536717 46889 cri.go:89] found id: "afe201cf19cd54f9626556f9fb2af59a62b57b2fc3870087ea49951763023e6a"
I0429 13:49:07.536735 46889 cri.go:89] found id: ""
I0429 13:49:07.536744 46889 logs.go:276] 2 containers: [ac0d7e8ff20e394f5786d75b39f6d09a8343e15d46a71c3ba119572cf16daac8 afe201cf19cd54f9626556f9fb2af59a62b57b2fc3870087ea49951763023e6a]
I0429 13:49:07.536810 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.540566 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.544205 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0429 13:49:07.544308 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0429 13:49:07.586363 46889 cri.go:89] found id: "46b329f549c16117b457f7dc74e36a56f69621b977c14a4225023ad5189c1e6f"
I0429 13:49:07.586387 46889 cri.go:89] found id: "eebb19d675cf51320fc9b8f9626a50880eba8fff7e0cae674a7b0477d516f3c9"
I0429 13:49:07.586392 46889 cri.go:89] found id: ""
I0429 13:49:07.586400 46889 logs.go:276] 2 containers: [46b329f549c16117b457f7dc74e36a56f69621b977c14a4225023ad5189c1e6f eebb19d675cf51320fc9b8f9626a50880eba8fff7e0cae674a7b0477d516f3c9]
I0429 13:49:07.586466 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.590576 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.594012 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0429 13:49:07.594087 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0429 13:49:07.643343 46889 cri.go:89] found id: "b9ff1e04cc2c14075223ed4143af7eab578112a95cd911df71fd61fe781efe9d"
I0429 13:49:07.643415 46889 cri.go:89] found id: "2d56c26090f29460a7f6de0be95e5742db6f734116e1e0b8060dba86b11a18c5"
I0429 13:49:07.643432 46889 cri.go:89] found id: ""
I0429 13:49:07.643454 46889 logs.go:276] 2 containers: [b9ff1e04cc2c14075223ed4143af7eab578112a95cd911df71fd61fe781efe9d 2d56c26090f29460a7f6de0be95e5742db6f734116e1e0b8060dba86b11a18c5]
I0429 13:49:07.643519 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.647310 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.650895 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0429 13:49:07.650976 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0429 13:49:07.692477 46889 cri.go:89] found id: "1171f7bf9e312d4e83e31789284ded3b56c8733f0f86756b847094cf17e199fc"
I0429 13:49:07.692556 46889 cri.go:89] found id: ""
I0429 13:49:07.692570 46889 logs.go:276] 1 containers: [1171f7bf9e312d4e83e31789284ded3b56c8733f0f86756b847094cf17e199fc]
I0429 13:49:07.692636 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.696513 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0429 13:49:07.696588 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0429 13:49:07.736604 46889 cri.go:89] found id: "b8faf4156978f8c5ec933471c71bdc73a0b442e4b837e3bdabab95ad9cf09146"
I0429 13:49:07.736626 46889 cri.go:89] found id: "9eb815c958691521a891ce6a646a8fe229c3c32994b0bd94e3911286c5e1a6d4"
I0429 13:49:07.736632 46889 cri.go:89] found id: ""
I0429 13:49:07.736639 46889 logs.go:276] 2 containers: [b8faf4156978f8c5ec933471c71bdc73a0b442e4b837e3bdabab95ad9cf09146 9eb815c958691521a891ce6a646a8fe229c3c32994b0bd94e3911286c5e1a6d4]
I0429 13:49:07.736701 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.740688 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:07.744245 46889 logs.go:123] Gathering logs for coredns [ceace251a3f285f11b13a433c49367b13d702752ff40ae66e2e8b3ac72bf71b2] ...
I0429 13:49:07.744270 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ceace251a3f285f11b13a433c49367b13d702752ff40ae66e2e8b3ac72bf71b2"
I0429 13:49:07.792535 46889 logs.go:123] Gathering logs for dmesg ...
I0429 13:49:07.792567 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0429 13:49:07.813587 46889 logs.go:123] Gathering logs for kube-apiserver [92695848292c9dcf5fb37f9b7432bba3fafa7483ced7559a57ab1206427c21f3] ...
I0429 13:49:07.813617 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 92695848292c9dcf5fb37f9b7432bba3fafa7483ced7559a57ab1206427c21f3"
I0429 13:49:07.870937 46889 logs.go:123] Gathering logs for coredns [99aafd29fea02a0255847f0185b6468d29d23dead19e79879c006c7b1030f5b5] ...
I0429 13:49:07.870971 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 99aafd29fea02a0255847f0185b6468d29d23dead19e79879c006c7b1030f5b5"
I0429 13:49:07.924127 46889 logs.go:123] Gathering logs for kube-scheduler [4b9d2030c82b4b99a0f1aa9c220a7d550fa28b6799c689551c3e01a257cf14fe] ...
I0429 13:49:07.924155 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4b9d2030c82b4b99a0f1aa9c220a7d550fa28b6799c689551c3e01a257cf14fe"
I0429 13:49:07.971460 46889 logs.go:123] Gathering logs for kube-scheduler [676b344d21c39a7b716ddccc155a37537ba17d9d55bded00344944a3b5251ae1] ...
I0429 13:49:07.971492 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 676b344d21c39a7b716ddccc155a37537ba17d9d55bded00344944a3b5251ae1"
I0429 13:49:08.020657 46889 logs.go:123] Gathering logs for storage-provisioner [9eb815c958691521a891ce6a646a8fe229c3c32994b0bd94e3911286c5e1a6d4] ...
I0429 13:49:08.020690 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9eb815c958691521a891ce6a646a8fe229c3c32994b0bd94e3911286c5e1a6d4"
I0429 13:49:08.062079 46889 logs.go:123] Gathering logs for kube-apiserver [6f49514fe6938949387be25147dcb0463b2b9ae15ee83e14cae5c70460c06a68] ...
I0429 13:49:08.062108 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6f49514fe6938949387be25147dcb0463b2b9ae15ee83e14cae5c70460c06a68"
I0429 13:49:08.131183 46889 logs.go:123] Gathering logs for etcd [487a468a367155648e2599415872a829294e36e2f52064e34362ae63b9dc2b51] ...
I0429 13:49:08.131225 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 487a468a367155648e2599415872a829294e36e2f52064e34362ae63b9dc2b51"
I0429 13:49:08.184979 46889 logs.go:123] Gathering logs for kube-proxy [ac0d7e8ff20e394f5786d75b39f6d09a8343e15d46a71c3ba119572cf16daac8] ...
I0429 13:49:08.185009 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ac0d7e8ff20e394f5786d75b39f6d09a8343e15d46a71c3ba119572cf16daac8"
I0429 13:49:08.233437 46889 logs.go:123] Gathering logs for kube-proxy [afe201cf19cd54f9626556f9fb2af59a62b57b2fc3870087ea49951763023e6a] ...
I0429 13:49:08.233467 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 afe201cf19cd54f9626556f9fb2af59a62b57b2fc3870087ea49951763023e6a"
I0429 13:49:08.299373 46889 logs.go:123] Gathering logs for kindnet [b9ff1e04cc2c14075223ed4143af7eab578112a95cd911df71fd61fe781efe9d] ...
I0429 13:49:08.299402 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b9ff1e04cc2c14075223ed4143af7eab578112a95cd911df71fd61fe781efe9d"
I0429 13:49:08.347036 46889 logs.go:123] Gathering logs for kindnet [2d56c26090f29460a7f6de0be95e5742db6f734116e1e0b8060dba86b11a18c5] ...
I0429 13:49:08.347066 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2d56c26090f29460a7f6de0be95e5742db6f734116e1e0b8060dba86b11a18c5"
I0429 13:49:08.399470 46889 logs.go:123] Gathering logs for storage-provisioner [b8faf4156978f8c5ec933471c71bdc73a0b442e4b837e3bdabab95ad9cf09146] ...
I0429 13:49:08.399500 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b8faf4156978f8c5ec933471c71bdc73a0b442e4b837e3bdabab95ad9cf09146"
I0429 13:49:08.438967 46889 logs.go:123] Gathering logs for container status ...
I0429 13:49:08.439037 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0429 13:49:08.485269 46889 logs.go:123] Gathering logs for kubelet ...
I0429 13:49:08.485297 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0429 13:49:08.542300 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857623 659 reflector.go:138] object-"default"/"default-token-nlkvk": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-nlkvk" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:08.542562 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857721 659 reflector.go:138] object-"kube-system"/"kube-proxy-token-6ww95": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-6ww95" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:08.542773 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857791 659 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:08.542985 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857856 659 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:08.543217 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857908 659 reflector.go:138] object-"kube-system"/"storage-provisioner-token-d45m7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-d45m7" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:08.543429 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857965 659 reflector.go:138] object-"kube-system"/"kindnet-token-kb54z": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-kb54z" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:08.543681 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.858021 659 reflector.go:138] object-"kube-system"/"coredns-token-8fhcc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-8fhcc" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:08.543910 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.858109 659 reflector.go:138] object-"kube-system"/"metrics-server-token-5dph5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-5dph5" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:08.552068 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:43 old-k8s-version-637516 kubelet[659]: E0429 13:43:43.774651 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0429 13:49:08.552403 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:44 old-k8s-version-637516 kubelet[659]: E0429 13:43:44.097901 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.557193 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:55 old-k8s-version-637516 kubelet[659]: E0429 13:43:55.958973 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0429 13:49:08.558862 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:09 old-k8s-version-637516 kubelet[659]: E0429 13:44:09.944369 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.559656 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:14 old-k8s-version-637516 kubelet[659]: E0429 13:44:14.326723 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.560224 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:15 old-k8s-version-637516 kubelet[659]: E0429 13:44:15.330554 659 pod_workers.go:191] Error syncing pod 768c1e4c-85ee-4968-9c8c-df33fac74bf3 ("storage-provisioner_kube-system(768c1e4c-85ee-4968-9c8c-df33fac74bf3)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(768c1e4c-85ee-4968-9c8c-df33fac74bf3)"
W0429 13:49:08.560552 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:15 old-k8s-version-637516 kubelet[659]: E0429 13:44:15.349369 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.560878 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:16 old-k8s-version-637516 kubelet[659]: E0429 13:44:16.353332 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.563657 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:24 old-k8s-version-637516 kubelet[659]: E0429 13:44:24.940536 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0429 13:49:08.564374 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:28 old-k8s-version-637516 kubelet[659]: E0429 13:44:28.387652 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.564701 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:35 old-k8s-version-637516 kubelet[659]: E0429 13:44:35.903409 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.564882 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:36 old-k8s-version-637516 kubelet[659]: E0429 13:44:36.931263 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.565207 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:46 old-k8s-version-637516 kubelet[659]: E0429 13:44:46.931347 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.565396 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:48 old-k8s-version-637516 kubelet[659]: E0429 13:44:48.931189 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.565978 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:59 old-k8s-version-637516 kubelet[659]: E0429 13:44:59.455798 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.566161 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:00 old-k8s-version-637516 kubelet[659]: E0429 13:45:00.931323 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.566485 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:05 old-k8s-version-637516 kubelet[659]: E0429 13:45:05.903931 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.568942 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:13 old-k8s-version-637516 kubelet[659]: E0429 13:45:13.944072 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0429 13:49:08.569269 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:16 old-k8s-version-637516 kubelet[659]: E0429 13:45:16.930872 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.569454 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:25 old-k8s-version-637516 kubelet[659]: E0429 13:45:25.931864 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.569796 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:27 old-k8s-version-637516 kubelet[659]: E0429 13:45:27.931269 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.570110 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:39 old-k8s-version-637516 kubelet[659]: E0429 13:45:39.933057 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.570563 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:40 old-k8s-version-637516 kubelet[659]: E0429 13:45:40.548936 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.570903 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:45 old-k8s-version-637516 kubelet[659]: E0429 13:45:45.903448 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.571091 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:51 old-k8s-version-637516 kubelet[659]: E0429 13:45:51.935180 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.571422 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:00 old-k8s-version-637516 kubelet[659]: E0429 13:46:00.931055 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.571606 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:04 old-k8s-version-637516 kubelet[659]: E0429 13:46:04.931269 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.571930 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:11 old-k8s-version-637516 kubelet[659]: E0429 13:46:11.931371 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.572117 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:15 old-k8s-version-637516 kubelet[659]: E0429 13:46:15.931701 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.572439 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:26 old-k8s-version-637516 kubelet[659]: E0429 13:46:26.931099 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.572624 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:29 old-k8s-version-637516 kubelet[659]: E0429 13:46:29.932102 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.572949 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:39 old-k8s-version-637516 kubelet[659]: E0429 13:46:39.931852 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.575406 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:44 old-k8s-version-637516 kubelet[659]: E0429 13:46:44.939309 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0429 13:49:08.575737 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:52 old-k8s-version-637516 kubelet[659]: E0429 13:46:52.930774 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.575921 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:56 old-k8s-version-637516 kubelet[659]: E0429 13:46:56.931506 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.576514 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:05 old-k8s-version-637516 kubelet[659]: E0429 13:47:05.770364 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.576837 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:06 old-k8s-version-637516 kubelet[659]: E0429 13:47:06.773003 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.577020 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:08 old-k8s-version-637516 kubelet[659]: E0429 13:47:08.931577 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.577205 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:19 old-k8s-version-637516 kubelet[659]: E0429 13:47:19.935693 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.577530 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:19 old-k8s-version-637516 kubelet[659]: E0429 13:47:19.937549 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.577715 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:31 old-k8s-version-637516 kubelet[659]: E0429 13:47:31.936395 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.578038 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:34 old-k8s-version-637516 kubelet[659]: E0429 13:47:34.930862 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.578222 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:44 old-k8s-version-637516 kubelet[659]: E0429 13:47:44.931375 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.578550 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:47 old-k8s-version-637516 kubelet[659]: E0429 13:47:47.930873 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.578735 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:59 old-k8s-version-637516 kubelet[659]: E0429 13:47:59.931717 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.579070 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:01 old-k8s-version-637516 kubelet[659]: E0429 13:48:01.931616 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.579258 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:10 old-k8s-version-637516 kubelet[659]: E0429 13:48:10.931290 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.579579 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:14 old-k8s-version-637516 kubelet[659]: E0429 13:48:14.931904 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.579763 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:21 old-k8s-version-637516 kubelet[659]: E0429 13:48:21.931833 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.580086 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:27 old-k8s-version-637516 kubelet[659]: E0429 13:48:27.931422 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.580272 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:35 old-k8s-version-637516 kubelet[659]: E0429 13:48:35.931483 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.580596 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:42 old-k8s-version-637516 kubelet[659]: E0429 13:48:42.930864 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.580779 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:48 old-k8s-version-637516 kubelet[659]: E0429 13:48:48.932975 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.581109 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:56 old-k8s-version-637516 kubelet[659]: E0429 13:48:56.930900 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:08.581294 46889 logs.go:138] Found kubelet problem: Apr 29 13:49:01 old-k8s-version-637516 kubelet[659]: E0429 13:49:01.931193 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:08.581617 46889 logs.go:138] Found kubelet problem: Apr 29 13:49:07 old-k8s-version-637516 kubelet[659]: E0429 13:49:07.931524 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
I0429 13:49:08.581628 46889 logs.go:123] Gathering logs for etcd [d822d5375019aa8b6fdae088edca5093130b82835432dd2833a71ae56c9a1753] ...
I0429 13:49:08.581643 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d822d5375019aa8b6fdae088edca5093130b82835432dd2833a71ae56c9a1753"
I0429 13:49:08.646262 46889 logs.go:123] Gathering logs for kube-controller-manager [eebb19d675cf51320fc9b8f9626a50880eba8fff7e0cae674a7b0477d516f3c9] ...
I0429 13:49:08.646294 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 eebb19d675cf51320fc9b8f9626a50880eba8fff7e0cae674a7b0477d516f3c9"
I0429 13:49:08.737593 46889 logs.go:123] Gathering logs for kubernetes-dashboard [1171f7bf9e312d4e83e31789284ded3b56c8733f0f86756b847094cf17e199fc] ...
I0429 13:49:08.737648 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1171f7bf9e312d4e83e31789284ded3b56c8733f0f86756b847094cf17e199fc"
I0429 13:49:08.781099 46889 logs.go:123] Gathering logs for containerd ...
I0429 13:49:08.781125 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0429 13:49:08.839315 46889 logs.go:123] Gathering logs for describe nodes ...
I0429 13:49:08.839351 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0429 13:49:08.997479 46889 logs.go:123] Gathering logs for kube-controller-manager [46b329f549c16117b457f7dc74e36a56f69621b977c14a4225023ad5189c1e6f] ...
I0429 13:49:08.997509 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 46b329f549c16117b457f7dc74e36a56f69621b977c14a4225023ad5189c1e6f"
I0429 13:49:09.057965 46889 out.go:304] Setting ErrFile to fd 2...
I0429 13:49:09.058451 46889 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0429 13:49:09.058508 46889 out.go:239] X Problems detected in kubelet:
W0429 13:49:09.058521 46889 out.go:239] Apr 29 13:48:42 old-k8s-version-637516 kubelet[659]: E0429 13:48:42.930864 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:09.058535 46889 out.go:239] Apr 29 13:48:48 old-k8s-version-637516 kubelet[659]: E0429 13:48:48.932975 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:09.058550 46889 out.go:239] Apr 29 13:48:56 old-k8s-version-637516 kubelet[659]: E0429 13:48:56.930900 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:09.058561 46889 out.go:239] Apr 29 13:49:01 old-k8s-version-637516 kubelet[659]: E0429 13:49:01.931193 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:09.058567 46889 out.go:239] Apr 29 13:49:07 old-k8s-version-637516 kubelet[659]: E0429 13:49:07.931524 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
I0429 13:49:09.058576 46889 out.go:304] Setting ErrFile to fd 2...
I0429 13:49:09.058583 46889 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0429 13:49:09.752791 54341 pod_ready.go:102] pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace has status "Ready":"False"
I0429 13:49:11.252236 54341 pod_ready.go:81] duration metric: took 4m0.006542928s for pod "metrics-server-569cc877fc-6mt4f" in "kube-system" namespace to be "Ready" ...
E0429 13:49:11.252298 54341 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0429 13:49:11.252324 54341 pod_ready.go:38] duration metric: took 4m0.609715522s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0429 13:49:11.252344 54341 api_server.go:52] waiting for apiserver process to appear ...
I0429 13:49:11.252372 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0429 13:49:11.252440 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0429 13:49:11.289957 54341 cri.go:89] found id: "a9b1916ffd4c752a8cd852e671dc2b6bf80541cab530ee8ebac5a1f9096220cd"
I0429 13:49:11.289980 54341 cri.go:89] found id: "8479fc16ba8a689c95a90d6010d6cd7e41e3ef515bbf558657fcbcb4ce4fad8d"
I0429 13:49:11.289987 54341 cri.go:89] found id: ""
I0429 13:49:11.289994 54341 logs.go:276] 2 containers: [a9b1916ffd4c752a8cd852e671dc2b6bf80541cab530ee8ebac5a1f9096220cd 8479fc16ba8a689c95a90d6010d6cd7e41e3ef515bbf558657fcbcb4ce4fad8d]
I0429 13:49:11.290053 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:11.293990 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:11.297614 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0429 13:49:11.297699 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0429 13:49:11.350541 54341 cri.go:89] found id: "c619a84cd4b5d52dea394eb9e55793deaf5c84af0ff41cd181f3ec294aa6898e"
I0429 13:49:11.350566 54341 cri.go:89] found id: "337dae6815a9bc77d4d0cda01280f06fcdd445b632c003e045a5effec947091b"
I0429 13:49:11.350572 54341 cri.go:89] found id: ""
I0429 13:49:11.350579 54341 logs.go:276] 2 containers: [c619a84cd4b5d52dea394eb9e55793deaf5c84af0ff41cd181f3ec294aa6898e 337dae6815a9bc77d4d0cda01280f06fcdd445b632c003e045a5effec947091b]
I0429 13:49:11.350657 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:11.354743 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:11.358495 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0429 13:49:11.358594 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0429 13:49:11.402454 54341 cri.go:89] found id: "321ab2f02311cecc28b896edfd2de37f27acf6ce79a835ee232206f0e1cad599"
I0429 13:49:11.402476 54341 cri.go:89] found id: "9424f2b14afbbf14dc6034f77898c6d50797b2d72c6bfc7e4f2abbf792b13510"
I0429 13:49:11.402482 54341 cri.go:89] found id: ""
I0429 13:49:11.402489 54341 logs.go:276] 2 containers: [321ab2f02311cecc28b896edfd2de37f27acf6ce79a835ee232206f0e1cad599 9424f2b14afbbf14dc6034f77898c6d50797b2d72c6bfc7e4f2abbf792b13510]
I0429 13:49:11.402558 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:11.406385 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:11.410045 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0429 13:49:11.410118 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0429 13:49:11.454940 54341 cri.go:89] found id: "1164addf1687d43551d62d9585fae665f50f87b59df3ac3cdaca0f332ea6fa38"
I0429 13:49:11.454973 54341 cri.go:89] found id: "773300bb56a3cf480debfc1708df63d242912d955ed2878e344f290b3e135636"
I0429 13:49:11.454978 54341 cri.go:89] found id: ""
I0429 13:49:11.454986 54341 logs.go:276] 2 containers: [1164addf1687d43551d62d9585fae665f50f87b59df3ac3cdaca0f332ea6fa38 773300bb56a3cf480debfc1708df63d242912d955ed2878e344f290b3e135636]
I0429 13:49:11.455056 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:11.458601 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:11.461890 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0429 13:49:11.461965 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0429 13:49:11.508832 54341 cri.go:89] found id: "7f79624c17430676c296e00e693bab05b33cc379e57f5ef697ba5c7f9d0ed5ad"
I0429 13:49:11.508951 54341 cri.go:89] found id: "5aecd138f90559d169394f79f0ad05b606433fa4b4ec072c13e9835835ce17a1"
I0429 13:49:11.508970 54341 cri.go:89] found id: ""
I0429 13:49:11.508998 54341 logs.go:276] 2 containers: [7f79624c17430676c296e00e693bab05b33cc379e57f5ef697ba5c7f9d0ed5ad 5aecd138f90559d169394f79f0ad05b606433fa4b4ec072c13e9835835ce17a1]
I0429 13:49:11.509094 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:11.512728 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:11.516345 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0429 13:49:11.516471 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0429 13:49:11.557876 54341 cri.go:89] found id: "86999dfa0ef227089779294515c0edc4aec86591625ce9468a70dd842c85c6a5"
I0429 13:49:11.557943 54341 cri.go:89] found id: "318cce7a1b0f2a614f1194bbaa431bfa0f983bbdae38b64ee888c61540c28705"
I0429 13:49:11.557955 54341 cri.go:89] found id: ""
I0429 13:49:11.557963 54341 logs.go:276] 2 containers: [86999dfa0ef227089779294515c0edc4aec86591625ce9468a70dd842c85c6a5 318cce7a1b0f2a614f1194bbaa431bfa0f983bbdae38b64ee888c61540c28705]
I0429 13:49:11.558033 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:11.561635 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:11.565503 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0429 13:49:11.565577 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0429 13:49:11.614194 54341 cri.go:89] found id: "8f08fd37b9722a4c5ef5f7c31b777ddca73efdfeb2aec27755ada5cbaa29b62a"
I0429 13:49:11.614263 54341 cri.go:89] found id: "3c7c4fb800f0fb3702325ff5f5658941d615bbeb528e0ace8320ca9d937313fb"
I0429 13:49:11.614292 54341 cri.go:89] found id: ""
I0429 13:49:11.614312 54341 logs.go:276] 2 containers: [8f08fd37b9722a4c5ef5f7c31b777ddca73efdfeb2aec27755ada5cbaa29b62a 3c7c4fb800f0fb3702325ff5f5658941d615bbeb528e0ace8320ca9d937313fb]
I0429 13:49:11.614396 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:11.618374 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:11.622100 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0429 13:49:11.622221 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0429 13:49:11.662502 54341 cri.go:89] found id: "f539a90d1219ba425a0de60d8caa1c954296acf845937d023b88c0290e16d535"
I0429 13:49:11.662524 54341 cri.go:89] found id: ""
I0429 13:49:11.662532 54341 logs.go:276] 1 containers: [f539a90d1219ba425a0de60d8caa1c954296acf845937d023b88c0290e16d535]
I0429 13:49:11.662600 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:11.666574 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0429 13:49:11.666650 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0429 13:49:11.718378 54341 cri.go:89] found id: "3c8484524133f407ce59c822b3a864e3cba1cb23839ec61ec98469adb9983061"
I0429 13:49:11.718453 54341 cri.go:89] found id: "7fcc36d1b0b23c2f9801279de66c54bed59e84aecd7a965c1122648a7fc645b4"
I0429 13:49:11.718470 54341 cri.go:89] found id: ""
I0429 13:49:11.718493 54341 logs.go:276] 2 containers: [3c8484524133f407ce59c822b3a864e3cba1cb23839ec61ec98469adb9983061 7fcc36d1b0b23c2f9801279de66c54bed59e84aecd7a965c1122648a7fc645b4]
I0429 13:49:11.718581 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:11.722518 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:11.726402 54341 logs.go:123] Gathering logs for kube-proxy [7f79624c17430676c296e00e693bab05b33cc379e57f5ef697ba5c7f9d0ed5ad] ...
I0429 13:49:11.726429 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7f79624c17430676c296e00e693bab05b33cc379e57f5ef697ba5c7f9d0ed5ad"
I0429 13:49:11.765077 54341 logs.go:123] Gathering logs for kindnet [8f08fd37b9722a4c5ef5f7c31b777ddca73efdfeb2aec27755ada5cbaa29b62a] ...
I0429 13:49:11.765108 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8f08fd37b9722a4c5ef5f7c31b777ddca73efdfeb2aec27755ada5cbaa29b62a"
I0429 13:49:11.804965 54341 logs.go:123] Gathering logs for storage-provisioner [7fcc36d1b0b23c2f9801279de66c54bed59e84aecd7a965c1122648a7fc645b4] ...
I0429 13:49:11.805060 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7fcc36d1b0b23c2f9801279de66c54bed59e84aecd7a965c1122648a7fc645b4"
I0429 13:49:11.849334 54341 logs.go:123] Gathering logs for kubelet ...
I0429 13:49:11.849361 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0429 13:49:11.923610 54341 logs.go:123] Gathering logs for kube-apiserver [a9b1916ffd4c752a8cd852e671dc2b6bf80541cab530ee8ebac5a1f9096220cd] ...
I0429 13:49:11.923686 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a9b1916ffd4c752a8cd852e671dc2b6bf80541cab530ee8ebac5a1f9096220cd"
I0429 13:49:11.980274 54341 logs.go:123] Gathering logs for coredns [9424f2b14afbbf14dc6034f77898c6d50797b2d72c6bfc7e4f2abbf792b13510] ...
I0429 13:49:11.980309 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9424f2b14afbbf14dc6034f77898c6d50797b2d72c6bfc7e4f2abbf792b13510"
I0429 13:49:12.030789 54341 logs.go:123] Gathering logs for kube-scheduler [1164addf1687d43551d62d9585fae665f50f87b59df3ac3cdaca0f332ea6fa38] ...
I0429 13:49:12.030861 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1164addf1687d43551d62d9585fae665f50f87b59df3ac3cdaca0f332ea6fa38"
I0429 13:49:12.073879 54341 logs.go:123] Gathering logs for dmesg ...
I0429 13:49:12.073904 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0429 13:49:12.093770 54341 logs.go:123] Gathering logs for kube-scheduler [773300bb56a3cf480debfc1708df63d242912d955ed2878e344f290b3e135636] ...
I0429 13:49:12.093806 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 773300bb56a3cf480debfc1708df63d242912d955ed2878e344f290b3e135636"
I0429 13:49:12.146031 54341 logs.go:123] Gathering logs for kindnet [3c7c4fb800f0fb3702325ff5f5658941d615bbeb528e0ace8320ca9d937313fb] ...
I0429 13:49:12.146069 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3c7c4fb800f0fb3702325ff5f5658941d615bbeb528e0ace8320ca9d937313fb"
I0429 13:49:12.186530 54341 logs.go:123] Gathering logs for storage-provisioner [3c8484524133f407ce59c822b3a864e3cba1cb23839ec61ec98469adb9983061] ...
I0429 13:49:12.186603 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3c8484524133f407ce59c822b3a864e3cba1cb23839ec61ec98469adb9983061"
I0429 13:49:12.243845 54341 logs.go:123] Gathering logs for kube-proxy [5aecd138f90559d169394f79f0ad05b606433fa4b4ec072c13e9835835ce17a1] ...
I0429 13:49:12.243871 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5aecd138f90559d169394f79f0ad05b606433fa4b4ec072c13e9835835ce17a1"
I0429 13:49:12.289614 54341 logs.go:123] Gathering logs for kube-controller-manager [86999dfa0ef227089779294515c0edc4aec86591625ce9468a70dd842c85c6a5] ...
I0429 13:49:12.289641 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 86999dfa0ef227089779294515c0edc4aec86591625ce9468a70dd842c85c6a5"
I0429 13:49:12.364804 54341 logs.go:123] Gathering logs for kube-controller-manager [318cce7a1b0f2a614f1194bbaa431bfa0f983bbdae38b64ee888c61540c28705] ...
I0429 13:49:12.364837 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 318cce7a1b0f2a614f1194bbaa431bfa0f983bbdae38b64ee888c61540c28705"
I0429 13:49:12.434347 54341 logs.go:123] Gathering logs for kubernetes-dashboard [f539a90d1219ba425a0de60d8caa1c954296acf845937d023b88c0290e16d535] ...
I0429 13:49:12.434377 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f539a90d1219ba425a0de60d8caa1c954296acf845937d023b88c0290e16d535"
I0429 13:49:12.477050 54341 logs.go:123] Gathering logs for kube-apiserver [8479fc16ba8a689c95a90d6010d6cd7e41e3ef515bbf558657fcbcb4ce4fad8d] ...
I0429 13:49:12.477077 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8479fc16ba8a689c95a90d6010d6cd7e41e3ef515bbf558657fcbcb4ce4fad8d"
I0429 13:49:12.534408 54341 logs.go:123] Gathering logs for etcd [c619a84cd4b5d52dea394eb9e55793deaf5c84af0ff41cd181f3ec294aa6898e] ...
I0429 13:49:12.534455 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c619a84cd4b5d52dea394eb9e55793deaf5c84af0ff41cd181f3ec294aa6898e"
I0429 13:49:12.609783 54341 logs.go:123] Gathering logs for etcd [337dae6815a9bc77d4d0cda01280f06fcdd445b632c003e045a5effec947091b] ...
I0429 13:49:12.609868 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 337dae6815a9bc77d4d0cda01280f06fcdd445b632c003e045a5effec947091b"
I0429 13:49:12.659917 54341 logs.go:123] Gathering logs for coredns [321ab2f02311cecc28b896edfd2de37f27acf6ce79a835ee232206f0e1cad599] ...
I0429 13:49:12.659953 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 321ab2f02311cecc28b896edfd2de37f27acf6ce79a835ee232206f0e1cad599"
I0429 13:49:12.707379 54341 logs.go:123] Gathering logs for container status ...
I0429 13:49:12.707409 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0429 13:49:12.757587 54341 logs.go:123] Gathering logs for describe nodes ...
I0429 13:49:12.757613 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0429 13:49:12.948549 54341 logs.go:123] Gathering logs for containerd ...
I0429 13:49:12.948596 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0429 13:49:15.508950 54341 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0429 13:49:15.521477 54341 api_server.go:72] duration metric: took 4m10.085492103s to wait for apiserver process to appear ...
I0429 13:49:15.521513 54341 api_server.go:88] waiting for apiserver healthz status ...
I0429 13:49:15.521571 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0429 13:49:15.521643 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0429 13:49:15.565270 54341 cri.go:89] found id: "a9b1916ffd4c752a8cd852e671dc2b6bf80541cab530ee8ebac5a1f9096220cd"
I0429 13:49:15.565293 54341 cri.go:89] found id: "8479fc16ba8a689c95a90d6010d6cd7e41e3ef515bbf558657fcbcb4ce4fad8d"
I0429 13:49:15.565298 54341 cri.go:89] found id: ""
I0429 13:49:15.565305 54341 logs.go:276] 2 containers: [a9b1916ffd4c752a8cd852e671dc2b6bf80541cab530ee8ebac5a1f9096220cd 8479fc16ba8a689c95a90d6010d6cd7e41e3ef515bbf558657fcbcb4ce4fad8d]
I0429 13:49:15.565367 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:15.569262 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:15.572882 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0429 13:49:15.572985 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0429 13:49:15.626304 54341 cri.go:89] found id: "c619a84cd4b5d52dea394eb9e55793deaf5c84af0ff41cd181f3ec294aa6898e"
I0429 13:49:15.626330 54341 cri.go:89] found id: "337dae6815a9bc77d4d0cda01280f06fcdd445b632c003e045a5effec947091b"
I0429 13:49:15.626336 54341 cri.go:89] found id: ""
I0429 13:49:15.626343 54341 logs.go:276] 2 containers: [c619a84cd4b5d52dea394eb9e55793deaf5c84af0ff41cd181f3ec294aa6898e 337dae6815a9bc77d4d0cda01280f06fcdd445b632c003e045a5effec947091b]
I0429 13:49:15.626433 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:15.630167 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:15.634021 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0429 13:49:15.634119 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0429 13:49:15.686732 54341 cri.go:89] found id: "321ab2f02311cecc28b896edfd2de37f27acf6ce79a835ee232206f0e1cad599"
I0429 13:49:15.686755 54341 cri.go:89] found id: "9424f2b14afbbf14dc6034f77898c6d50797b2d72c6bfc7e4f2abbf792b13510"
I0429 13:49:15.686760 54341 cri.go:89] found id: ""
I0429 13:49:15.686767 54341 logs.go:276] 2 containers: [321ab2f02311cecc28b896edfd2de37f27acf6ce79a835ee232206f0e1cad599 9424f2b14afbbf14dc6034f77898c6d50797b2d72c6bfc7e4f2abbf792b13510]
I0429 13:49:15.686884 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:15.691119 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:15.694912 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0429 13:49:15.695010 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0429 13:49:15.732266 54341 cri.go:89] found id: "1164addf1687d43551d62d9585fae665f50f87b59df3ac3cdaca0f332ea6fa38"
I0429 13:49:15.732342 54341 cri.go:89] found id: "773300bb56a3cf480debfc1708df63d242912d955ed2878e344f290b3e135636"
I0429 13:49:15.732361 54341 cri.go:89] found id: ""
I0429 13:49:15.732381 54341 logs.go:276] 2 containers: [1164addf1687d43551d62d9585fae665f50f87b59df3ac3cdaca0f332ea6fa38 773300bb56a3cf480debfc1708df63d242912d955ed2878e344f290b3e135636]
I0429 13:49:15.732461 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:15.737187 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:15.741154 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0429 13:49:15.741257 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0429 13:49:15.778933 54341 cri.go:89] found id: "7f79624c17430676c296e00e693bab05b33cc379e57f5ef697ba5c7f9d0ed5ad"
I0429 13:49:15.778955 54341 cri.go:89] found id: "5aecd138f90559d169394f79f0ad05b606433fa4b4ec072c13e9835835ce17a1"
I0429 13:49:15.778960 54341 cri.go:89] found id: ""
I0429 13:49:15.778967 54341 logs.go:276] 2 containers: [7f79624c17430676c296e00e693bab05b33cc379e57f5ef697ba5c7f9d0ed5ad 5aecd138f90559d169394f79f0ad05b606433fa4b4ec072c13e9835835ce17a1]
I0429 13:49:15.779028 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:15.783145 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:15.786551 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0429 13:49:15.786654 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0429 13:49:15.844255 54341 cri.go:89] found id: "86999dfa0ef227089779294515c0edc4aec86591625ce9468a70dd842c85c6a5"
I0429 13:49:15.844279 54341 cri.go:89] found id: "318cce7a1b0f2a614f1194bbaa431bfa0f983bbdae38b64ee888c61540c28705"
I0429 13:49:15.844284 54341 cri.go:89] found id: ""
I0429 13:49:15.844292 54341 logs.go:276] 2 containers: [86999dfa0ef227089779294515c0edc4aec86591625ce9468a70dd842c85c6a5 318cce7a1b0f2a614f1194bbaa431bfa0f983bbdae38b64ee888c61540c28705]
I0429 13:49:15.844356 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:15.848606 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:15.852462 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0429 13:49:15.852535 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0429 13:49:15.894857 54341 cri.go:89] found id: "8f08fd37b9722a4c5ef5f7c31b777ddca73efdfeb2aec27755ada5cbaa29b62a"
I0429 13:49:15.894879 54341 cri.go:89] found id: "3c7c4fb800f0fb3702325ff5f5658941d615bbeb528e0ace8320ca9d937313fb"
I0429 13:49:15.894884 54341 cri.go:89] found id: ""
I0429 13:49:15.894891 54341 logs.go:276] 2 containers: [8f08fd37b9722a4c5ef5f7c31b777ddca73efdfeb2aec27755ada5cbaa29b62a 3c7c4fb800f0fb3702325ff5f5658941d615bbeb528e0ace8320ca9d937313fb]
I0429 13:49:15.894950 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:15.898577 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:15.902139 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0429 13:49:15.902210 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0429 13:49:15.948676 54341 cri.go:89] found id: "f539a90d1219ba425a0de60d8caa1c954296acf845937d023b88c0290e16d535"
I0429 13:49:15.948704 54341 cri.go:89] found id: ""
I0429 13:49:15.948713 54341 logs.go:276] 1 containers: [f539a90d1219ba425a0de60d8caa1c954296acf845937d023b88c0290e16d535]
I0429 13:49:15.948791 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:15.952633 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0429 13:49:15.952707 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0429 13:49:15.992261 54341 cri.go:89] found id: "3c8484524133f407ce59c822b3a864e3cba1cb23839ec61ec98469adb9983061"
I0429 13:49:15.992322 54341 cri.go:89] found id: "7fcc36d1b0b23c2f9801279de66c54bed59e84aecd7a965c1122648a7fc645b4"
I0429 13:49:15.992342 54341 cri.go:89] found id: ""
I0429 13:49:15.992364 54341 logs.go:276] 2 containers: [3c8484524133f407ce59c822b3a864e3cba1cb23839ec61ec98469adb9983061 7fcc36d1b0b23c2f9801279de66c54bed59e84aecd7a965c1122648a7fc645b4]
I0429 13:49:15.992436 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:15.996197 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:16.000667 54341 logs.go:123] Gathering logs for dmesg ...
I0429 13:49:16.000750 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0429 13:49:16.023701 54341 logs.go:123] Gathering logs for kube-scheduler [773300bb56a3cf480debfc1708df63d242912d955ed2878e344f290b3e135636] ...
I0429 13:49:16.023731 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 773300bb56a3cf480debfc1708df63d242912d955ed2878e344f290b3e135636"
I0429 13:49:16.078189 54341 logs.go:123] Gathering logs for kindnet [3c7c4fb800f0fb3702325ff5f5658941d615bbeb528e0ace8320ca9d937313fb] ...
I0429 13:49:16.078226 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3c7c4fb800f0fb3702325ff5f5658941d615bbeb528e0ace8320ca9d937313fb"
I0429 13:49:16.123326 54341 logs.go:123] Gathering logs for containerd ...
I0429 13:49:16.123402 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0429 13:49:16.186960 54341 logs.go:123] Gathering logs for describe nodes ...
I0429 13:49:16.186997 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0429 13:49:16.324038 54341 logs.go:123] Gathering logs for coredns [321ab2f02311cecc28b896edfd2de37f27acf6ce79a835ee232206f0e1cad599] ...
I0429 13:49:16.324070 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 321ab2f02311cecc28b896edfd2de37f27acf6ce79a835ee232206f0e1cad599"
I0429 13:49:16.374229 54341 logs.go:123] Gathering logs for coredns [9424f2b14afbbf14dc6034f77898c6d50797b2d72c6bfc7e4f2abbf792b13510] ...
I0429 13:49:16.374258 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9424f2b14afbbf14dc6034f77898c6d50797b2d72c6bfc7e4f2abbf792b13510"
I0429 13:49:16.417805 54341 logs.go:123] Gathering logs for kube-scheduler [1164addf1687d43551d62d9585fae665f50f87b59df3ac3cdaca0f332ea6fa38] ...
I0429 13:49:16.417844 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1164addf1687d43551d62d9585fae665f50f87b59df3ac3cdaca0f332ea6fa38"
I0429 13:49:16.457590 54341 logs.go:123] Gathering logs for kube-proxy [5aecd138f90559d169394f79f0ad05b606433fa4b4ec072c13e9835835ce17a1] ...
I0429 13:49:16.457617 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5aecd138f90559d169394f79f0ad05b606433fa4b4ec072c13e9835835ce17a1"
I0429 13:49:16.501973 54341 logs.go:123] Gathering logs for kube-controller-manager [86999dfa0ef227089779294515c0edc4aec86591625ce9468a70dd842c85c6a5] ...
I0429 13:49:16.502002 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 86999dfa0ef227089779294515c0edc4aec86591625ce9468a70dd842c85c6a5"
I0429 13:49:16.590386 54341 logs.go:123] Gathering logs for kubernetes-dashboard [f539a90d1219ba425a0de60d8caa1c954296acf845937d023b88c0290e16d535] ...
I0429 13:49:16.590418 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f539a90d1219ba425a0de60d8caa1c954296acf845937d023b88c0290e16d535"
I0429 13:49:16.639553 54341 logs.go:123] Gathering logs for storage-provisioner [3c8484524133f407ce59c822b3a864e3cba1cb23839ec61ec98469adb9983061] ...
I0429 13:49:16.639637 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3c8484524133f407ce59c822b3a864e3cba1cb23839ec61ec98469adb9983061"
I0429 13:49:16.684755 54341 logs.go:123] Gathering logs for kubelet ...
I0429 13:49:16.684785 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0429 13:49:16.760349 54341 logs.go:123] Gathering logs for kube-apiserver [8479fc16ba8a689c95a90d6010d6cd7e41e3ef515bbf558657fcbcb4ce4fad8d] ...
I0429 13:49:16.760388 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8479fc16ba8a689c95a90d6010d6cd7e41e3ef515bbf558657fcbcb4ce4fad8d"
I0429 13:49:16.831053 54341 logs.go:123] Gathering logs for etcd [337dae6815a9bc77d4d0cda01280f06fcdd445b632c003e045a5effec947091b] ...
I0429 13:49:16.831089 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 337dae6815a9bc77d4d0cda01280f06fcdd445b632c003e045a5effec947091b"
I0429 13:49:16.879605 54341 logs.go:123] Gathering logs for kube-controller-manager [318cce7a1b0f2a614f1194bbaa431bfa0f983bbdae38b64ee888c61540c28705] ...
I0429 13:49:16.879682 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 318cce7a1b0f2a614f1194bbaa431bfa0f983bbdae38b64ee888c61540c28705"
I0429 13:49:16.948203 54341 logs.go:123] Gathering logs for kindnet [8f08fd37b9722a4c5ef5f7c31b777ddca73efdfeb2aec27755ada5cbaa29b62a] ...
I0429 13:49:16.948237 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8f08fd37b9722a4c5ef5f7c31b777ddca73efdfeb2aec27755ada5cbaa29b62a"
I0429 13:49:16.995478 54341 logs.go:123] Gathering logs for storage-provisioner [7fcc36d1b0b23c2f9801279de66c54bed59e84aecd7a965c1122648a7fc645b4] ...
I0429 13:49:16.995510 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7fcc36d1b0b23c2f9801279de66c54bed59e84aecd7a965c1122648a7fc645b4"
I0429 13:49:17.048214 54341 logs.go:123] Gathering logs for kube-apiserver [a9b1916ffd4c752a8cd852e671dc2b6bf80541cab530ee8ebac5a1f9096220cd] ...
I0429 13:49:17.048243 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a9b1916ffd4c752a8cd852e671dc2b6bf80541cab530ee8ebac5a1f9096220cd"
I0429 13:49:17.109900 54341 logs.go:123] Gathering logs for etcd [c619a84cd4b5d52dea394eb9e55793deaf5c84af0ff41cd181f3ec294aa6898e] ...
I0429 13:49:17.109932 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c619a84cd4b5d52dea394eb9e55793deaf5c84af0ff41cd181f3ec294aa6898e"
I0429 13:49:17.162236 54341 logs.go:123] Gathering logs for kube-proxy [7f79624c17430676c296e00e693bab05b33cc379e57f5ef697ba5c7f9d0ed5ad] ...
I0429 13:49:17.162265 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7f79624c17430676c296e00e693bab05b33cc379e57f5ef697ba5c7f9d0ed5ad"
I0429 13:49:17.203708 54341 logs.go:123] Gathering logs for container status ...
I0429 13:49:17.203738 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0429 13:49:19.059776 46889 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0429 13:49:19.072176 46889 api_server.go:72] duration metric: took 5m57.123959415s to wait for apiserver process to appear ...
I0429 13:49:19.072201 46889 api_server.go:88] waiting for apiserver healthz status ...
I0429 13:49:19.072237 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0429 13:49:19.072304 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0429 13:49:19.117329 46889 cri.go:89] found id: "6f49514fe6938949387be25147dcb0463b2b9ae15ee83e14cae5c70460c06a68"
I0429 13:49:19.117352 46889 cri.go:89] found id: "92695848292c9dcf5fb37f9b7432bba3fafa7483ced7559a57ab1206427c21f3"
I0429 13:49:19.117358 46889 cri.go:89] found id: ""
I0429 13:49:19.117365 46889 logs.go:276] 2 containers: [6f49514fe6938949387be25147dcb0463b2b9ae15ee83e14cae5c70460c06a68 92695848292c9dcf5fb37f9b7432bba3fafa7483ced7559a57ab1206427c21f3]
I0429 13:49:19.117426 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.121265 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.125007 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0429 13:49:19.125084 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0429 13:49:19.765870 54341 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0429 13:49:19.775728 54341 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0429 13:49:19.776903 54341 api_server.go:141] control plane version: v1.30.0
I0429 13:49:19.776925 54341 api_server.go:131] duration metric: took 4.25540477s to wait for apiserver health ...
I0429 13:49:19.776933 54341 system_pods.go:43] waiting for kube-system pods to appear ...
I0429 13:49:19.776960 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0429 13:49:19.777020 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0429 13:49:19.830398 54341 cri.go:89] found id: "a9b1916ffd4c752a8cd852e671dc2b6bf80541cab530ee8ebac5a1f9096220cd"
I0429 13:49:19.830418 54341 cri.go:89] found id: "8479fc16ba8a689c95a90d6010d6cd7e41e3ef515bbf558657fcbcb4ce4fad8d"
I0429 13:49:19.830423 54341 cri.go:89] found id: ""
I0429 13:49:19.830431 54341 logs.go:276] 2 containers: [a9b1916ffd4c752a8cd852e671dc2b6bf80541cab530ee8ebac5a1f9096220cd 8479fc16ba8a689c95a90d6010d6cd7e41e3ef515bbf558657fcbcb4ce4fad8d]
I0429 13:49:19.830491 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.834556 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.838209 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0429 13:49:19.838284 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0429 13:49:19.888096 54341 cri.go:89] found id: "c619a84cd4b5d52dea394eb9e55793deaf5c84af0ff41cd181f3ec294aa6898e"
I0429 13:49:19.888116 54341 cri.go:89] found id: "337dae6815a9bc77d4d0cda01280f06fcdd445b632c003e045a5effec947091b"
I0429 13:49:19.888120 54341 cri.go:89] found id: ""
I0429 13:49:19.888128 54341 logs.go:276] 2 containers: [c619a84cd4b5d52dea394eb9e55793deaf5c84af0ff41cd181f3ec294aa6898e 337dae6815a9bc77d4d0cda01280f06fcdd445b632c003e045a5effec947091b]
I0429 13:49:19.888186 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.896102 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.900581 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0429 13:49:19.900656 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0429 13:49:19.968520 54341 cri.go:89] found id: "321ab2f02311cecc28b896edfd2de37f27acf6ce79a835ee232206f0e1cad599"
I0429 13:49:19.968584 54341 cri.go:89] found id: "9424f2b14afbbf14dc6034f77898c6d50797b2d72c6bfc7e4f2abbf792b13510"
I0429 13:49:19.968596 54341 cri.go:89] found id: ""
I0429 13:49:19.968605 54341 logs.go:276] 2 containers: [321ab2f02311cecc28b896edfd2de37f27acf6ce79a835ee232206f0e1cad599 9424f2b14afbbf14dc6034f77898c6d50797b2d72c6bfc7e4f2abbf792b13510]
I0429 13:49:19.968666 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.973317 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.977429 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0429 13:49:19.977502 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0429 13:49:20.072045 54341 cri.go:89] found id: "1164addf1687d43551d62d9585fae665f50f87b59df3ac3cdaca0f332ea6fa38"
I0429 13:49:20.072072 54341 cri.go:89] found id: "773300bb56a3cf480debfc1708df63d242912d955ed2878e344f290b3e135636"
I0429 13:49:20.072078 54341 cri.go:89] found id: ""
I0429 13:49:20.072086 54341 logs.go:276] 2 containers: [1164addf1687d43551d62d9585fae665f50f87b59df3ac3cdaca0f332ea6fa38 773300bb56a3cf480debfc1708df63d242912d955ed2878e344f290b3e135636]
I0429 13:49:20.072149 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:20.076572 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:20.081631 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0429 13:49:20.081715 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0429 13:49:20.154317 54341 cri.go:89] found id: "7f79624c17430676c296e00e693bab05b33cc379e57f5ef697ba5c7f9d0ed5ad"
I0429 13:49:20.154343 54341 cri.go:89] found id: "5aecd138f90559d169394f79f0ad05b606433fa4b4ec072c13e9835835ce17a1"
I0429 13:49:20.154348 54341 cri.go:89] found id: ""
I0429 13:49:20.154355 54341 logs.go:276] 2 containers: [7f79624c17430676c296e00e693bab05b33cc379e57f5ef697ba5c7f9d0ed5ad 5aecd138f90559d169394f79f0ad05b606433fa4b4ec072c13e9835835ce17a1]
I0429 13:49:20.154412 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:20.158951 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:20.163433 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0429 13:49:20.163515 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0429 13:49:20.225663 54341 cri.go:89] found id: "86999dfa0ef227089779294515c0edc4aec86591625ce9468a70dd842c85c6a5"
I0429 13:49:20.225688 54341 cri.go:89] found id: "318cce7a1b0f2a614f1194bbaa431bfa0f983bbdae38b64ee888c61540c28705"
I0429 13:49:20.225693 54341 cri.go:89] found id: ""
I0429 13:49:20.225700 54341 logs.go:276] 2 containers: [86999dfa0ef227089779294515c0edc4aec86591625ce9468a70dd842c85c6a5 318cce7a1b0f2a614f1194bbaa431bfa0f983bbdae38b64ee888c61540c28705]
I0429 13:49:20.225758 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:20.230541 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:20.234335 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0429 13:49:20.234413 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0429 13:49:20.281886 54341 cri.go:89] found id: "8f08fd37b9722a4c5ef5f7c31b777ddca73efdfeb2aec27755ada5cbaa29b62a"
I0429 13:49:20.281910 54341 cri.go:89] found id: "3c7c4fb800f0fb3702325ff5f5658941d615bbeb528e0ace8320ca9d937313fb"
I0429 13:49:20.281915 54341 cri.go:89] found id: ""
I0429 13:49:20.281923 54341 logs.go:276] 2 containers: [8f08fd37b9722a4c5ef5f7c31b777ddca73efdfeb2aec27755ada5cbaa29b62a 3c7c4fb800f0fb3702325ff5f5658941d615bbeb528e0ace8320ca9d937313fb]
I0429 13:49:20.281979 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:20.285919 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:20.290030 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0429 13:49:20.290134 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0429 13:49:20.360460 54341 cri.go:89] found id: "f539a90d1219ba425a0de60d8caa1c954296acf845937d023b88c0290e16d535"
I0429 13:49:20.360486 54341 cri.go:89] found id: ""
I0429 13:49:20.360494 54341 logs.go:276] 1 containers: [f539a90d1219ba425a0de60d8caa1c954296acf845937d023b88c0290e16d535]
I0429 13:49:20.360556 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:20.365305 54341 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0429 13:49:20.365383 54341 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0429 13:49:20.424151 54341 cri.go:89] found id: "3c8484524133f407ce59c822b3a864e3cba1cb23839ec61ec98469adb9983061"
I0429 13:49:20.424177 54341 cri.go:89] found id: "7fcc36d1b0b23c2f9801279de66c54bed59e84aecd7a965c1122648a7fc645b4"
I0429 13:49:20.424184 54341 cri.go:89] found id: ""
I0429 13:49:20.424192 54341 logs.go:276] 2 containers: [3c8484524133f407ce59c822b3a864e3cba1cb23839ec61ec98469adb9983061 7fcc36d1b0b23c2f9801279de66c54bed59e84aecd7a965c1122648a7fc645b4]
I0429 13:49:20.424250 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:20.428442 54341 ssh_runner.go:195] Run: which crictl
I0429 13:49:20.432843 54341 logs.go:123] Gathering logs for kube-apiserver [8479fc16ba8a689c95a90d6010d6cd7e41e3ef515bbf558657fcbcb4ce4fad8d] ...
I0429 13:49:20.432873 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8479fc16ba8a689c95a90d6010d6cd7e41e3ef515bbf558657fcbcb4ce4fad8d"
I0429 13:49:20.517887 54341 logs.go:123] Gathering logs for coredns [321ab2f02311cecc28b896edfd2de37f27acf6ce79a835ee232206f0e1cad599] ...
I0429 13:49:20.517918 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 321ab2f02311cecc28b896edfd2de37f27acf6ce79a835ee232206f0e1cad599"
I0429 13:49:20.572745 54341 logs.go:123] Gathering logs for coredns [9424f2b14afbbf14dc6034f77898c6d50797b2d72c6bfc7e4f2abbf792b13510] ...
I0429 13:49:20.572778 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9424f2b14afbbf14dc6034f77898c6d50797b2d72c6bfc7e4f2abbf792b13510"
I0429 13:49:20.629914 54341 logs.go:123] Gathering logs for kube-scheduler [773300bb56a3cf480debfc1708df63d242912d955ed2878e344f290b3e135636] ...
I0429 13:49:20.629945 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 773300bb56a3cf480debfc1708df63d242912d955ed2878e344f290b3e135636"
I0429 13:49:20.701516 54341 logs.go:123] Gathering logs for describe nodes ...
I0429 13:49:20.701675 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0429 13:49:20.864724 54341 logs.go:123] Gathering logs for dmesg ...
I0429 13:49:20.864766 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0429 13:49:20.888560 54341 logs.go:123] Gathering logs for kube-apiserver [a9b1916ffd4c752a8cd852e671dc2b6bf80541cab530ee8ebac5a1f9096220cd] ...
I0429 13:49:20.888593 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a9b1916ffd4c752a8cd852e671dc2b6bf80541cab530ee8ebac5a1f9096220cd"
I0429 13:49:20.957057 54341 logs.go:123] Gathering logs for etcd [c619a84cd4b5d52dea394eb9e55793deaf5c84af0ff41cd181f3ec294aa6898e] ...
I0429 13:49:20.957095 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c619a84cd4b5d52dea394eb9e55793deaf5c84af0ff41cd181f3ec294aa6898e"
I0429 13:49:21.025900 54341 logs.go:123] Gathering logs for etcd [337dae6815a9bc77d4d0cda01280f06fcdd445b632c003e045a5effec947091b] ...
I0429 13:49:21.025937 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 337dae6815a9bc77d4d0cda01280f06fcdd445b632c003e045a5effec947091b"
I0429 13:49:21.116484 54341 logs.go:123] Gathering logs for storage-provisioner [7fcc36d1b0b23c2f9801279de66c54bed59e84aecd7a965c1122648a7fc645b4] ...
I0429 13:49:21.116541 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7fcc36d1b0b23c2f9801279de66c54bed59e84aecd7a965c1122648a7fc645b4"
I0429 13:49:21.172324 54341 logs.go:123] Gathering logs for kubelet ...
I0429 13:49:21.172358 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0429 13:49:21.275200 54341 logs.go:123] Gathering logs for kube-controller-manager [86999dfa0ef227089779294515c0edc4aec86591625ce9468a70dd842c85c6a5] ...
I0429 13:49:21.275238 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 86999dfa0ef227089779294515c0edc4aec86591625ce9468a70dd842c85c6a5"
I0429 13:49:21.340653 54341 logs.go:123] Gathering logs for kindnet [3c7c4fb800f0fb3702325ff5f5658941d615bbeb528e0ace8320ca9d937313fb] ...
I0429 13:49:21.340701 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3c7c4fb800f0fb3702325ff5f5658941d615bbeb528e0ace8320ca9d937313fb"
I0429 13:49:21.399226 54341 logs.go:123] Gathering logs for kube-proxy [7f79624c17430676c296e00e693bab05b33cc379e57f5ef697ba5c7f9d0ed5ad] ...
I0429 13:49:21.399265 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7f79624c17430676c296e00e693bab05b33cc379e57f5ef697ba5c7f9d0ed5ad"
I0429 13:49:21.449527 54341 logs.go:123] Gathering logs for kube-proxy [5aecd138f90559d169394f79f0ad05b606433fa4b4ec072c13e9835835ce17a1] ...
I0429 13:49:21.449554 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5aecd138f90559d169394f79f0ad05b606433fa4b4ec072c13e9835835ce17a1"
I0429 13:49:21.490065 54341 logs.go:123] Gathering logs for kube-controller-manager [318cce7a1b0f2a614f1194bbaa431bfa0f983bbdae38b64ee888c61540c28705] ...
I0429 13:49:21.490092 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 318cce7a1b0f2a614f1194bbaa431bfa0f983bbdae38b64ee888c61540c28705"
I0429 13:49:21.555445 54341 logs.go:123] Gathering logs for kindnet [8f08fd37b9722a4c5ef5f7c31b777ddca73efdfeb2aec27755ada5cbaa29b62a] ...
I0429 13:49:21.555484 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8f08fd37b9722a4c5ef5f7c31b777ddca73efdfeb2aec27755ada5cbaa29b62a"
I0429 13:49:21.599535 54341 logs.go:123] Gathering logs for kubernetes-dashboard [f539a90d1219ba425a0de60d8caa1c954296acf845937d023b88c0290e16d535] ...
I0429 13:49:21.599566 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f539a90d1219ba425a0de60d8caa1c954296acf845937d023b88c0290e16d535"
I0429 13:49:21.655979 54341 logs.go:123] Gathering logs for storage-provisioner [3c8484524133f407ce59c822b3a864e3cba1cb23839ec61ec98469adb9983061] ...
I0429 13:49:21.656008 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3c8484524133f407ce59c822b3a864e3cba1cb23839ec61ec98469adb9983061"
I0429 13:49:21.700239 54341 logs.go:123] Gathering logs for containerd ...
I0429 13:49:21.700268 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0429 13:49:21.765902 54341 logs.go:123] Gathering logs for container status ...
I0429 13:49:21.765939 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0429 13:49:21.814310 54341 logs.go:123] Gathering logs for kube-scheduler [1164addf1687d43551d62d9585fae665f50f87b59df3ac3cdaca0f332ea6fa38] ...
I0429 13:49:21.814345 54341 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1164addf1687d43551d62d9585fae665f50f87b59df3ac3cdaca0f332ea6fa38"
I0429 13:49:19.164316 46889 cri.go:89] found id: "d822d5375019aa8b6fdae088edca5093130b82835432dd2833a71ae56c9a1753"
I0429 13:49:19.164338 46889 cri.go:89] found id: "487a468a367155648e2599415872a829294e36e2f52064e34362ae63b9dc2b51"
I0429 13:49:19.164343 46889 cri.go:89] found id: ""
I0429 13:49:19.164350 46889 logs.go:276] 2 containers: [d822d5375019aa8b6fdae088edca5093130b82835432dd2833a71ae56c9a1753 487a468a367155648e2599415872a829294e36e2f52064e34362ae63b9dc2b51]
I0429 13:49:19.164409 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.168251 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.171813 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0429 13:49:19.171889 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0429 13:49:19.215794 46889 cri.go:89] found id: "99aafd29fea02a0255847f0185b6468d29d23dead19e79879c006c7b1030f5b5"
I0429 13:49:19.215819 46889 cri.go:89] found id: "ceace251a3f285f11b13a433c49367b13d702752ff40ae66e2e8b3ac72bf71b2"
I0429 13:49:19.215825 46889 cri.go:89] found id: ""
I0429 13:49:19.215832 46889 logs.go:276] 2 containers: [99aafd29fea02a0255847f0185b6468d29d23dead19e79879c006c7b1030f5b5 ceace251a3f285f11b13a433c49367b13d702752ff40ae66e2e8b3ac72bf71b2]
I0429 13:49:19.215902 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.220344 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.223935 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0429 13:49:19.224020 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0429 13:49:19.273990 46889 cri.go:89] found id: "4b9d2030c82b4b99a0f1aa9c220a7d550fa28b6799c689551c3e01a257cf14fe"
I0429 13:49:19.274019 46889 cri.go:89] found id: "676b344d21c39a7b716ddccc155a37537ba17d9d55bded00344944a3b5251ae1"
I0429 13:49:19.274024 46889 cri.go:89] found id: ""
I0429 13:49:19.274032 46889 logs.go:276] 2 containers: [4b9d2030c82b4b99a0f1aa9c220a7d550fa28b6799c689551c3e01a257cf14fe 676b344d21c39a7b716ddccc155a37537ba17d9d55bded00344944a3b5251ae1]
I0429 13:49:19.274091 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.278053 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.281807 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0429 13:49:19.281889 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0429 13:49:19.321020 46889 cri.go:89] found id: "ac0d7e8ff20e394f5786d75b39f6d09a8343e15d46a71c3ba119572cf16daac8"
I0429 13:49:19.321091 46889 cri.go:89] found id: "afe201cf19cd54f9626556f9fb2af59a62b57b2fc3870087ea49951763023e6a"
I0429 13:49:19.321109 46889 cri.go:89] found id: ""
I0429 13:49:19.321132 46889 logs.go:276] 2 containers: [ac0d7e8ff20e394f5786d75b39f6d09a8343e15d46a71c3ba119572cf16daac8 afe201cf19cd54f9626556f9fb2af59a62b57b2fc3870087ea49951763023e6a]
I0429 13:49:19.321198 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.324913 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.328754 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0429 13:49:19.328862 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0429 13:49:19.375633 46889 cri.go:89] found id: "46b329f549c16117b457f7dc74e36a56f69621b977c14a4225023ad5189c1e6f"
I0429 13:49:19.375656 46889 cri.go:89] found id: "eebb19d675cf51320fc9b8f9626a50880eba8fff7e0cae674a7b0477d516f3c9"
I0429 13:49:19.375662 46889 cri.go:89] found id: ""
I0429 13:49:19.375670 46889 logs.go:276] 2 containers: [46b329f549c16117b457f7dc74e36a56f69621b977c14a4225023ad5189c1e6f eebb19d675cf51320fc9b8f9626a50880eba8fff7e0cae674a7b0477d516f3c9]
I0429 13:49:19.375728 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.379800 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.383818 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0429 13:49:19.383891 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0429 13:49:19.425795 46889 cri.go:89] found id: "b9ff1e04cc2c14075223ed4143af7eab578112a95cd911df71fd61fe781efe9d"
I0429 13:49:19.425817 46889 cri.go:89] found id: "2d56c26090f29460a7f6de0be95e5742db6f734116e1e0b8060dba86b11a18c5"
I0429 13:49:19.425822 46889 cri.go:89] found id: ""
I0429 13:49:19.425830 46889 logs.go:276] 2 containers: [b9ff1e04cc2c14075223ed4143af7eab578112a95cd911df71fd61fe781efe9d 2d56c26090f29460a7f6de0be95e5742db6f734116e1e0b8060dba86b11a18c5]
I0429 13:49:19.425906 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.429984 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.433830 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0429 13:49:19.433926 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0429 13:49:19.480409 46889 cri.go:89] found id: "b8faf4156978f8c5ec933471c71bdc73a0b442e4b837e3bdabab95ad9cf09146"
I0429 13:49:19.480430 46889 cri.go:89] found id: "9eb815c958691521a891ce6a646a8fe229c3c32994b0bd94e3911286c5e1a6d4"
I0429 13:49:19.480435 46889 cri.go:89] found id: ""
I0429 13:49:19.480442 46889 logs.go:276] 2 containers: [b8faf4156978f8c5ec933471c71bdc73a0b442e4b837e3bdabab95ad9cf09146 9eb815c958691521a891ce6a646a8fe229c3c32994b0bd94e3911286c5e1a6d4]
I0429 13:49:19.480520 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.484761 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.488349 46889 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0429 13:49:19.488471 46889 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0429 13:49:19.529429 46889 cri.go:89] found id: "1171f7bf9e312d4e83e31789284ded3b56c8733f0f86756b847094cf17e199fc"
I0429 13:49:19.529450 46889 cri.go:89] found id: ""
I0429 13:49:19.529458 46889 logs.go:276] 1 containers: [1171f7bf9e312d4e83e31789284ded3b56c8733f0f86756b847094cf17e199fc]
I0429 13:49:19.529517 46889 ssh_runner.go:195] Run: which crictl
I0429 13:49:19.533222 46889 logs.go:123] Gathering logs for kubelet ...
I0429 13:49:19.533311 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0429 13:49:19.586870 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857623 659 reflector.go:138] object-"default"/"default-token-nlkvk": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-nlkvk" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:19.587142 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857721 659 reflector.go:138] object-"kube-system"/"kube-proxy-token-6ww95": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-6ww95" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:19.587364 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857791 659 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:19.587584 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857856 659 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:19.587813 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857908 659 reflector.go:138] object-"kube-system"/"storage-provisioner-token-d45m7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-d45m7" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:19.588029 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.857965 659 reflector.go:138] object-"kube-system"/"kindnet-token-kb54z": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-kb54z" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:19.588253 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.858021 659 reflector.go:138] object-"kube-system"/"coredns-token-8fhcc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-8fhcc" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:19.588486 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:41 old-k8s-version-637516 kubelet[659]: E0429 13:43:41.858109 659 reflector.go:138] object-"kube-system"/"metrics-server-token-5dph5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-5dph5" is forbidden: User "system:node:old-k8s-version-637516" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-637516' and this object
W0429 13:49:19.597319 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:43 old-k8s-version-637516 kubelet[659]: E0429 13:43:43.774651 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0429 13:49:19.597758 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:44 old-k8s-version-637516 kubelet[659]: E0429 13:43:44.097901 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.604496 46889 logs.go:138] Found kubelet problem: Apr 29 13:43:55 old-k8s-version-637516 kubelet[659]: E0429 13:43:55.958973 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0429 13:49:19.606484 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:09 old-k8s-version-637516 kubelet[659]: E0429 13:44:09.944369 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.607960 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:14 old-k8s-version-637516 kubelet[659]: E0429 13:44:14.326723 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.608597 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:15 old-k8s-version-637516 kubelet[659]: E0429 13:44:15.330554 659 pod_workers.go:191] Error syncing pod 768c1e4c-85ee-4968-9c8c-df33fac74bf3 ("storage-provisioner_kube-system(768c1e4c-85ee-4968-9c8c-df33fac74bf3)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(768c1e4c-85ee-4968-9c8c-df33fac74bf3)"
W0429 13:49:19.608943 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:15 old-k8s-version-637516 kubelet[659]: E0429 13:44:15.349369 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.609303 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:16 old-k8s-version-637516 kubelet[659]: E0429 13:44:16.353332 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.612778 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:24 old-k8s-version-637516 kubelet[659]: E0429 13:44:24.940536 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0429 13:49:19.614099 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:28 old-k8s-version-637516 kubelet[659]: E0429 13:44:28.387652 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.614892 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:35 old-k8s-version-637516 kubelet[659]: E0429 13:44:35.903409 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.615112 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:36 old-k8s-version-637516 kubelet[659]: E0429 13:44:36.931263 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.615471 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:46 old-k8s-version-637516 kubelet[659]: E0429 13:44:46.931347 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.615689 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:48 old-k8s-version-637516 kubelet[659]: E0429 13:44:48.931189 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.616348 46889 logs.go:138] Found kubelet problem: Apr 29 13:44:59 old-k8s-version-637516 kubelet[659]: E0429 13:44:59.455798 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.616547 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:00 old-k8s-version-637516 kubelet[659]: E0429 13:45:00.931323 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.616912 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:05 old-k8s-version-637516 kubelet[659]: E0429 13:45:05.903931 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.619862 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:13 old-k8s-version-637516 kubelet[659]: E0429 13:45:13.944072 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0429 13:49:19.620206 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:16 old-k8s-version-637516 kubelet[659]: E0429 13:45:16.930872 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.620412 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:25 old-k8s-version-637516 kubelet[659]: E0429 13:45:25.931864 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.620770 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:27 old-k8s-version-637516 kubelet[659]: E0429 13:45:27.931269 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.621114 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:39 old-k8s-version-637516 kubelet[659]: E0429 13:45:39.933057 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.621625 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:40 old-k8s-version-637516 kubelet[659]: E0429 13:45:40.548936 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.622053 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:45 old-k8s-version-637516 kubelet[659]: E0429 13:45:45.903448 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.622246 46889 logs.go:138] Found kubelet problem: Apr 29 13:45:51 old-k8s-version-637516 kubelet[659]: E0429 13:45:51.935180 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.622615 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:00 old-k8s-version-637516 kubelet[659]: E0429 13:46:00.931055 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.622857 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:04 old-k8s-version-637516 kubelet[659]: E0429 13:46:04.931269 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.623248 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:11 old-k8s-version-637516 kubelet[659]: E0429 13:46:11.931371 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.623454 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:15 old-k8s-version-637516 kubelet[659]: E0429 13:46:15.931701 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.623817 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:26 old-k8s-version-637516 kubelet[659]: E0429 13:46:26.931099 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.624015 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:29 old-k8s-version-637516 kubelet[659]: E0429 13:46:29.932102 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.624384 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:39 old-k8s-version-637516 kubelet[659]: E0429 13:46:39.931852 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.627390 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:44 old-k8s-version-637516 kubelet[659]: E0429 13:46:44.939309 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0429 13:49:19.627857 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:52 old-k8s-version-637516 kubelet[659]: E0429 13:46:52.930774 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.628212 46889 logs.go:138] Found kubelet problem: Apr 29 13:46:56 old-k8s-version-637516 kubelet[659]: E0429 13:46:56.931506 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.628996 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:05 old-k8s-version-637516 kubelet[659]: E0429 13:47:05.770364 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.629367 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:06 old-k8s-version-637516 kubelet[659]: E0429 13:47:06.773003 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.629566 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:08 old-k8s-version-637516 kubelet[659]: E0429 13:47:08.931577 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.629771 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:19 old-k8s-version-637516 kubelet[659]: E0429 13:47:19.935693 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.630107 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:19 old-k8s-version-637516 kubelet[659]: E0429 13:47:19.937549 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.630303 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:31 old-k8s-version-637516 kubelet[659]: E0429 13:47:31.936395 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.630636 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:34 old-k8s-version-637516 kubelet[659]: E0429 13:47:34.930862 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.630852 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:44 old-k8s-version-637516 kubelet[659]: E0429 13:47:44.931375 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.631206 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:47 old-k8s-version-637516 kubelet[659]: E0429 13:47:47.930873 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.631462 46889 logs.go:138] Found kubelet problem: Apr 29 13:47:59 old-k8s-version-637516 kubelet[659]: E0429 13:47:59.931717 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.631973 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:01 old-k8s-version-637516 kubelet[659]: E0429 13:48:01.931616 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.632192 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:10 old-k8s-version-637516 kubelet[659]: E0429 13:48:10.931290 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.632583 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:14 old-k8s-version-637516 kubelet[659]: E0429 13:48:14.931904 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.632782 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:21 old-k8s-version-637516 kubelet[659]: E0429 13:48:21.931833 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.633135 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:27 old-k8s-version-637516 kubelet[659]: E0429 13:48:27.931422 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.633341 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:35 old-k8s-version-637516 kubelet[659]: E0429 13:48:35.931483 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.633749 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:42 old-k8s-version-637516 kubelet[659]: E0429 13:48:42.930864 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.633949 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:48 old-k8s-version-637516 kubelet[659]: E0429 13:48:48.932975 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.634308 46889 logs.go:138] Found kubelet problem: Apr 29 13:48:56 old-k8s-version-637516 kubelet[659]: E0429 13:48:56.930900 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.634509 46889 logs.go:138] Found kubelet problem: Apr 29 13:49:01 old-k8s-version-637516 kubelet[659]: E0429 13:49:01.931193 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.634914 46889 logs.go:138] Found kubelet problem: Apr 29 13:49:07 old-k8s-version-637516 kubelet[659]: E0429 13:49:07.931524 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:19.635125 46889 logs.go:138] Found kubelet problem: Apr 29 13:49:15 old-k8s-version-637516 kubelet[659]: E0429 13:49:15.931441 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:19.635474 46889 logs.go:138] Found kubelet problem: Apr 29 13:49:18 old-k8s-version-637516 kubelet[659]: E0429 13:49:18.930903 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
I0429 13:49:19.635485 46889 logs.go:123] Gathering logs for dmesg ...
I0429 13:49:19.635503 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0429 13:49:19.657344 46889 logs.go:123] Gathering logs for kube-apiserver [6f49514fe6938949387be25147dcb0463b2b9ae15ee83e14cae5c70460c06a68] ...
I0429 13:49:19.657423 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6f49514fe6938949387be25147dcb0463b2b9ae15ee83e14cae5c70460c06a68"
I0429 13:49:19.719004 46889 logs.go:123] Gathering logs for kube-apiserver [92695848292c9dcf5fb37f9b7432bba3fafa7483ced7559a57ab1206427c21f3] ...
I0429 13:49:19.719052 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 92695848292c9dcf5fb37f9b7432bba3fafa7483ced7559a57ab1206427c21f3"
I0429 13:49:19.806575 46889 logs.go:123] Gathering logs for kube-controller-manager [eebb19d675cf51320fc9b8f9626a50880eba8fff7e0cae674a7b0477d516f3c9] ...
I0429 13:49:19.806617 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 eebb19d675cf51320fc9b8f9626a50880eba8fff7e0cae674a7b0477d516f3c9"
I0429 13:49:19.889606 46889 logs.go:123] Gathering logs for kindnet [b9ff1e04cc2c14075223ed4143af7eab578112a95cd911df71fd61fe781efe9d] ...
I0429 13:49:19.889644 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b9ff1e04cc2c14075223ed4143af7eab578112a95cd911df71fd61fe781efe9d"
I0429 13:49:19.967054 46889 logs.go:123] Gathering logs for containerd ...
I0429 13:49:19.967084 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0429 13:49:20.037676 46889 logs.go:123] Gathering logs for etcd [d822d5375019aa8b6fdae088edca5093130b82835432dd2833a71ae56c9a1753] ...
I0429 13:49:20.037715 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d822d5375019aa8b6fdae088edca5093130b82835432dd2833a71ae56c9a1753"
I0429 13:49:20.112367 46889 logs.go:123] Gathering logs for kube-controller-manager [46b329f549c16117b457f7dc74e36a56f69621b977c14a4225023ad5189c1e6f] ...
I0429 13:49:20.112398 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 46b329f549c16117b457f7dc74e36a56f69621b977c14a4225023ad5189c1e6f"
I0429 13:49:20.208661 46889 logs.go:123] Gathering logs for container status ...
I0429 13:49:20.208701 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0429 13:49:20.272829 46889 logs.go:123] Gathering logs for etcd [487a468a367155648e2599415872a829294e36e2f52064e34362ae63b9dc2b51] ...
I0429 13:49:20.272858 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 487a468a367155648e2599415872a829294e36e2f52064e34362ae63b9dc2b51"
I0429 13:49:20.340554 46889 logs.go:123] Gathering logs for coredns [ceace251a3f285f11b13a433c49367b13d702752ff40ae66e2e8b3ac72bf71b2] ...
I0429 13:49:20.340584 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ceace251a3f285f11b13a433c49367b13d702752ff40ae66e2e8b3ac72bf71b2"
I0429 13:49:20.400540 46889 logs.go:123] Gathering logs for kube-scheduler [4b9d2030c82b4b99a0f1aa9c220a7d550fa28b6799c689551c3e01a257cf14fe] ...
I0429 13:49:20.400570 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4b9d2030c82b4b99a0f1aa9c220a7d550fa28b6799c689551c3e01a257cf14fe"
I0429 13:49:20.467457 46889 logs.go:123] Gathering logs for kube-proxy [ac0d7e8ff20e394f5786d75b39f6d09a8343e15d46a71c3ba119572cf16daac8] ...
I0429 13:49:20.467487 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ac0d7e8ff20e394f5786d75b39f6d09a8343e15d46a71c3ba119572cf16daac8"
I0429 13:49:20.533617 46889 logs.go:123] Gathering logs for kindnet [2d56c26090f29460a7f6de0be95e5742db6f734116e1e0b8060dba86b11a18c5] ...
I0429 13:49:20.533645 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2d56c26090f29460a7f6de0be95e5742db6f734116e1e0b8060dba86b11a18c5"
I0429 13:49:20.589267 46889 logs.go:123] Gathering logs for storage-provisioner [9eb815c958691521a891ce6a646a8fe229c3c32994b0bd94e3911286c5e1a6d4] ...
I0429 13:49:20.589292 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9eb815c958691521a891ce6a646a8fe229c3c32994b0bd94e3911286c5e1a6d4"
I0429 13:49:20.652417 46889 logs.go:123] Gathering logs for kubernetes-dashboard [1171f7bf9e312d4e83e31789284ded3b56c8733f0f86756b847094cf17e199fc] ...
I0429 13:49:20.652445 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1171f7bf9e312d4e83e31789284ded3b56c8733f0f86756b847094cf17e199fc"
I0429 13:49:20.711073 46889 logs.go:123] Gathering logs for describe nodes ...
I0429 13:49:20.711109 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0429 13:49:20.907160 46889 logs.go:123] Gathering logs for coredns [99aafd29fea02a0255847f0185b6468d29d23dead19e79879c006c7b1030f5b5] ...
I0429 13:49:20.907190 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 99aafd29fea02a0255847f0185b6468d29d23dead19e79879c006c7b1030f5b5"
I0429 13:49:20.969335 46889 logs.go:123] Gathering logs for kube-scheduler [676b344d21c39a7b716ddccc155a37537ba17d9d55bded00344944a3b5251ae1] ...
I0429 13:49:20.969363 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 676b344d21c39a7b716ddccc155a37537ba17d9d55bded00344944a3b5251ae1"
I0429 13:49:21.049073 46889 logs.go:123] Gathering logs for kube-proxy [afe201cf19cd54f9626556f9fb2af59a62b57b2fc3870087ea49951763023e6a] ...
I0429 13:49:21.049105 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 afe201cf19cd54f9626556f9fb2af59a62b57b2fc3870087ea49951763023e6a"
I0429 13:49:21.141297 46889 logs.go:123] Gathering logs for storage-provisioner [b8faf4156978f8c5ec933471c71bdc73a0b442e4b837e3bdabab95ad9cf09146] ...
I0429 13:49:21.141326 46889 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b8faf4156978f8c5ec933471c71bdc73a0b442e4b837e3bdabab95ad9cf09146"
I0429 13:49:21.198979 46889 out.go:304] Setting ErrFile to fd 2...
I0429 13:49:21.199009 46889 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0429 13:49:21.199064 46889 out.go:239] X Problems detected in kubelet:
W0429 13:49:21.199077 46889 out.go:239] Apr 29 13:48:56 old-k8s-version-637516 kubelet[659]: E0429 13:48:56.930900 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:21.199099 46889 out.go:239] Apr 29 13:49:01 old-k8s-version-637516 kubelet[659]: E0429 13:49:01.931193 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:21.199114 46889 out.go:239] Apr 29 13:49:07 old-k8s-version-637516 kubelet[659]: E0429 13:49:07.931524 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
W0429 13:49:21.199121 46889 out.go:239] Apr 29 13:49:15 old-k8s-version-637516 kubelet[659]: E0429 13:49:15.931441 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 13:49:21.199130 46889 out.go:239] Apr 29 13:49:18 old-k8s-version-637516 kubelet[659]: E0429 13:49:18.930903 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
I0429 13:49:21.199137 46889 out.go:304] Setting ErrFile to fd 2...
I0429 13:49:21.199144 46889 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0429 13:49:24.373412 54341 system_pods.go:59] 9 kube-system pods found
I0429 13:49:24.373448 54341 system_pods.go:61] "coredns-7db6d8ff4d-g8jz9" [84c7414b-8c44-47c6-a401-2b54830c79bc] Running
I0429 13:49:24.373455 54341 system_pods.go:61] "etcd-no-preload-452985" [2b82beb7-83ec-45bf-be26-56cf14d1373a] Running
I0429 13:49:24.373459 54341 system_pods.go:61] "kindnet-gmrln" [d30b9fdf-1104-4876-9b02-571a00bb95f3] Running
I0429 13:49:24.373464 54341 system_pods.go:61] "kube-apiserver-no-preload-452985" [d6e8ab85-e914-4d6e-91b6-a4140c7b08b0] Running
I0429 13:49:24.373469 54341 system_pods.go:61] "kube-controller-manager-no-preload-452985" [69cca788-1f5a-447a-aeac-0d459d890c32] Running
I0429 13:49:24.373472 54341 system_pods.go:61] "kube-proxy-68dsj" [f2afeb18-a504-4283-a63e-befe16acaa99] Running
I0429 13:49:24.373476 54341 system_pods.go:61] "kube-scheduler-no-preload-452985" [787656b9-3f14-46e6-abb5-b14f42f38f49] Running
I0429 13:49:24.373483 54341 system_pods.go:61] "metrics-server-569cc877fc-6mt4f" [4bb5a413-4a24-4dec-889a-45c872d6444a] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0429 13:49:24.373494 54341 system_pods.go:61] "storage-provisioner" [37c5ef93-35ee-4a05-99fe-1183c7923211] Running
I0429 13:49:24.373502 54341 system_pods.go:74] duration metric: took 4.596563017s to wait for pod list to return data ...
I0429 13:49:24.373516 54341 default_sa.go:34] waiting for default service account to be created ...
I0429 13:49:24.376445 54341 default_sa.go:45] found service account: "default"
I0429 13:49:24.376471 54341 default_sa.go:55] duration metric: took 2.94882ms for default service account to be created ...
I0429 13:49:24.376481 54341 system_pods.go:116] waiting for k8s-apps to be running ...
I0429 13:49:24.382833 54341 system_pods.go:86] 9 kube-system pods found
I0429 13:49:24.382903 54341 system_pods.go:89] "coredns-7db6d8ff4d-g8jz9" [84c7414b-8c44-47c6-a401-2b54830c79bc] Running
I0429 13:49:24.382918 54341 system_pods.go:89] "etcd-no-preload-452985" [2b82beb7-83ec-45bf-be26-56cf14d1373a] Running
I0429 13:49:24.382924 54341 system_pods.go:89] "kindnet-gmrln" [d30b9fdf-1104-4876-9b02-571a00bb95f3] Running
I0429 13:49:24.382929 54341 system_pods.go:89] "kube-apiserver-no-preload-452985" [d6e8ab85-e914-4d6e-91b6-a4140c7b08b0] Running
I0429 13:49:24.382934 54341 system_pods.go:89] "kube-controller-manager-no-preload-452985" [69cca788-1f5a-447a-aeac-0d459d890c32] Running
I0429 13:49:24.382939 54341 system_pods.go:89] "kube-proxy-68dsj" [f2afeb18-a504-4283-a63e-befe16acaa99] Running
I0429 13:49:24.382943 54341 system_pods.go:89] "kube-scheduler-no-preload-452985" [787656b9-3f14-46e6-abb5-b14f42f38f49] Running
I0429 13:49:24.382950 54341 system_pods.go:89] "metrics-server-569cc877fc-6mt4f" [4bb5a413-4a24-4dec-889a-45c872d6444a] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0429 13:49:24.382955 54341 system_pods.go:89] "storage-provisioner" [37c5ef93-35ee-4a05-99fe-1183c7923211] Running
I0429 13:49:24.382975 54341 system_pods.go:126] duration metric: took 6.487081ms to wait for k8s-apps to be running ...
I0429 13:49:24.382988 54341 system_svc.go:44] waiting for kubelet service to be running ....
I0429 13:49:24.383052 54341 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0429 13:49:24.396003 54341 system_svc.go:56] duration metric: took 13.00653ms WaitForService to wait for kubelet
I0429 13:49:24.396039 54341 kubeadm.go:576] duration metric: took 4m18.960052955s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0429 13:49:24.396060 54341 node_conditions.go:102] verifying NodePressure condition ...
I0429 13:49:24.400369 54341 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0429 13:49:24.400443 54341 node_conditions.go:123] node cpu capacity is 2
I0429 13:49:24.400462 54341 node_conditions.go:105] duration metric: took 4.395936ms to run NodePressure ...
I0429 13:49:24.400477 54341 start.go:240] waiting for startup goroutines ...
I0429 13:49:24.400485 54341 start.go:245] waiting for cluster config update ...
I0429 13:49:24.400497 54341 start.go:254] writing updated cluster config ...
I0429 13:49:24.400815 54341 ssh_runner.go:195] Run: rm -f paused
I0429 13:49:24.464498 54341 start.go:600] kubectl: 1.30.0, cluster: 1.30.0 (minor skew: 0)
I0429 13:49:24.469390 54341 out.go:177] * Done! kubectl is now configured to use "no-preload-452985" cluster and "default" namespace by default
I0429 13:49:31.200585 46889 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0429 13:49:31.217733 46889 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0429 13:49:31.220690 46889 out.go:177]
W0429 13:49:31.223397 46889 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0429 13:49:31.223436 46889 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0429 13:49:31.223460 46889 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0429 13:49:31.223465 46889 out.go:239] *
W0429 13:49:31.224421 46889 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0429 13:49:31.228021 46889 out.go:177]
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
8687ad836da07 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 988745af9097a dashboard-metrics-scraper-8d5bb5db8-j87qc
b8faf4156978f ba04bb24b9575 5 minutes ago Running storage-provisioner 2 8d5a8c91a2d5b storage-provisioner
1171f7bf9e312 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 21ee94f2e6ba6 kubernetes-dashboard-cd95d586-d6zcf
b9ff1e04cc2c1 4740c1948d3fc 5 minutes ago Running kindnet-cni 1 575d3db433156 kindnet-5hv44
99aafd29fea02 db91994f4ee8f 5 minutes ago Running coredns 1 c15ad4793e8f9 coredns-74ff55c5b-lcl72
ac0d7e8ff20e3 25a5233254979 5 minutes ago Running kube-proxy 1 f8081dbabb94b kube-proxy-vqvz9
9eb815c958691 ba04bb24b9575 5 minutes ago Exited storage-provisioner 1 8d5a8c91a2d5b storage-provisioner
833da7db5e578 1611cd07b61d5 5 minutes ago Running busybox 1 1fe8f308ffd62 busybox
46b329f549c16 1df8a2b116bd1 6 minutes ago Running kube-controller-manager 1 a30f12c05ac0f kube-controller-manager-old-k8s-version-637516
6f49514fe6938 2c08bbbc02d3a 6 minutes ago Running kube-apiserver 1 3133df42d58f5 kube-apiserver-old-k8s-version-637516
4b9d2030c82b4 e7605f88f17d6 6 minutes ago Running kube-scheduler 1 e1b7b82033ef3 kube-scheduler-old-k8s-version-637516
d822d5375019a 05b738aa1bc63 6 minutes ago Running etcd 1 619ce1a3b67be etcd-old-k8s-version-637516
f6f92811b04bd 1611cd07b61d5 6 minutes ago Exited busybox 0 e7ac24ae1b84d busybox
ceace251a3f28 db91994f4ee8f 7 minutes ago Exited coredns 0 bdb4a0ee340b5 coredns-74ff55c5b-lcl72
2d56c26090f29 4740c1948d3fc 8 minutes ago Exited kindnet-cni 0 e94f126a3f4e9 kindnet-5hv44
afe201cf19cd5 25a5233254979 8 minutes ago Exited kube-proxy 0 c85437bfc4fff kube-proxy-vqvz9
92695848292c9 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 16ac12a3098ae kube-apiserver-old-k8s-version-637516
eebb19d675cf5 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 6553d256ab528 kube-controller-manager-old-k8s-version-637516
487a468a36715 05b738aa1bc63 8 minutes ago Exited etcd 0 d11f3bd2c29b2 etcd-old-k8s-version-637516
676b344d21c39 e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 6ce53d5fee2b0 kube-scheduler-old-k8s-version-637516
==> containerd <==
Apr 29 13:45:39 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:45:39.959570951Z" level=info msg="CreateContainer within sandbox \"988745af9097aba80dc617b058896763a5869539d090043f29739c2ceda1ed0e\" for &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:4,} returns container id \"bf83cbca6e41dfbf61fb9b474bbaa10dbe617687b173d34dd4016a8425235025\""
Apr 29 13:45:39 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:45:39.960767252Z" level=info msg="StartContainer for \"bf83cbca6e41dfbf61fb9b474bbaa10dbe617687b173d34dd4016a8425235025\""
Apr 29 13:45:40 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:45:40.048605647Z" level=info msg="StartContainer for \"bf83cbca6e41dfbf61fb9b474bbaa10dbe617687b173d34dd4016a8425235025\" returns successfully"
Apr 29 13:45:40 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:45:40.081515141Z" level=info msg="shim disconnected" id=bf83cbca6e41dfbf61fb9b474bbaa10dbe617687b173d34dd4016a8425235025
Apr 29 13:45:40 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:45:40.081726212Z" level=warning msg="cleaning up after shim disconnected" id=bf83cbca6e41dfbf61fb9b474bbaa10dbe617687b173d34dd4016a8425235025 namespace=k8s.io
Apr 29 13:45:40 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:45:40.081751770Z" level=info msg="cleaning up dead shim"
Apr 29 13:45:40 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:45:40.093870552Z" level=warning msg="cleanup warnings time=\"2024-04-29T13:45:40Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2967 runtime=io.containerd.runc.v2\n"
Apr 29 13:45:40 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:45:40.555662865Z" level=info msg="RemoveContainer for \"6b3c1cc4af9ffcee814ec65a142d37deac0a57bd150e885d111a693011ca1453\""
Apr 29 13:45:40 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:45:40.564156185Z" level=info msg="RemoveContainer for \"6b3c1cc4af9ffcee814ec65a142d37deac0a57bd150e885d111a693011ca1453\" returns successfully"
Apr 29 13:46:44 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:46:44.931838885Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 29 13:46:44 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:46:44.936802486Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Apr 29 13:46:44 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:46:44.938545594Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Apr 29 13:47:04 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:47:04.933309904Z" level=info msg="CreateContainer within sandbox \"988745af9097aba80dc617b058896763a5869539d090043f29739c2ceda1ed0e\" for container &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:5,}"
Apr 29 13:47:04 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:47:04.959763163Z" level=info msg="CreateContainer within sandbox \"988745af9097aba80dc617b058896763a5869539d090043f29739c2ceda1ed0e\" for &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:5,} returns container id \"8687ad836da0734a2eaa4c0dced947ac9b394d4165e1570ed796ad61f936c382\""
Apr 29 13:47:04 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:47:04.960484022Z" level=info msg="StartContainer for \"8687ad836da0734a2eaa4c0dced947ac9b394d4165e1570ed796ad61f936c382\""
Apr 29 13:47:05 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:47:05.051462664Z" level=info msg="StartContainer for \"8687ad836da0734a2eaa4c0dced947ac9b394d4165e1570ed796ad61f936c382\" returns successfully"
Apr 29 13:47:05 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:47:05.085407571Z" level=info msg="shim disconnected" id=8687ad836da0734a2eaa4c0dced947ac9b394d4165e1570ed796ad61f936c382
Apr 29 13:47:05 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:47:05.085480143Z" level=warning msg="cleaning up after shim disconnected" id=8687ad836da0734a2eaa4c0dced947ac9b394d4165e1570ed796ad61f936c382 namespace=k8s.io
Apr 29 13:47:05 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:47:05.085492689Z" level=info msg="cleaning up dead shim"
Apr 29 13:47:05 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:47:05.095346768Z" level=warning msg="cleanup warnings time=\"2024-04-29T13:47:05Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=3223 runtime=io.containerd.runc.v2\n"
Apr 29 13:47:05 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:47:05.771270236Z" level=info msg="RemoveContainer for \"bf83cbca6e41dfbf61fb9b474bbaa10dbe617687b173d34dd4016a8425235025\""
Apr 29 13:47:05 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:47:05.777027318Z" level=info msg="RemoveContainer for \"bf83cbca6e41dfbf61fb9b474bbaa10dbe617687b173d34dd4016a8425235025\" returns successfully"
Apr 29 13:49:26 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:49:26.931580209Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 29 13:49:26 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:49:26.938298307Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Apr 29 13:49:26 old-k8s-version-637516 containerd[568]: time="2024-04-29T13:49:26.940329358Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
==> coredns [99aafd29fea02a0255847f0185b6468d29d23dead19e79879c006c7b1030f5b5] <==
[INFO] plugin/ready: Still waiting on: "kubernetes"
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:39857 - 3649 "HINFO IN 11323056418300958.6149140392411326094. udp 55 false 512" NXDOMAIN qr,rd,ra 55 0.043476665s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I0429 13:44:16.375657 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-04-29 13:43:46.374903864 +0000 UTC m=+0.089001111) (total time: 30.000553769s):
Trace[2019727887]: [30.000553769s] [30.000553769s] END
E0429 13:44:16.375680 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0429 13:44:16.384812 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-04-29 13:43:46.384427415 +0000 UTC m=+0.098524653) (total time: 30.000358124s):
Trace[939984059]: [30.000358124s] [30.000358124s] END
E0429 13:44:16.384831 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0429 13:44:16.384942 1 trace.go:116] Trace[1474941318]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-04-29 13:43:46.384739964 +0000 UTC m=+0.098837203) (total time: 30.000192499s):
Trace[1474941318]: [30.000192499s] [30.000192499s] END
E0429 13:44:16.384947 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> coredns [ceace251a3f285f11b13a433c49367b13d702752ff40ae66e2e8b3ac72bf71b2] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:53149 - 47794 "HINFO IN 6852158049384092553.1160116388786646161. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.021166361s
==> describe nodes <==
Name: old-k8s-version-637516
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-637516
kubernetes.io/os=linux
minikube.k8s.io/commit=ac56d99acb3fbd2d6010a41c69273a14230e0332
minikube.k8s.io/name=old-k8s-version-637516
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_04_29T13_41_06_0700
minikube.k8s.io/version=v1.33.0
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 29 Apr 2024 13:41:03 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-637516
AcquireTime: <unset>
RenewTime: Mon, 29 Apr 2024 13:49:24 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 29 Apr 2024 13:44:35 +0000 Mon, 29 Apr 2024 13:40:56 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 29 Apr 2024 13:44:35 +0000 Mon, 29 Apr 2024 13:40:56 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 29 Apr 2024 13:44:35 +0000 Mon, 29 Apr 2024 13:40:56 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 29 Apr 2024 13:44:35 +0000 Mon, 29 Apr 2024 13:41:21 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-637516
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022564Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022564Ki
pods: 110
System Info:
Machine ID: b32ef96f12464ecda213863d5b3eea47
System UUID: c75aa106-aa79-4ce2-bce5-0de6678cb7d1
Boot ID: 59da81a4-c79c-4505-8aae-9b0d0a7d2ea1
Kernel Version: 5.15.0-1058-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.6.31
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m40s
kube-system coredns-74ff55c5b-lcl72 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m11s
kube-system etcd-old-k8s-version-637516 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m18s
kube-system kindnet-5hv44 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 8m11s
kube-system kube-apiserver-old-k8s-version-637516 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m18s
kube-system kube-controller-manager-old-k8s-version-637516 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m18s
kube-system kube-proxy-vqvz9 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m11s
kube-system kube-scheduler-old-k8s-version-637516 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m18s
kube-system metrics-server-9975d5f86-x5gln 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m30s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m9s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-j87qc 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m32s
kubernetes-dashboard kubernetes-dashboard-cd95d586-d6zcf 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m32s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m38s (x4 over 8m38s) kubelet Node old-k8s-version-637516 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m38s (x4 over 8m38s) kubelet Node old-k8s-version-637516 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m38s (x4 over 8m38s) kubelet Node old-k8s-version-637516 status is now: NodeHasSufficientPID
Normal Starting 8m18s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m18s kubelet Node old-k8s-version-637516 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m18s kubelet Node old-k8s-version-637516 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m18s kubelet Node old-k8s-version-637516 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m18s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m11s kubelet Node old-k8s-version-637516 status is now: NodeReady
Normal Starting 8m9s kube-proxy Starting kube-proxy.
Normal Starting 6m3s kubelet Starting kubelet.
Normal NodeAllocatableEnforced 6m3s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 6m2s (x8 over 6m3s) kubelet Node old-k8s-version-637516 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m2s (x7 over 6m3s) kubelet Node old-k8s-version-637516 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m2s (x8 over 6m3s) kubelet Node old-k8s-version-637516 status is now: NodeHasSufficientPID
Normal Starting 5m46s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.001023] FS-Cache: O-key=[8] 'a4e6c90000000000'
[ +0.000776] FS-Cache: N-cookie c=000000d2 [p=000000c9 fl=2 nc=0 na=1]
[ +0.000941] FS-Cache: N-cookie d=00000000f652579b{9p.inode} n=00000000558e4ce0
[ +0.001113] FS-Cache: N-key=[8] 'a4e6c90000000000'
[ +0.003329] FS-Cache: Duplicate cookie detected
[ +0.000799] FS-Cache: O-cookie c=000000cc [p=000000c9 fl=226 nc=0 na=1]
[ +0.001068] FS-Cache: O-cookie d=00000000f652579b{9p.inode} n=00000000df8e0e79
[ +0.001179] FS-Cache: O-key=[8] 'a4e6c90000000000'
[ +0.000723] FS-Cache: N-cookie c=000000d3 [p=000000c9 fl=2 nc=0 na=1]
[ +0.000959] FS-Cache: N-cookie d=00000000f652579b{9p.inode} n=0000000068d990a4
[ +0.001067] FS-Cache: N-key=[8] 'a4e6c90000000000'
[ +2.711709] FS-Cache: Duplicate cookie detected
[ +0.000697] FS-Cache: O-cookie c=000000ca [p=000000c9 fl=226 nc=0 na=1]
[ +0.001077] FS-Cache: O-cookie d=00000000f652579b{9p.inode} n=00000000d4edc684
[ +0.001094] FS-Cache: O-key=[8] 'a3e6c90000000000'
[ +0.000691] FS-Cache: N-cookie c=000000d5 [p=000000c9 fl=2 nc=0 na=1]
[ +0.000909] FS-Cache: N-cookie d=00000000f652579b{9p.inode} n=00000000ef940348
[ +0.001042] FS-Cache: N-key=[8] 'a3e6c90000000000'
[ +0.300806] FS-Cache: Duplicate cookie detected
[ +0.000700] FS-Cache: O-cookie c=000000cf [p=000000c9 fl=226 nc=0 na=1]
[ +0.000994] FS-Cache: O-cookie d=00000000f652579b{9p.inode} n=00000000b975c316
[ +0.001057] FS-Cache: O-key=[8] 'a9e6c90000000000'
[ +0.000678] FS-Cache: N-cookie c=000000d6 [p=000000c9 fl=2 nc=0 na=1]
[ +0.000938] FS-Cache: N-cookie d=00000000f652579b{9p.inode} n=000000002003c04b
[ +0.001093] FS-Cache: N-key=[8] 'a9e6c90000000000'
==> etcd [487a468a367155648e2599415872a829294e36e2f52064e34362ae63b9dc2b51] <==
2024-04-29 13:40:55.516394 I | etcdserver/membership: added member ea7e25599daad906 [https://192.168.76.2:2380] to cluster 6f20f2c4b2fb5f8a
raft2024/04/29 13:40:56 INFO: ea7e25599daad906 is starting a new election at term 1
raft2024/04/29 13:40:56 INFO: ea7e25599daad906 became candidate at term 2
raft2024/04/29 13:40:56 INFO: ea7e25599daad906 received MsgVoteResp from ea7e25599daad906 at term 2
raft2024/04/29 13:40:56 INFO: ea7e25599daad906 became leader at term 2
raft2024/04/29 13:40:56 INFO: raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2
2024-04-29 13:40:56.255165 I | etcdserver: published {Name:old-k8s-version-637516 ClientURLs:[https://192.168.76.2:2379]} to cluster 6f20f2c4b2fb5f8a
2024-04-29 13:40:56.255352 I | etcdserver: setting up the initial cluster version to 3.4
2024-04-29 13:40:56.255550 I | embed: ready to serve client requests
2024-04-29 13:40:56.255777 I | embed: ready to serve client requests
2024-04-29 13:40:56.260522 I | embed: serving client requests on 127.0.0.1:2379
2024-04-29 13:40:56.269281 N | etcdserver/membership: set the initial cluster version to 3.4
2024-04-29 13:40:56.271754 I | etcdserver/api: enabled capabilities for version 3.4
2024-04-29 13:40:56.291893 I | embed: serving client requests on 192.168.76.2:2379
2024-04-29 13:41:19.875058 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:41:29.640053 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:41:39.639935 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:41:49.639945 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:41:59.640041 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:42:09.640252 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:42:19.639962 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:42:29.640160 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:42:39.640160 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:42:49.640149 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:42:59.640078 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [d822d5375019aa8b6fdae088edca5093130b82835432dd2833a71ae56c9a1753] <==
2024-04-29 13:45:31.032902 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:45:41.033074 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:45:51.033106 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:46:01.033274 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:46:11.032938 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:46:21.033203 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:46:31.033096 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:46:41.033214 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:46:51.033230 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:47:01.033274 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:47:11.033218 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:47:21.033032 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:47:31.033201 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:47:41.033078 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:47:51.033107 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:48:01.033122 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:48:11.033196 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:48:21.033090 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:48:31.033176 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:48:41.033116 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:48:51.033849 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:49:01.033068 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:49:11.033151 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:49:21.034083 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 13:49:31.033081 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
13:49:33 up 19:31, 0 users, load average: 0.68, 1.64, 2.26
Linux old-k8s-version-637516 5.15.0-1058-aws #64~20.04.1-Ubuntu SMP Tue Apr 9 11:11:55 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [2d56c26090f29460a7f6de0be95e5742db6f734116e1e0b8060dba86b11a18c5] <==
I0429 13:41:22.833481 1 main.go:102] connected to apiserver: https://10.96.0.1:443
I0429 13:41:22.833554 1 main.go:107] hostIP = 192.168.76.2
podIP = 192.168.76.2
I0429 13:41:22.833670 1 main.go:116] setting mtu 1500 for CNI
I0429 13:41:22.833685 1 main.go:146] kindnetd IP family: "ipv4"
I0429 13:41:22.833694 1 main.go:150] noMask IPv4 subnets: [10.244.0.0/16]
I0429 13:41:53.069728 1 main.go:191] Failed to get nodes, retrying after error: Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: i/o timeout
I0429 13:41:53.084640 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0429 13:41:53.084677 1 main.go:227] handling current node
I0429 13:42:03.118866 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0429 13:42:03.118895 1 main.go:227] handling current node
I0429 13:42:13.133991 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0429 13:42:13.134021 1 main.go:227] handling current node
I0429 13:42:23.145738 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0429 13:42:23.145902 1 main.go:227] handling current node
I0429 13:42:33.176935 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0429 13:42:33.176963 1 main.go:227] handling current node
I0429 13:42:43.199602 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0429 13:42:43.199838 1 main.go:227] handling current node
I0429 13:42:53.210247 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0429 13:42:53.210277 1 main.go:227] handling current node
==> kindnet [b9ff1e04cc2c14075223ed4143af7eab578112a95cd911df71fd61fe781efe9d] <==
I0429 13:47:26.932988 1 main.go:227] handling current node
I0429 13:47:36.949951 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0429 13:47:36.950091 1 main.go:227] handling current node
I0429 13:47:46.955532 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0429 13:47:46.955594 1 main.go:227] handling current node
I0429 13:47:56.969475 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0429 13:47:56.969832 1 main.go:227] handling current node
I0429 13:48:06.980940 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0429 13:48:06.980972 1 main.go:227] handling current node
I0429 13:48:17.005042 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0429 13:48:17.005263 1 main.go:227] handling current node
I0429 13:48:27.018612 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0429 13:48:27.018643 1 main.go:227] handling current node
I0429 13:48:37.031697 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0429 13:48:37.031731 1 main.go:227] handling current node
I0429 13:48:47.044545 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0429 13:48:47.044633 1 main.go:227] handling current node
I0429 13:48:57.060080 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0429 13:48:57.060110 1 main.go:227] handling current node
I0429 13:49:07.071075 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0429 13:49:07.071198 1 main.go:227] handling current node
I0429 13:49:17.085622 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0429 13:49:17.085818 1 main.go:227] handling current node
I0429 13:49:27.097940 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0429 13:49:27.097966 1 main.go:227] handling current node
==> kube-apiserver [6f49514fe6938949387be25147dcb0463b2b9ae15ee83e14cae5c70460c06a68] <==
I0429 13:46:19.743592 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0429 13:46:19.743601 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0429 13:46:44.228848 1 handler_proxy.go:102] no RequestInfo found in the context
E0429 13:46:44.229106 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0429 13:46:44.229121 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0429 13:46:52.602902 1 client.go:360] parsed scheme: "passthrough"
I0429 13:46:52.602946 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0429 13:46:52.603100 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0429 13:47:30.609987 1 client.go:360] parsed scheme: "passthrough"
I0429 13:47:30.610240 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0429 13:47:30.610291 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0429 13:48:08.471266 1 client.go:360] parsed scheme: "passthrough"
I0429 13:48:08.471314 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0429 13:48:08.471323 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0429 13:48:42.882709 1 handler_proxy.go:102] no RequestInfo found in the context
E0429 13:48:42.882785 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0429 13:48:42.882819 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0429 13:48:52.149479 1 client.go:360] parsed scheme: "passthrough"
I0429 13:48:52.149524 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0429 13:48:52.149533 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0429 13:49:27.124521 1 client.go:360] parsed scheme: "passthrough"
I0429 13:49:27.124579 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0429 13:49:27.124590 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [92695848292c9dcf5fb37f9b7432bba3fafa7483ced7559a57ab1206427c21f3] <==
I0429 13:41:03.385779 1 cache.go:39] Caches are synced for autoregister controller
I0429 13:41:03.405538 1 controller.go:606] quota admission added evaluator for: namespaces
I0429 13:41:04.076615 1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
I0429 13:41:04.076800 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I0429 13:41:04.107529 1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000
I0429 13:41:04.113212 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I0429 13:41:04.113242 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0429 13:41:04.584470 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0429 13:41:04.627986 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0429 13:41:04.735515 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
I0429 13:41:04.736995 1 controller.go:606] quota admission added evaluator for: endpoints
I0429 13:41:04.743160 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0429 13:41:05.795259 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0429 13:41:06.093159 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0429 13:41:06.179628 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0429 13:41:14.658260 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0429 13:41:21.841491 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0429 13:41:21.910569 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0429 13:41:37.548721 1 client.go:360] parsed scheme: "passthrough"
I0429 13:41:37.548778 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0429 13:41:37.548787 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0429 13:42:18.157190 1 client.go:360] parsed scheme: "passthrough"
I0429 13:42:18.157257 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0429 13:42:18.157267 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
E0429 13:43:00.474351 1 upgradeaware.go:387] Error proxying data from backend to client: tls: use of closed connection
==> kube-controller-manager [46b329f549c16117b457f7dc74e36a56f69621b977c14a4225023ad5189c1e6f] <==
W0429 13:45:05.917806 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0429 13:45:32.067192 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0429 13:45:37.568314 1 request.go:655] Throttling request took 1.048381742s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0429 13:45:38.419804 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0429 13:46:02.569177 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0429 13:46:10.071741 1 request.go:655] Throttling request took 1.048407283s, request: GET:https://192.168.76.2:8443/apis/networking.k8s.io/v1beta1?timeout=32s
W0429 13:46:10.923062 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0429 13:46:33.088174 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0429 13:46:42.573491 1 request.go:655] Throttling request took 1.048407714s, request: GET:https://192.168.76.2:8443/apis/batch/v1?timeout=32s
W0429 13:46:43.424953 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0429 13:47:03.590033 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0429 13:47:15.075407 1 request.go:655] Throttling request took 1.048307577s, request: GET:https://192.168.76.2:8443/apis/networking.k8s.io/v1?timeout=32s
W0429 13:47:15.927127 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0429 13:47:34.091955 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0429 13:47:47.577595 1 request.go:655] Throttling request took 1.048333235s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0429 13:47:48.429284 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0429 13:48:04.593925 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0429 13:48:20.079904 1 request.go:655] Throttling request took 1.048394591s, request: GET:https://192.168.76.2:8443/apis/scheduling.k8s.io/v1?timeout=32s
W0429 13:48:20.931253 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0429 13:48:35.096302 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0429 13:48:52.581612 1 request.go:655] Throttling request took 1.048297632s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0429 13:48:53.433199 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0429 13:49:05.598497 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0429 13:49:25.083764 1 request.go:655] Throttling request took 1.047927162s, request: GET:https://192.168.76.2:8443/apis/scheduling.k8s.io/v1?timeout=32s
W0429 13:49:25.935258 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-controller-manager [eebb19d675cf51320fc9b8f9626a50880eba8fff7e0cae674a7b0477d516f3c9] <==
I0429 13:41:21.886170 1 shared_informer.go:247] Caches are synced for daemon sets
I0429 13:41:21.886539 1 range_allocator.go:373] Set node old-k8s-version-637516 PodCIDR to [10.244.0.0/24]
I0429 13:41:21.889758 1 shared_informer.go:247] Caches are synced for resource quota
I0429 13:41:21.890044 1 shared_informer.go:247] Caches are synced for TTL
I0429 13:41:21.890920 1 shared_informer.go:247] Caches are synced for persistent volume
I0429 13:41:21.909406 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-lcl72"
I0429 13:41:21.918044 1 shared_informer.go:247] Caches are synced for attach detach
I0429 13:41:21.929714 1 shared_informer.go:247] Caches are synced for namespace
I0429 13:41:21.937060 1 shared_informer.go:247] Caches are synced for GC
I0429 13:41:21.937279 1 shared_informer.go:247] Caches are synced for endpoint_slice
I0429 13:41:21.939917 1 shared_informer.go:247] Caches are synced for service account
I0429 13:41:21.958426 1 shared_informer.go:247] Caches are synced for resource quota
I0429 13:41:21.961579 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-5hv44"
I0429 13:41:21.961596 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-vqvz9"
E0429 13:41:22.086546 1 daemon_controller.go:320] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"7b9eafe2-a9a9-4b31-8e2d-057f5910193e", ResourceVersion:"259", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63849994866, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001bfbd20), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001bfbd40)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.
LabelSelector)(0x4001bfbd60), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Gl
usterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0x4001c16d80), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001bfb
d80), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeS
ource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001bfbda0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil),
AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.20.0", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001bfbde0)}}, Resources:v1.R
esourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x4001b55800), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPo
licy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4001bc37e8), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x4000a5d110), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), Runtime
ClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x400000ead8)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4001bc3838)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest version and try again
I0429 13:41:22.325435 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0429 13:41:22.402279 1 shared_informer.go:247] Caches are synced for garbage collector
I0429 13:41:22.402300 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0429 13:41:22.426103 1 shared_informer.go:247] Caches are synced for garbage collector
I0429 13:41:23.467903 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0429 13:41:23.511672 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-kf6wq"
I0429 13:41:26.854126 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I0429 13:43:01.251048 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
E0429 13:43:01.448403 1 clusterroleaggregation_controller.go:181] view failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "view": the object has been modified; please apply your changes to the latest version and try again
E0429 13:43:01.448805 1 clusterroleaggregation_controller.go:181] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
==> kube-proxy [ac0d7e8ff20e394f5786d75b39f6d09a8343e15d46a71c3ba119572cf16daac8] <==
I0429 13:43:46.183085 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0429 13:43:46.193135 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0429 13:43:46.261214 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0429 13:43:46.261695 1 server_others.go:185] Using iptables Proxier.
I0429 13:43:46.267315 1 server.go:650] Version: v1.20.0
I0429 13:43:46.268037 1 config.go:224] Starting endpoint slice config controller
I0429 13:43:46.268054 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0429 13:43:46.268202 1 config.go:315] Starting service config controller
I0429 13:43:46.268208 1 shared_informer.go:240] Waiting for caches to sync for service config
I0429 13:43:46.373433 1 shared_informer.go:247] Caches are synced for service config
I0429 13:43:46.383964 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-proxy [afe201cf19cd54f9626556f9fb2af59a62b57b2fc3870087ea49951763023e6a] <==
I0429 13:41:22.988070 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0429 13:41:22.988179 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0429 13:41:23.034572 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0429 13:41:23.034702 1 server_others.go:185] Using iptables Proxier.
I0429 13:41:23.035039 1 server.go:650] Version: v1.20.0
I0429 13:41:23.043524 1 config.go:315] Starting service config controller
I0429 13:41:23.043544 1 shared_informer.go:240] Waiting for caches to sync for service config
I0429 13:41:23.043568 1 config.go:224] Starting endpoint slice config controller
I0429 13:41:23.043571 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0429 13:41:23.143666 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0429 13:41:23.143751 1 shared_informer.go:247] Caches are synced for service config
==> kube-scheduler [4b9d2030c82b4b99a0f1aa9c220a7d550fa28b6799c689551c3e01a257cf14fe] <==
I0429 13:43:35.974341 1 serving.go:331] Generated self-signed cert in-memory
W0429 13:43:41.611670 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0429 13:43:41.612825 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0429 13:43:41.612853 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0429 13:43:41.612861 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0429 13:43:41.901691 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0429 13:43:41.939190 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0429 13:43:41.939217 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0429 13:43:41.939235 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0429 13:43:42.039607 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [676b344d21c39a7b716ddccc155a37537ba17d9d55bded00344944a3b5251ae1] <==
I0429 13:40:57.176456 1 serving.go:331] Generated self-signed cert in-memory
W0429 13:41:03.252720 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0429 13:41:03.252765 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0429 13:41:03.252774 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0429 13:41:03.252779 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0429 13:41:03.340311 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0429 13:41:03.340444 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0429 13:41:03.340458 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0429 13:41:03.340472 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0429 13:41:03.352079 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0429 13:41:03.352293 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0429 13:41:03.352422 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0429 13:41:03.352518 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0429 13:41:03.352602 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0429 13:41:03.353810 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0429 13:41:03.354054 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0429 13:41:03.354125 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0429 13:41:03.354229 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0429 13:41:03.354346 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0429 13:41:03.354442 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0429 13:41:03.354473 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0429 13:41:04.222200 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0429 13:41:04.261512 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0429 13:41:04.406256 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
I0429 13:41:07.241214 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Apr 29 13:48:01 old-k8s-version-637516 kubelet[659]: E0429 13:48:01.931616 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
Apr 29 13:48:10 old-k8s-version-637516 kubelet[659]: E0429 13:48:10.931290 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 29 13:48:14 old-k8s-version-637516 kubelet[659]: I0429 13:48:14.930563 659 scope.go:95] [topologymanager] RemoveContainer - Container ID: 8687ad836da0734a2eaa4c0dced947ac9b394d4165e1570ed796ad61f936c382
Apr 29 13:48:14 old-k8s-version-637516 kubelet[659]: E0429 13:48:14.931904 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
Apr 29 13:48:21 old-k8s-version-637516 kubelet[659]: E0429 13:48:21.931833 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 29 13:48:27 old-k8s-version-637516 kubelet[659]: I0429 13:48:27.930521 659 scope.go:95] [topologymanager] RemoveContainer - Container ID: 8687ad836da0734a2eaa4c0dced947ac9b394d4165e1570ed796ad61f936c382
Apr 29 13:48:27 old-k8s-version-637516 kubelet[659]: E0429 13:48:27.931422 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
Apr 29 13:48:35 old-k8s-version-637516 kubelet[659]: E0429 13:48:35.931483 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 29 13:48:42 old-k8s-version-637516 kubelet[659]: I0429 13:48:42.930449 659 scope.go:95] [topologymanager] RemoveContainer - Container ID: 8687ad836da0734a2eaa4c0dced947ac9b394d4165e1570ed796ad61f936c382
Apr 29 13:48:42 old-k8s-version-637516 kubelet[659]: E0429 13:48:42.930864 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
Apr 29 13:48:48 old-k8s-version-637516 kubelet[659]: E0429 13:48:48.932975 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 29 13:48:56 old-k8s-version-637516 kubelet[659]: I0429 13:48:56.930507 659 scope.go:95] [topologymanager] RemoveContainer - Container ID: 8687ad836da0734a2eaa4c0dced947ac9b394d4165e1570ed796ad61f936c382
Apr 29 13:48:56 old-k8s-version-637516 kubelet[659]: E0429 13:48:56.930900 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
Apr 29 13:49:01 old-k8s-version-637516 kubelet[659]: E0429 13:49:01.931193 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 29 13:49:07 old-k8s-version-637516 kubelet[659]: I0429 13:49:07.930596 659 scope.go:95] [topologymanager] RemoveContainer - Container ID: 8687ad836da0734a2eaa4c0dced947ac9b394d4165e1570ed796ad61f936c382
Apr 29 13:49:07 old-k8s-version-637516 kubelet[659]: E0429 13:49:07.931524 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
Apr 29 13:49:15 old-k8s-version-637516 kubelet[659]: E0429 13:49:15.931441 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 29 13:49:18 old-k8s-version-637516 kubelet[659]: I0429 13:49:18.930492 659 scope.go:95] [topologymanager] RemoveContainer - Container ID: 8687ad836da0734a2eaa4c0dced947ac9b394d4165e1570ed796ad61f936c382
Apr 29 13:49:18 old-k8s-version-637516 kubelet[659]: E0429 13:49:18.930903 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
Apr 29 13:49:26 old-k8s-version-637516 kubelet[659]: E0429 13:49:26.940636 659 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Apr 29 13:49:26 old-k8s-version-637516 kubelet[659]: E0429 13:49:26.940693 659 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Apr 29 13:49:26 old-k8s-version-637516 kubelet[659]: E0429 13:49:26.940847 659 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-5dph5,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-x5gln_kube-system(933ebad
e-8473-4e78-a6ad-1acab02e55a5): ErrImagePull: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Apr 29 13:49:26 old-k8s-version-637516 kubelet[659]: E0429 13:49:26.940894 659 pod_workers.go:191] Error syncing pod 933ebade-8473-4e78-a6ad-1acab02e55a5 ("metrics-server-9975d5f86-x5gln_kube-system(933ebade-8473-4e78-a6ad-1acab02e55a5)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Apr 29 13:49:32 old-k8s-version-637516 kubelet[659]: I0429 13:49:32.930535 659 scope.go:95] [topologymanager] RemoveContainer - Container ID: 8687ad836da0734a2eaa4c0dced947ac9b394d4165e1570ed796ad61f936c382
Apr 29 13:49:32 old-k8s-version-637516 kubelet[659]: E0429 13:49:32.931279 659 pod_workers.go:191] Error syncing pod b6bc6f80-c675-4230-93c7-2412b1937e2d ("dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-j87qc_kubernetes-dashboard(b6bc6f80-c675-4230-93c7-2412b1937e2d)"
==> kubernetes-dashboard [1171f7bf9e312d4e83e31789284ded3b56c8733f0f86756b847094cf17e199fc] <==
2024/04/29 13:44:07 Using namespace: kubernetes-dashboard
2024/04/29 13:44:07 Using in-cluster config to connect to apiserver
2024/04/29 13:44:07 Using secret token for csrf signing
2024/04/29 13:44:07 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/04/29 13:44:07 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/04/29 13:44:07 Successful initial request to the apiserver, version: v1.20.0
2024/04/29 13:44:07 Generating JWE encryption key
2024/04/29 13:44:07 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/04/29 13:44:07 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/04/29 13:44:09 Initializing JWE encryption key from synchronized object
2024/04/29 13:44:09 Creating in-cluster Sidecar client
2024/04/29 13:44:09 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/29 13:44:09 Serving insecurely on HTTP port: 9090
2024/04/29 13:44:39 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/29 13:45:09 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/29 13:45:39 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/29 13:46:09 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/29 13:46:39 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/29 13:47:09 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/29 13:47:39 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/29 13:48:09 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/29 13:48:39 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/29 13:49:09 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/29 13:44:07 Starting overwatch
==> storage-provisioner [9eb815c958691521a891ce6a646a8fe229c3c32994b0bd94e3911286c5e1a6d4] <==
I0429 13:43:44.781535 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0429 13:44:14.787474 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
==> storage-provisioner [b8faf4156978f8c5ec933471c71bdc73a0b442e4b837e3bdabab95ad9cf09146] <==
I0429 13:44:26.068697 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0429 13:44:26.094019 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0429 13:44:26.094063 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0429 13:44:43.549058 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0429 13:44:43.549491 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"c8025fb2-3e52-47ef-b101-44e25ccf6856", APIVersion:"v1", ResourceVersion:"842", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-637516_bff449a4-ea0b-4c30-be84-7ab666f39ee1 became leader
I0429 13:44:43.549621 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-637516_bff449a4-ea0b-4c30-be84-7ab666f39ee1!
I0429 13:44:43.650553 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-637516_bff449a4-ea0b-4c30-be84-7ab666f39ee1!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-637516 -n old-k8s-version-637516
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-637516 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-x5gln
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-637516 describe pod metrics-server-9975d5f86-x5gln
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-637516 describe pod metrics-server-9975d5f86-x5gln: exit status 1 (97.814129ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-x5gln" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-637516 describe pod metrics-server-9975d5f86-x5gln: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (380.42s)