=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-038518 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
E0505 21:46:17.463007 839600 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/addons-468049/client.crt: no such file or directory
E0505 21:46:19.518393 839600 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/functional-552552/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-038518 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m12.073984605s)
-- stdout --
* [old-k8s-version-038518] minikube v1.33.0 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=18602
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18602-834174/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18602-834174/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.30.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.0
* Using the docker driver based on existing profile
* Starting "old-k8s-version-038518" primary control-plane node in "old-k8s-version-038518" cluster
* Pulling base image v0.0.43-1714386659-18769 ...
* Restarting existing docker container for "old-k8s-version-038518" ...
* Preparing Kubernetes v1.20.0 on containerd 1.6.31 ...
* Verifying Kubernetes components...
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image fake.domain/registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-038518 addons enable metrics-server
* Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
-- /stdout --
** stderr **
I0505 21:46:12.540747 1034872 out.go:291] Setting OutFile to fd 1 ...
I0505 21:46:12.540920 1034872 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0505 21:46:12.540978 1034872 out.go:304] Setting ErrFile to fd 2...
I0505 21:46:12.541001 1034872 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0505 21:46:12.541353 1034872 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18602-834174/.minikube/bin
I0505 21:46:12.541777 1034872 out.go:298] Setting JSON to false
I0505 21:46:12.542854 1034872 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":19719,"bootTime":1714925853,"procs":210,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0505 21:46:12.543062 1034872 start.go:139] virtualization:
I0505 21:46:12.546886 1034872 out.go:177] * [old-k8s-version-038518] minikube v1.33.0 on Ubuntu 20.04 (arm64)
I0505 21:46:12.549692 1034872 out.go:177] - MINIKUBE_LOCATION=18602
I0505 21:46:12.549746 1034872 notify.go:220] Checking for updates...
I0505 21:46:12.557446 1034872 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0505 21:46:12.562130 1034872 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18602-834174/kubeconfig
I0505 21:46:12.564797 1034872 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18602-834174/.minikube
I0505 21:46:12.567423 1034872 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0505 21:46:12.569926 1034872 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0505 21:46:12.573046 1034872 config.go:182] Loaded profile config "old-k8s-version-038518": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0505 21:46:12.576206 1034872 out.go:177] * Kubernetes 1.30.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.0
I0505 21:46:12.578998 1034872 driver.go:392] Setting default libvirt URI to qemu:///system
I0505 21:46:12.600294 1034872 docker.go:122] docker version: linux-26.1.1:Docker Engine - Community
I0505 21:46:12.600423 1034872 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0505 21:46:12.693482 1034872 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:52 OomKillDisable:true NGoroutines:67 SystemTime:2024-05-05 21:46:12.683641213 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215101440 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:26.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.0]] Warnings:<nil>}}
I0505 21:46:12.693593 1034872 docker.go:295] overlay module found
I0505 21:46:12.696852 1034872 out.go:177] * Using the docker driver based on existing profile
I0505 21:46:12.700021 1034872 start.go:297] selected driver: docker
I0505 21:46:12.700041 1034872 start.go:901] validating driver "docker" against &{Name:old-k8s-version-038518 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-038518 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0505 21:46:12.700162 1034872 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0505 21:46:12.700808 1034872 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0505 21:46:12.771588 1034872 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:52 OomKillDisable:true NGoroutines:67 SystemTime:2024-05-05 21:46:12.761361866 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215101440 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:26.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.0]] Warnings:<nil>}}
I0505 21:46:12.771937 1034872 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0505 21:46:12.772004 1034872 cni.go:84] Creating CNI manager for ""
I0505 21:46:12.772019 1034872 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0505 21:46:12.772062 1034872 start.go:340] cluster config:
{Name:old-k8s-version-038518 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-038518 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0505 21:46:12.774853 1034872 out.go:177] * Starting "old-k8s-version-038518" primary control-plane node in "old-k8s-version-038518" cluster
I0505 21:46:12.777583 1034872 cache.go:121] Beginning downloading kic base image for docker with containerd
I0505 21:46:12.780157 1034872 out.go:177] * Pulling base image v0.0.43-1714386659-18769 ...
I0505 21:46:12.782670 1034872 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0505 21:46:12.782718 1034872 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e in local docker daemon
I0505 21:46:12.782826 1034872 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18602-834174/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0505 21:46:12.783205 1034872 cache.go:56] Caching tarball of preloaded images
I0505 21:46:12.783456 1034872 preload.go:173] Found /home/jenkins/minikube-integration/18602-834174/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0505 21:46:12.783468 1034872 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0505 21:46:12.783594 1034872 profile.go:143] Saving config to /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/old-k8s-version-038518/config.json ...
I0505 21:46:12.809442 1034872 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e in local docker daemon, skipping pull
I0505 21:46:12.809469 1034872 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e exists in daemon, skipping load
I0505 21:46:12.809485 1034872 cache.go:194] Successfully downloaded all kic artifacts
I0505 21:46:12.809524 1034872 start.go:360] acquireMachinesLock for old-k8s-version-038518: {Name:mka24e6b2e0f91b71599a7bee90a5e9a7f5018d8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0505 21:46:12.809595 1034872 start.go:364] duration metric: took 43.84µs to acquireMachinesLock for "old-k8s-version-038518"
I0505 21:46:12.809622 1034872 start.go:96] Skipping create...Using existing machine configuration
I0505 21:46:12.809631 1034872 fix.go:54] fixHost starting:
I0505 21:46:12.809937 1034872 cli_runner.go:164] Run: docker container inspect old-k8s-version-038518 --format={{.State.Status}}
I0505 21:46:12.826555 1034872 fix.go:112] recreateIfNeeded on old-k8s-version-038518: state=Stopped err=<nil>
W0505 21:46:12.826588 1034872 fix.go:138] unexpected machine state, will restart: <nil>
I0505 21:46:12.829492 1034872 out.go:177] * Restarting existing docker container for "old-k8s-version-038518" ...
I0505 21:46:12.832097 1034872 cli_runner.go:164] Run: docker start old-k8s-version-038518
I0505 21:46:13.275714 1034872 cli_runner.go:164] Run: docker container inspect old-k8s-version-038518 --format={{.State.Status}}
I0505 21:46:13.299412 1034872 kic.go:430] container "old-k8s-version-038518" state is running.
I0505 21:46:13.300244 1034872 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-038518
I0505 21:46:13.326727 1034872 profile.go:143] Saving config to /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/old-k8s-version-038518/config.json ...
I0505 21:46:13.327125 1034872 machine.go:94] provisionDockerMachine start ...
I0505 21:46:13.327249 1034872 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-038518
I0505 21:46:13.354466 1034872 main.go:141] libmachine: Using SSH client type: native
I0505 21:46:13.355091 1034872 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 34178 <nil> <nil>}
I0505 21:46:13.355108 1034872 main.go:141] libmachine: About to run SSH command:
hostname
I0505 21:46:13.355843 1034872 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:60990->127.0.0.1:34178: read: connection reset by peer
I0505 21:46:16.495327 1034872 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-038518
I0505 21:46:16.495350 1034872 ubuntu.go:169] provisioning hostname "old-k8s-version-038518"
I0505 21:46:16.495428 1034872 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-038518
I0505 21:46:16.513062 1034872 main.go:141] libmachine: Using SSH client type: native
I0505 21:46:16.513332 1034872 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 34178 <nil> <nil>}
I0505 21:46:16.513350 1034872 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-038518 && echo "old-k8s-version-038518" | sudo tee /etc/hostname
I0505 21:46:16.664294 1034872 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-038518
I0505 21:46:16.664380 1034872 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-038518
I0505 21:46:16.688526 1034872 main.go:141] libmachine: Using SSH client type: native
I0505 21:46:16.688791 1034872 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 34178 <nil> <nil>}
I0505 21:46:16.688815 1034872 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-038518' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-038518/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-038518' | sudo tee -a /etc/hosts;
fi
fi
I0505 21:46:16.843136 1034872 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0505 21:46:16.843163 1034872 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18602-834174/.minikube CaCertPath:/home/jenkins/minikube-integration/18602-834174/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18602-834174/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18602-834174/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18602-834174/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18602-834174/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18602-834174/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18602-834174/.minikube}
I0505 21:46:16.843193 1034872 ubuntu.go:177] setting up certificates
I0505 21:46:16.843203 1034872 provision.go:84] configureAuth start
I0505 21:46:16.843265 1034872 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-038518
I0505 21:46:16.859170 1034872 provision.go:143] copyHostCerts
I0505 21:46:16.859239 1034872 exec_runner.go:144] found /home/jenkins/minikube-integration/18602-834174/.minikube/key.pem, removing ...
I0505 21:46:16.859259 1034872 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18602-834174/.minikube/key.pem
I0505 21:46:16.859333 1034872 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18602-834174/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18602-834174/.minikube/key.pem (1675 bytes)
I0505 21:46:16.859457 1034872 exec_runner.go:144] found /home/jenkins/minikube-integration/18602-834174/.minikube/ca.pem, removing ...
I0505 21:46:16.859467 1034872 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18602-834174/.minikube/ca.pem
I0505 21:46:16.859497 1034872 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18602-834174/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18602-834174/.minikube/ca.pem (1082 bytes)
I0505 21:46:16.859560 1034872 exec_runner.go:144] found /home/jenkins/minikube-integration/18602-834174/.minikube/cert.pem, removing ...
I0505 21:46:16.859569 1034872 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18602-834174/.minikube/cert.pem
I0505 21:46:16.859595 1034872 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18602-834174/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18602-834174/.minikube/cert.pem (1123 bytes)
I0505 21:46:16.859648 1034872 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18602-834174/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18602-834174/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18602-834174/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-038518 san=[127.0.0.1 192.168.85.2 localhost minikube old-k8s-version-038518]
I0505 21:46:17.695263 1034872 provision.go:177] copyRemoteCerts
I0505 21:46:17.695329 1034872 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0505 21:46:17.695378 1034872 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-038518
I0505 21:46:17.713167 1034872 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34178 SSHKeyPath:/home/jenkins/minikube-integration/18602-834174/.minikube/machines/old-k8s-version-038518/id_rsa Username:docker}
I0505 21:46:17.831520 1034872 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0505 21:46:17.857821 1034872 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0505 21:46:17.884499 1034872 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0505 21:46:17.909357 1034872 provision.go:87] duration metric: took 1.066139036s to configureAuth
I0505 21:46:17.909431 1034872 ubuntu.go:193] setting minikube options for container-runtime
I0505 21:46:17.909655 1034872 config.go:182] Loaded profile config "old-k8s-version-038518": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0505 21:46:17.909672 1034872 machine.go:97] duration metric: took 4.58253468s to provisionDockerMachine
I0505 21:46:17.909681 1034872 start.go:293] postStartSetup for "old-k8s-version-038518" (driver="docker")
I0505 21:46:17.909710 1034872 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0505 21:46:17.909780 1034872 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0505 21:46:17.909838 1034872 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-038518
I0505 21:46:17.927023 1034872 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34178 SSHKeyPath:/home/jenkins/minikube-integration/18602-834174/.minikube/machines/old-k8s-version-038518/id_rsa Username:docker}
I0505 21:46:18.024883 1034872 ssh_runner.go:195] Run: cat /etc/os-release
I0505 21:46:18.028324 1034872 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0505 21:46:18.028362 1034872 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0505 21:46:18.028374 1034872 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0505 21:46:18.028381 1034872 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0505 21:46:18.028392 1034872 filesync.go:126] Scanning /home/jenkins/minikube-integration/18602-834174/.minikube/addons for local assets ...
I0505 21:46:18.028454 1034872 filesync.go:126] Scanning /home/jenkins/minikube-integration/18602-834174/.minikube/files for local assets ...
I0505 21:46:18.028533 1034872 filesync.go:149] local asset: /home/jenkins/minikube-integration/18602-834174/.minikube/files/etc/ssl/certs/8396002.pem -> 8396002.pem in /etc/ssl/certs
I0505 21:46:18.028637 1034872 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0505 21:46:18.038044 1034872 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/files/etc/ssl/certs/8396002.pem --> /etc/ssl/certs/8396002.pem (1708 bytes)
I0505 21:46:18.065303 1034872 start.go:296] duration metric: took 155.588875ms for postStartSetup
I0505 21:46:18.065401 1034872 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0505 21:46:18.065459 1034872 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-038518
I0505 21:46:18.084257 1034872 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34178 SSHKeyPath:/home/jenkins/minikube-integration/18602-834174/.minikube/machines/old-k8s-version-038518/id_rsa Username:docker}
I0505 21:46:18.184933 1034872 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0505 21:46:18.189627 1034872 fix.go:56] duration metric: took 5.379989246s for fixHost
I0505 21:46:18.189651 1034872 start.go:83] releasing machines lock for "old-k8s-version-038518", held for 5.380042579s
I0505 21:46:18.189719 1034872 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-038518
I0505 21:46:18.206939 1034872 ssh_runner.go:195] Run: cat /version.json
I0505 21:46:18.206999 1034872 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-038518
I0505 21:46:18.207015 1034872 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0505 21:46:18.207068 1034872 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-038518
I0505 21:46:18.238496 1034872 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34178 SSHKeyPath:/home/jenkins/minikube-integration/18602-834174/.minikube/machines/old-k8s-version-038518/id_rsa Username:docker}
I0505 21:46:18.241878 1034872 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34178 SSHKeyPath:/home/jenkins/minikube-integration/18602-834174/.minikube/machines/old-k8s-version-038518/id_rsa Username:docker}
I0505 21:46:18.342445 1034872 ssh_runner.go:195] Run: systemctl --version
I0505 21:46:18.461807 1034872 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0505 21:46:18.466287 1034872 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0505 21:46:18.484349 1034872 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0505 21:46:18.484440 1034872 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0505 21:46:18.494453 1034872 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0505 21:46:18.494482 1034872 start.go:494] detecting cgroup driver to use...
I0505 21:46:18.494516 1034872 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0505 21:46:18.494564 1034872 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0505 21:46:18.508780 1034872 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0505 21:46:18.521293 1034872 docker.go:217] disabling cri-docker service (if available) ...
I0505 21:46:18.521410 1034872 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0505 21:46:18.534645 1034872 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0505 21:46:18.546098 1034872 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0505 21:46:18.629970 1034872 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0505 21:46:18.754511 1034872 docker.go:233] disabling docker service ...
I0505 21:46:18.754578 1034872 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0505 21:46:18.770728 1034872 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0505 21:46:18.783064 1034872 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0505 21:46:18.873310 1034872 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0505 21:46:18.965041 1034872 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0505 21:46:18.976592 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0505 21:46:18.993296 1034872 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0505 21:46:19.005411 1034872 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0505 21:46:19.015878 1034872 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0505 21:46:19.015950 1034872 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0505 21:46:19.032393 1034872 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0505 21:46:19.047312 1034872 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0505 21:46:19.058989 1034872 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0505 21:46:19.069463 1034872 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0505 21:46:19.079353 1034872 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0505 21:46:19.089475 1034872 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0505 21:46:19.100163 1034872 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0505 21:46:19.109390 1034872 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0505 21:46:19.231271 1034872 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0505 21:46:19.421518 1034872 start.go:541] Will wait 60s for socket path /run/containerd/containerd.sock
I0505 21:46:19.421606 1034872 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0505 21:46:19.425275 1034872 start.go:562] Will wait 60s for crictl version
I0505 21:46:19.425379 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:46:19.429020 1034872 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0505 21:46:19.467193 1034872 start.go:578] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.6.31
RuntimeApiVersion: v1
I0505 21:46:19.467308 1034872 ssh_runner.go:195] Run: containerd --version
I0505 21:46:19.490448 1034872 ssh_runner.go:195] Run: containerd --version
I0505 21:46:19.516503 1034872 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.6.31 ...
I0505 21:46:19.518274 1034872 cli_runner.go:164] Run: docker network inspect old-k8s-version-038518 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0505 21:46:19.535098 1034872 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0505 21:46:19.539145 1034872 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0505 21:46:19.550809 1034872 kubeadm.go:877] updating cluster {Name:old-k8s-version-038518 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-038518 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0505 21:46:19.550947 1034872 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0505 21:46:19.551009 1034872 ssh_runner.go:195] Run: sudo crictl images --output json
I0505 21:46:19.590902 1034872 containerd.go:627] all images are preloaded for containerd runtime.
I0505 21:46:19.590927 1034872 containerd.go:534] Images already preloaded, skipping extraction
I0505 21:46:19.591007 1034872 ssh_runner.go:195] Run: sudo crictl images --output json
I0505 21:46:19.637766 1034872 containerd.go:627] all images are preloaded for containerd runtime.
I0505 21:46:19.637791 1034872 cache_images.go:84] Images are preloaded, skipping loading
I0505 21:46:19.637799 1034872 kubeadm.go:928] updating node { 192.168.85.2 8443 v1.20.0 containerd true true} ...
I0505 21:46:19.637915 1034872 kubeadm.go:940] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-038518 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-038518 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0505 21:46:19.637986 1034872 ssh_runner.go:195] Run: sudo crictl info
I0505 21:46:19.689341 1034872 cni.go:84] Creating CNI manager for ""
I0505 21:46:19.689366 1034872 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0505 21:46:19.689376 1034872 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0505 21:46:19.689396 1034872 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-038518 NodeName:old-k8s-version-038518 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0505 21:46:19.689526 1034872 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-038518"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0505 21:46:19.689598 1034872 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0505 21:46:19.701106 1034872 binaries.go:44] Found k8s binaries, skipping transfer
I0505 21:46:19.701221 1034872 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0505 21:46:19.713368 1034872 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0505 21:46:19.736069 1034872 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0505 21:46:19.757361 1034872 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0505 21:46:19.780985 1034872 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0505 21:46:19.784612 1034872 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0505 21:46:19.795627 1034872 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0505 21:46:19.881740 1034872 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0505 21:46:19.900217 1034872 certs.go:68] Setting up /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/old-k8s-version-038518 for IP: 192.168.85.2
I0505 21:46:19.900250 1034872 certs.go:194] generating shared ca certs ...
I0505 21:46:19.900267 1034872 certs.go:226] acquiring lock for ca certs: {Name:mk992a03e977f4c41ac615dd6f7b5b5a59a04251 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0505 21:46:19.900427 1034872 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18602-834174/.minikube/ca.key
I0505 21:46:19.900490 1034872 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18602-834174/.minikube/proxy-client-ca.key
I0505 21:46:19.900504 1034872 certs.go:256] generating profile certs ...
I0505 21:46:19.900615 1034872 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/old-k8s-version-038518/client.key
I0505 21:46:19.900694 1034872 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/old-k8s-version-038518/apiserver.key.500cf037
I0505 21:46:19.900753 1034872 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/old-k8s-version-038518/proxy-client.key
I0505 21:46:19.900891 1034872 certs.go:484] found cert: /home/jenkins/minikube-integration/18602-834174/.minikube/certs/839600.pem (1338 bytes)
W0505 21:46:19.900937 1034872 certs.go:480] ignoring /home/jenkins/minikube-integration/18602-834174/.minikube/certs/839600_empty.pem, impossibly tiny 0 bytes
I0505 21:46:19.900949 1034872 certs.go:484] found cert: /home/jenkins/minikube-integration/18602-834174/.minikube/certs/ca-key.pem (1675 bytes)
I0505 21:46:19.900973 1034872 certs.go:484] found cert: /home/jenkins/minikube-integration/18602-834174/.minikube/certs/ca.pem (1082 bytes)
I0505 21:46:19.901000 1034872 certs.go:484] found cert: /home/jenkins/minikube-integration/18602-834174/.minikube/certs/cert.pem (1123 bytes)
I0505 21:46:19.901032 1034872 certs.go:484] found cert: /home/jenkins/minikube-integration/18602-834174/.minikube/certs/key.pem (1675 bytes)
I0505 21:46:19.901092 1034872 certs.go:484] found cert: /home/jenkins/minikube-integration/18602-834174/.minikube/files/etc/ssl/certs/8396002.pem (1708 bytes)
I0505 21:46:19.901879 1034872 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0505 21:46:19.926656 1034872 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0505 21:46:19.952244 1034872 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0505 21:46:19.977536 1034872 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0505 21:46:20.003238 1034872 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/old-k8s-version-038518/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0505 21:46:20.033660 1034872 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/old-k8s-version-038518/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0505 21:46:20.065960 1034872 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/old-k8s-version-038518/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0505 21:46:20.095321 1034872 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/old-k8s-version-038518/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1671 bytes)
I0505 21:46:20.122893 1034872 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0505 21:46:20.149631 1034872 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/certs/839600.pem --> /usr/share/ca-certificates/839600.pem (1338 bytes)
I0505 21:46:20.184628 1034872 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/files/etc/ssl/certs/8396002.pem --> /usr/share/ca-certificates/8396002.pem (1708 bytes)
I0505 21:46:20.213872 1034872 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0505 21:46:20.236135 1034872 ssh_runner.go:195] Run: openssl version
I0505 21:46:20.245050 1034872 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/839600.pem && ln -fs /usr/share/ca-certificates/839600.pem /etc/ssl/certs/839600.pem"
I0505 21:46:20.258687 1034872 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/839600.pem
I0505 21:46:20.262621 1034872 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 May 5 21:05 /usr/share/ca-certificates/839600.pem
I0505 21:46:20.262723 1034872 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/839600.pem
I0505 21:46:20.273651 1034872 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/839600.pem /etc/ssl/certs/51391683.0"
I0505 21:46:20.282981 1034872 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/8396002.pem && ln -fs /usr/share/ca-certificates/8396002.pem /etc/ssl/certs/8396002.pem"
I0505 21:46:20.293531 1034872 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/8396002.pem
I0505 21:46:20.297169 1034872 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 May 5 21:05 /usr/share/ca-certificates/8396002.pem
I0505 21:46:20.297259 1034872 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/8396002.pem
I0505 21:46:20.304530 1034872 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/8396002.pem /etc/ssl/certs/3ec20f2e.0"
I0505 21:46:20.313674 1034872 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0505 21:46:20.323074 1034872 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0505 21:46:20.326467 1034872 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 May 5 20:58 /usr/share/ca-certificates/minikubeCA.pem
I0505 21:46:20.326593 1034872 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0505 21:46:20.333516 1034872 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0505 21:46:20.342493 1034872 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0505 21:46:20.346265 1034872 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0505 21:46:20.352952 1034872 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0505 21:46:20.359727 1034872 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0505 21:46:20.366653 1034872 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0505 21:46:20.373897 1034872 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0505 21:46:20.380974 1034872 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0505 21:46:20.387946 1034872 kubeadm.go:391] StartCluster: {Name:old-k8s-version-038518 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-038518 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0505 21:46:20.388046 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0505 21:46:20.388109 1034872 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0505 21:46:20.425969 1034872 cri.go:89] found id: "718b2b382a1dbae2be4f3fe12f41a1c16ad252136b3ffd405f84c2c8dd1cb908"
I0505 21:46:20.425992 1034872 cri.go:89] found id: "eeef826886f49f8a3d295e86a6a5d0357f6336899aed7c54ca1a4b1d0ceafdf3"
I0505 21:46:20.425997 1034872 cri.go:89] found id: "7c36c2442ceb7ea588207eeb243a163d370cc67473ad5096314a4b9f8bf196cb"
I0505 21:46:20.426000 1034872 cri.go:89] found id: "64ef7f857a2f76b261914c70bce060b265f43d38371ea0ca161a99a9d7c3ef2d"
I0505 21:46:20.426004 1034872 cri.go:89] found id: "6a301dfa69e35bc9c7dfd957f9098189bef6c3a23dfdee95d5dfe176ee47a84e"
I0505 21:46:20.426008 1034872 cri.go:89] found id: "0441347974720e9d65c1d5094d8ca940394afc2d22b6fc51a6a18f4b1ba45061"
I0505 21:46:20.426030 1034872 cri.go:89] found id: "9067c10ea9a99ed6a32fe6eb91c9516cb585fb511f405daf4626d97a5236dde0"
I0505 21:46:20.426052 1034872 cri.go:89] found id: "0dc3b13f77012b59a798a53b123a1eb333fec5c5fef1d4e079e3060d22355c74"
I0505 21:46:20.426055 1034872 cri.go:89] found id: ""
I0505 21:46:20.426120 1034872 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0505 21:46:20.438070 1034872 cri.go:116] JSON = null
W0505 21:46:20.438117 1034872 kubeadm.go:398] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0505 21:46:20.438179 1034872 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0505 21:46:20.446966 1034872 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0505 21:46:20.446990 1034872 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0505 21:46:20.446995 1034872 kubeadm.go:587] restartPrimaryControlPlane start ...
I0505 21:46:20.447045 1034872 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0505 21:46:20.455891 1034872 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0505 21:46:20.456359 1034872 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-038518" does not appear in /home/jenkins/minikube-integration/18602-834174/kubeconfig
I0505 21:46:20.456499 1034872 kubeconfig.go:62] /home/jenkins/minikube-integration/18602-834174/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-038518" cluster setting kubeconfig missing "old-k8s-version-038518" context setting]
I0505 21:46:20.456849 1034872 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18602-834174/kubeconfig: {Name:mk1f4a993d314c9b9678dd66c1674ab1ea843e39 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0505 21:46:20.458170 1034872 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0505 21:46:20.466993 1034872 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.85.2
I0505 21:46:20.467076 1034872 kubeadm.go:591] duration metric: took 20.074661ms to restartPrimaryControlPlane
I0505 21:46:20.467094 1034872 kubeadm.go:393] duration metric: took 79.165447ms to StartCluster
I0505 21:46:20.467111 1034872 settings.go:142] acquiring lock: {Name:mk90aef9357b962664100b97eb84c84d957787fc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0505 21:46:20.467191 1034872 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/18602-834174/kubeconfig
I0505 21:46:20.467878 1034872 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18602-834174/kubeconfig: {Name:mk1f4a993d314c9b9678dd66c1674ab1ea843e39 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0505 21:46:20.468110 1034872 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0505 21:46:20.471647 1034872 out.go:177] * Verifying Kubernetes components...
I0505 21:46:20.468371 1034872 config.go:182] Loaded profile config "old-k8s-version-038518": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0505 21:46:20.468393 1034872 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0505 21:46:20.473663 1034872 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-038518"
I0505 21:46:20.473685 1034872 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-038518"
W0505 21:46:20.473692 1034872 addons.go:243] addon storage-provisioner should already be in state true
I0505 21:46:20.473692 1034872 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0505 21:46:20.473718 1034872 host.go:66] Checking if "old-k8s-version-038518" exists ...
I0505 21:46:20.473790 1034872 addons.go:69] Setting dashboard=true in profile "old-k8s-version-038518"
I0505 21:46:20.473814 1034872 addons.go:234] Setting addon dashboard=true in "old-k8s-version-038518"
W0505 21:46:20.473821 1034872 addons.go:243] addon dashboard should already be in state true
I0505 21:46:20.473852 1034872 host.go:66] Checking if "old-k8s-version-038518" exists ...
I0505 21:46:20.474168 1034872 cli_runner.go:164] Run: docker container inspect old-k8s-version-038518 --format={{.State.Status}}
I0505 21:46:20.474257 1034872 cli_runner.go:164] Run: docker container inspect old-k8s-version-038518 --format={{.State.Status}}
I0505 21:46:20.478558 1034872 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-038518"
I0505 21:46:20.478600 1034872 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-038518"
W0505 21:46:20.478607 1034872 addons.go:243] addon metrics-server should already be in state true
I0505 21:46:20.478636 1034872 host.go:66] Checking if "old-k8s-version-038518" exists ...
I0505 21:46:20.479063 1034872 cli_runner.go:164] Run: docker container inspect old-k8s-version-038518 --format={{.State.Status}}
I0505 21:46:20.479252 1034872 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-038518"
I0505 21:46:20.479282 1034872 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-038518"
I0505 21:46:20.479508 1034872 cli_runner.go:164] Run: docker container inspect old-k8s-version-038518 --format={{.State.Status}}
I0505 21:46:20.518816 1034872 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0505 21:46:20.522875 1034872 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0505 21:46:20.524483 1034872 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0505 21:46:20.526516 1034872 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0505 21:46:20.526538 1034872 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0505 21:46:20.526601 1034872 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-038518
I0505 21:46:20.524675 1034872 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0505 21:46:20.530504 1034872 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0505 21:46:20.530588 1034872 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-038518
I0505 21:46:20.532986 1034872 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0505 21:46:20.539566 1034872 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0505 21:46:20.539595 1034872 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0505 21:46:20.539667 1034872 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-038518
I0505 21:46:20.556071 1034872 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-038518"
W0505 21:46:20.556099 1034872 addons.go:243] addon default-storageclass should already be in state true
I0505 21:46:20.556124 1034872 host.go:66] Checking if "old-k8s-version-038518" exists ...
I0505 21:46:20.556539 1034872 cli_runner.go:164] Run: docker container inspect old-k8s-version-038518 --format={{.State.Status}}
I0505 21:46:20.579070 1034872 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34178 SSHKeyPath:/home/jenkins/minikube-integration/18602-834174/.minikube/machines/old-k8s-version-038518/id_rsa Username:docker}
I0505 21:46:20.600650 1034872 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34178 SSHKeyPath:/home/jenkins/minikube-integration/18602-834174/.minikube/machines/old-k8s-version-038518/id_rsa Username:docker}
I0505 21:46:20.632975 1034872 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34178 SSHKeyPath:/home/jenkins/minikube-integration/18602-834174/.minikube/machines/old-k8s-version-038518/id_rsa Username:docker}
I0505 21:46:20.656940 1034872 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0505 21:46:20.656962 1034872 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0505 21:46:20.657021 1034872 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-038518
I0505 21:46:20.664155 1034872 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0505 21:46:20.699694 1034872 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34178 SSHKeyPath:/home/jenkins/minikube-integration/18602-834174/.minikube/machines/old-k8s-version-038518/id_rsa Username:docker}
I0505 21:46:20.703918 1034872 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-038518" to be "Ready" ...
I0505 21:46:20.728655 1034872 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0505 21:46:20.728678 1034872 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0505 21:46:20.754505 1034872 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0505 21:46:20.754532 1034872 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0505 21:46:20.812482 1034872 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0505 21:46:20.812508 1034872 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0505 21:46:20.817960 1034872 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0505 21:46:20.818005 1034872 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0505 21:46:20.827781 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0505 21:46:20.869909 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0505 21:46:20.921947 1034872 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0505 21:46:20.921974 1034872 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0505 21:46:20.931278 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0505 21:46:20.963428 1034872 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0505 21:46:20.963452 1034872 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0505 21:46:20.984957 1034872 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0505 21:46:20.984982 1034872 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0505 21:46:21.012880 1034872 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0505 21:46:21.012907 1034872 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0505 21:46:21.100296 1034872 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0505 21:46:21.100328 1034872 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
W0505 21:46:21.135021 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:21.135057 1034872 retry.go:31] will retry after 231.034361ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0505 21:46:21.135139 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:21.135199 1034872 retry.go:31] will retry after 349.64333ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:21.143550 1034872 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0505 21:46:21.143579 1034872 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
W0505 21:46:21.170752 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:21.170879 1034872 retry.go:31] will retry after 353.453987ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:21.183031 1034872 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0505 21:46:21.183063 1034872 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0505 21:46:21.210043 1034872 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0505 21:46:21.210068 1034872 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0505 21:46:21.229774 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0505 21:46:21.318293 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:21.318328 1034872 retry.go:31] will retry after 328.03823ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:21.366449 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0505 21:46:21.438458 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:21.438492 1034872 retry.go:31] will retry after 293.088485ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:21.485813 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0505 21:46:21.524556 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0505 21:46:21.569053 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:21.569139 1034872 retry.go:31] will retry after 350.238355ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0505 21:46:21.610328 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:21.610358 1034872 retry.go:31] will retry after 192.438257ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:21.647485 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0505 21:46:21.732404 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0505 21:46:21.756561 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:21.756597 1034872 retry.go:31] will retry after 506.504545ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:21.803876 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0505 21:46:21.836313 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:21.836342 1034872 retry.go:31] will retry after 606.037281ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0505 21:46:21.890400 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:21.890432 1034872 retry.go:31] will retry after 438.119245ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:21.919570 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0505 21:46:21.994087 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:21.994118 1034872 retry.go:31] will retry after 530.233918ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:22.263993 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0505 21:46:22.329378 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0505 21:46:22.337796 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:22.337838 1034872 retry.go:31] will retry after 585.600907ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0505 21:46:22.405654 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:22.405702 1034872 retry.go:31] will retry after 581.40241ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:22.442850 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0505 21:46:22.512435 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:22.512464 1034872 retry.go:31] will retry after 900.938692ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:22.524655 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0505 21:46:22.596227 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:22.596265 1034872 retry.go:31] will retry after 917.979715ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:22.704734 1034872 node_ready.go:53] error getting node "old-k8s-version-038518": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-038518": dial tcp 192.168.85.2:8443: connect: connection refused
I0505 21:46:22.924153 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0505 21:46:22.987514 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0505 21:46:23.009071 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:23.009165 1034872 retry.go:31] will retry after 796.856369ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0505 21:46:23.063088 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:23.063119 1034872 retry.go:31] will retry after 1.873691574s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:23.414032 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0505 21:46:23.501003 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:23.501036 1034872 retry.go:31] will retry after 1.250463365s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:23.515191 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0505 21:46:23.585781 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:23.585814 1034872 retry.go:31] will retry after 934.644937ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:23.806652 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0505 21:46:23.886857 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:23.886891 1034872 retry.go:31] will retry after 1.208695927s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:24.520905 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0505 21:46:24.600301 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:24.600333 1034872 retry.go:31] will retry after 1.986312066s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:24.704854 1034872 node_ready.go:53] error getting node "old-k8s-version-038518": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-038518": dial tcp 192.168.85.2:8443: connect: connection refused
I0505 21:46:24.752128 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0505 21:46:24.830366 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:24.830446 1034872 retry.go:31] will retry after 1.937469785s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:24.937775 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0505 21:46:25.008497 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:25.008530 1034872 retry.go:31] will retry after 2.671545684s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:25.095838 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0505 21:46:25.185352 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:25.185386 1034872 retry.go:31] will retry after 1.105273186s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:26.291097 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0505 21:46:26.387599 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:26.387633 1034872 retry.go:31] will retry after 1.436006776s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:26.586907 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0505 21:46:26.704980 1034872 node_ready.go:53] error getting node "old-k8s-version-038518": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-038518": dial tcp 192.168.85.2:8443: connect: connection refused
W0505 21:46:26.727031 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:26.727059 1034872 retry.go:31] will retry after 1.651013066s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:26.768407 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0505 21:46:26.903388 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:26.903415 1034872 retry.go:31] will retry after 3.957279632s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:27.680684 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0505 21:46:27.824874 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0505 21:46:27.834829 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:27.834858 1034872 retry.go:31] will retry after 3.411734007s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0505 21:46:27.945549 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:27.945580 1034872 retry.go:31] will retry after 4.283008109s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:28.378674 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0505 21:46:28.563618 1034872 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:28.563700 1034872 retry.go:31] will retry after 5.0688514s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0505 21:46:28.705303 1034872 node_ready.go:53] error getting node "old-k8s-version-038518": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-038518": dial tcp 192.168.85.2:8443: connect: connection refused
I0505 21:46:30.860930 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0505 21:46:31.247737 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0505 21:46:32.229118 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0505 21:46:33.633062 1034872 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0505 21:46:36.737805 1034872 node_ready.go:49] node "old-k8s-version-038518" has status "Ready":"True"
I0505 21:46:36.737847 1034872 node_ready.go:38] duration metric: took 16.033880852s for node "old-k8s-version-038518" to be "Ready" ...
I0505 21:46:36.737862 1034872 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0505 21:46:36.902396 1034872 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-6mbxd" in "kube-system" namespace to be "Ready" ...
I0505 21:46:36.945505 1034872 pod_ready.go:92] pod "coredns-74ff55c5b-6mbxd" in "kube-system" namespace has status "Ready":"True"
I0505 21:46:36.945579 1034872 pod_ready.go:81] duration metric: took 43.112985ms for pod "coredns-74ff55c5b-6mbxd" in "kube-system" namespace to be "Ready" ...
I0505 21:46:36.945607 1034872 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-038518" in "kube-system" namespace to be "Ready" ...
I0505 21:46:36.980692 1034872 pod_ready.go:92] pod "etcd-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"True"
I0505 21:46:36.980712 1034872 pod_ready.go:81] duration metric: took 35.084835ms for pod "etcd-old-k8s-version-038518" in "kube-system" namespace to be "Ready" ...
I0505 21:46:36.980727 1034872 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-038518" in "kube-system" namespace to be "Ready" ...
I0505 21:46:36.997562 1034872 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"True"
I0505 21:46:36.997648 1034872 pod_ready.go:81] duration metric: took 16.911384ms for pod "kube-apiserver-old-k8s-version-038518" in "kube-system" namespace to be "Ready" ...
I0505 21:46:36.997676 1034872 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace to be "Ready" ...
I0505 21:46:37.609336 1034872 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (6.748348664s)
I0505 21:46:37.675275 1034872 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (6.42749063s)
I0505 21:46:38.046250 1034872 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (5.817070006s)
I0505 21:46:38.048340 1034872 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-038518 addons enable metrics-server
I0505 21:46:38.046612 1034872 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (4.413518066s)
I0505 21:46:38.048468 1034872 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-038518"
I0505 21:46:38.050752 1034872 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
I0505 21:46:38.052704 1034872 addons.go:510] duration metric: took 17.584292579s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server dashboard]
I0505 21:46:39.008427 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:46:41.504610 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:46:43.508575 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:46:46.012836 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:46:48.507847 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:46:51.010089 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:46:53.516986 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:46:56.014922 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:46:58.504354 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:00.505781 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:02.508137 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:05.007381 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:07.017188 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:09.504905 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:11.505459 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:14.006941 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:16.007967 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:18.523087 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:21.005613 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:23.007028 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:25.505943 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:28.009110 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:30.021324 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:32.504916 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:34.505484 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:36.508396 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:39.007175 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:41.008113 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:43.513092 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:45.518271 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:48.006518 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:50.026749 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:52.505313 1034872 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:54.008199 1034872 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"True"
I0505 21:47:54.008224 1034872 pod_ready.go:81] duration metric: took 1m17.010525519s for pod "kube-controller-manager-old-k8s-version-038518" in "kube-system" namespace to be "Ready" ...
I0505 21:47:54.008240 1034872 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-cfmwt" in "kube-system" namespace to be "Ready" ...
I0505 21:47:54.014101 1034872 pod_ready.go:92] pod "kube-proxy-cfmwt" in "kube-system" namespace has status "Ready":"True"
I0505 21:47:54.014130 1034872 pod_ready.go:81] duration metric: took 5.882722ms for pod "kube-proxy-cfmwt" in "kube-system" namespace to be "Ready" ...
I0505 21:47:54.014143 1034872 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-038518" in "kube-system" namespace to be "Ready" ...
I0505 21:47:56.021519 1034872 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:47:58.520115 1034872 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:00.522070 1034872 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-038518" in "kube-system" namespace has status "Ready":"True"
I0505 21:48:00.522095 1034872 pod_ready.go:81] duration metric: took 6.507944527s for pod "kube-scheduler-old-k8s-version-038518" in "kube-system" namespace to be "Ready" ...
I0505 21:48:00.522107 1034872 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace to be "Ready" ...
I0505 21:48:02.529329 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:05.028279 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:07.125277 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:09.529611 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:12.028245 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:14.528265 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:17.027753 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:19.028132 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:21.028436 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:23.028671 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:25.530523 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:28.029350 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:30.038499 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:32.529419 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:35.028073 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:37.528297 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:39.528843 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:42.028660 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:44.029203 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:46.528285 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:48.528482 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:50.528942 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:52.528976 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:54.529807 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:57.027891 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:48:59.028225 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:01.529569 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:04.029563 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:06.528646 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:09.028501 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:11.529110 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:14.027986 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:16.028115 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:18.028281 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:20.039985 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:22.529159 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:25.028315 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:27.028710 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:29.529110 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:32.028955 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:34.528455 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:36.528485 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:38.529138 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:41.028473 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:43.529052 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:46.029418 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:48.528403 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:50.528807 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:52.529024 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:55.029632 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:57.528266 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:49:59.528484 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:01.528709 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:04.028695 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:06.528278 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:08.528522 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:11.027756 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:13.028634 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:15.029316 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:17.529328 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:20.032123 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:22.528970 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:24.529658 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:27.028082 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:29.028438 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:31.028970 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:33.029540 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:35.528465 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:37.529163 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:40.028818 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:42.029444 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:44.528255 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:46.531099 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:48.595872 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:51.028106 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:53.529833 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:56.028509 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:50:58.028623 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:00.048601 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:02.529522 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:05.028640 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:07.028671 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:09.029793 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:11.528329 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:14.028416 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:16.028463 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:18.028865 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:20.029239 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:22.030470 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:24.528698 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:26.529413 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:29.028958 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:31.029033 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:33.529002 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:36.028742 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:38.030047 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:40.528260 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:42.528574 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:44.532997 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:47.028608 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:49.029308 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:51.531876 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:53.532617 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:56.028934 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:58.528323 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:52:00.529341 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:52:00.529376 1034872 pod_ready.go:81] duration metric: took 4m0.007260823s for pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace to be "Ready" ...
E0505 21:52:00.529388 1034872 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0505 21:52:00.529397 1034872 pod_ready.go:38] duration metric: took 5m23.791524111s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0505 21:52:00.529411 1034872 api_server.go:52] waiting for apiserver process to appear ...
I0505 21:52:00.529447 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0505 21:52:00.529516 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0505 21:52:00.570401 1034872 cri.go:89] found id: "e507b898dd4977185ac9e4f35e0538853889d163fb8c2646196f755bfd9aeb50"
I0505 21:52:00.570421 1034872 cri.go:89] found id: "0441347974720e9d65c1d5094d8ca940394afc2d22b6fc51a6a18f4b1ba45061"
I0505 21:52:00.570426 1034872 cri.go:89] found id: ""
I0505 21:52:00.570433 1034872 logs.go:276] 2 containers: [e507b898dd4977185ac9e4f35e0538853889d163fb8c2646196f755bfd9aeb50 0441347974720e9d65c1d5094d8ca940394afc2d22b6fc51a6a18f4b1ba45061]
I0505 21:52:00.570490 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.574432 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.578004 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0505 21:52:00.578083 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0505 21:52:00.616222 1034872 cri.go:89] found id: "580e75f9f31dafb32fc2f7dbacfb021fca77474ee298a6ed5835a83572ff441a"
I0505 21:52:00.616246 1034872 cri.go:89] found id: "9067c10ea9a99ed6a32fe6eb91c9516cb585fb511f405daf4626d97a5236dde0"
I0505 21:52:00.616252 1034872 cri.go:89] found id: ""
I0505 21:52:00.616258 1034872 logs.go:276] 2 containers: [580e75f9f31dafb32fc2f7dbacfb021fca77474ee298a6ed5835a83572ff441a 9067c10ea9a99ed6a32fe6eb91c9516cb585fb511f405daf4626d97a5236dde0]
I0505 21:52:00.616315 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.620626 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.624756 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0505 21:52:00.624866 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0505 21:52:00.663784 1034872 cri.go:89] found id: "00a9d52255afbc7a5af4b434524704f295b6b305ad9e0f1f57cb51ebc317a563"
I0505 21:52:00.663809 1034872 cri.go:89] found id: "718b2b382a1dbae2be4f3fe12f41a1c16ad252136b3ffd405f84c2c8dd1cb908"
I0505 21:52:00.663815 1034872 cri.go:89] found id: ""
I0505 21:52:00.663822 1034872 logs.go:276] 2 containers: [00a9d52255afbc7a5af4b434524704f295b6b305ad9e0f1f57cb51ebc317a563 718b2b382a1dbae2be4f3fe12f41a1c16ad252136b3ffd405f84c2c8dd1cb908]
I0505 21:52:00.663907 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.667561 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.670928 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0505 21:52:00.671055 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0505 21:52:00.714347 1034872 cri.go:89] found id: "a9b1a797d9ee2c00fbed142aaecb2de99854f0ab6cf2c751c17eb782676547d8"
I0505 21:52:00.714370 1034872 cri.go:89] found id: "0dc3b13f77012b59a798a53b123a1eb333fec5c5fef1d4e079e3060d22355c74"
I0505 21:52:00.714375 1034872 cri.go:89] found id: ""
I0505 21:52:00.714382 1034872 logs.go:276] 2 containers: [a9b1a797d9ee2c00fbed142aaecb2de99854f0ab6cf2c751c17eb782676547d8 0dc3b13f77012b59a798a53b123a1eb333fec5c5fef1d4e079e3060d22355c74]
I0505 21:52:00.714461 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.717889 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.721368 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0505 21:52:00.721477 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0505 21:52:00.775897 1034872 cri.go:89] found id: "0eedfa9ede7ada50303473ae02419af0e8e08f080f59c78fde9947be8067a50c"
I0505 21:52:00.775924 1034872 cri.go:89] found id: "64ef7f857a2f76b261914c70bce060b265f43d38371ea0ca161a99a9d7c3ef2d"
I0505 21:52:00.775930 1034872 cri.go:89] found id: ""
I0505 21:52:00.775937 1034872 logs.go:276] 2 containers: [0eedfa9ede7ada50303473ae02419af0e8e08f080f59c78fde9947be8067a50c 64ef7f857a2f76b261914c70bce060b265f43d38371ea0ca161a99a9d7c3ef2d]
I0505 21:52:00.775993 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.780204 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.785097 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0505 21:52:00.785165 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0505 21:52:00.826033 1034872 cri.go:89] found id: "a288efd4ebd942b45a3ca58128b3e8296d0e2c8fda2cd9104f1c23acb6ebdca9"
I0505 21:52:00.826056 1034872 cri.go:89] found id: "6a301dfa69e35bc9c7dfd957f9098189bef6c3a23dfdee95d5dfe176ee47a84e"
I0505 21:52:00.826061 1034872 cri.go:89] found id: ""
I0505 21:52:00.826069 1034872 logs.go:276] 2 containers: [a288efd4ebd942b45a3ca58128b3e8296d0e2c8fda2cd9104f1c23acb6ebdca9 6a301dfa69e35bc9c7dfd957f9098189bef6c3a23dfdee95d5dfe176ee47a84e]
I0505 21:52:00.826123 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.829684 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.832986 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0505 21:52:00.833107 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0505 21:52:00.870181 1034872 cri.go:89] found id: "faa0225deba398d4a6dbde18c4021422a8598fa18e0944489f35b4a7564593a9"
I0505 21:52:00.870208 1034872 cri.go:89] found id: "7c36c2442ceb7ea588207eeb243a163d370cc67473ad5096314a4b9f8bf196cb"
I0505 21:52:00.870213 1034872 cri.go:89] found id: ""
I0505 21:52:00.870220 1034872 logs.go:276] 2 containers: [faa0225deba398d4a6dbde18c4021422a8598fa18e0944489f35b4a7564593a9 7c36c2442ceb7ea588207eeb243a163d370cc67473ad5096314a4b9f8bf196cb]
I0505 21:52:00.870276 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.873960 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.877442 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0505 21:52:00.877525 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0505 21:52:00.923912 1034872 cri.go:89] found id: "48a51b2077e2dec5b1c8092e8da9e537f72f9d962aff852c13a67a6ca472dd16"
I0505 21:52:00.923933 1034872 cri.go:89] found id: "3fc65d073b431f4914e162dd4c0da74d3a8cc7f545665adbc031bd3869d1bbd2"
I0505 21:52:00.923937 1034872 cri.go:89] found id: ""
I0505 21:52:00.923945 1034872 logs.go:276] 2 containers: [48a51b2077e2dec5b1c8092e8da9e537f72f9d962aff852c13a67a6ca472dd16 3fc65d073b431f4914e162dd4c0da74d3a8cc7f545665adbc031bd3869d1bbd2]
I0505 21:52:00.923997 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.927484 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.930579 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0505 21:52:00.930647 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0505 21:52:00.969489 1034872 cri.go:89] found id: "e84d32f53ec5f8ce10bda8f22df215950b0a08e1924b9f83fa3e62918c0878b0"
I0505 21:52:00.969553 1034872 cri.go:89] found id: ""
I0505 21:52:00.969574 1034872 logs.go:276] 1 containers: [e84d32f53ec5f8ce10bda8f22df215950b0a08e1924b9f83fa3e62918c0878b0]
I0505 21:52:00.969673 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.973313 1034872 logs.go:123] Gathering logs for kube-controller-manager [a288efd4ebd942b45a3ca58128b3e8296d0e2c8fda2cd9104f1c23acb6ebdca9] ...
I0505 21:52:00.973342 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a288efd4ebd942b45a3ca58128b3e8296d0e2c8fda2cd9104f1c23acb6ebdca9"
I0505 21:52:01.034141 1034872 logs.go:123] Gathering logs for kube-controller-manager [6a301dfa69e35bc9c7dfd957f9098189bef6c3a23dfdee95d5dfe176ee47a84e] ...
I0505 21:52:01.034175 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6a301dfa69e35bc9c7dfd957f9098189bef6c3a23dfdee95d5dfe176ee47a84e"
I0505 21:52:01.107457 1034872 logs.go:123] Gathering logs for kubelet ...
I0505 21:52:01.107495 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0505 21:52:01.154099 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.362969 658 reflector.go:138] object-"kube-system"/"storage-provisioner-token-2246n": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-2246n" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:01.154420 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.364071 658 reflector.go:138] object-"kube-system"/"kube-proxy-token-kvlt6": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-kvlt6" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:01.154627 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.392090 658 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:01.154848 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.392198 658 reflector.go:138] object-"kube-system"/"kindnet-token-6nwjh": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-6nwjh" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:01.155057 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.392264 658 reflector.go:138] object-"kube-system"/"coredns-token-kbxdj": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-kbxdj" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:01.155256 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.392330 658 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:01.158861 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.536174 658 reflector.go:138] object-"default"/"default-token-xtgrf": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-xtgrf" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:01.159082 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.536174 658 reflector.go:138] object-"kube-system"/"metrics-server-token-77bv5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-77bv5" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:01.166115 1034872 logs.go:138] Found kubelet problem: May 05 21:46:38 old-k8s-version-038518 kubelet[658]: E0505 21:46:38.675127 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0505 21:52:01.167076 1034872 logs.go:138] Found kubelet problem: May 05 21:46:39 old-k8s-version-038518 kubelet[658]: E0505 21:46:39.593155 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.169834 1034872 logs.go:138] Found kubelet problem: May 05 21:46:53 old-k8s-version-038518 kubelet[658]: E0505 21:46:53.494945 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0505 21:52:01.171917 1034872 logs.go:138] Found kubelet problem: May 05 21:47:00 old-k8s-version-038518 kubelet[658]: E0505 21:47:00.699177 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.172255 1034872 logs.go:138] Found kubelet problem: May 05 21:47:01 old-k8s-version-038518 kubelet[658]: E0505 21:47:01.687241 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.172581 1034872 logs.go:138] Found kubelet problem: May 05 21:47:06 old-k8s-version-038518 kubelet[658]: E0505 21:47:06.703880 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.172769 1034872 logs.go:138] Found kubelet problem: May 05 21:47:07 old-k8s-version-038518 kubelet[658]: E0505 21:47:07.485645 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.173205 1034872 logs.go:138] Found kubelet problem: May 05 21:47:08 old-k8s-version-038518 kubelet[658]: E0505 21:47:08.728799 658 pod_workers.go:191] Error syncing pod 3b3b675d-496d-431d-8171-51d0320491be ("storage-provisioner_kube-system(3b3b675d-496d-431d-8171-51d0320491be)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(3b3b675d-496d-431d-8171-51d0320491be)"
W0505 21:52:01.176435 1034872 logs.go:138] Found kubelet problem: May 05 21:47:19 old-k8s-version-038518 kubelet[658]: E0505 21:47:19.494034 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0505 21:52:01.176895 1034872 logs.go:138] Found kubelet problem: May 05 21:47:19 old-k8s-version-038518 kubelet[658]: E0505 21:47:19.762150 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.177344 1034872 logs.go:138] Found kubelet problem: May 05 21:47:26 old-k8s-version-038518 kubelet[658]: E0505 21:47:26.703935 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.177527 1034872 logs.go:138] Found kubelet problem: May 05 21:47:30 old-k8s-version-038518 kubelet[658]: E0505 21:47:30.485820 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.178107 1034872 logs.go:138] Found kubelet problem: May 05 21:47:41 old-k8s-version-038518 kubelet[658]: E0505 21:47:41.822533 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.178291 1034872 logs.go:138] Found kubelet problem: May 05 21:47:43 old-k8s-version-038518 kubelet[658]: E0505 21:47:43.485594 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.178613 1034872 logs.go:138] Found kubelet problem: May 05 21:47:46 old-k8s-version-038518 kubelet[658]: E0505 21:47:46.704245 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.178865 1034872 logs.go:138] Found kubelet problem: May 05 21:47:57 old-k8s-version-038518 kubelet[658]: E0505 21:47:57.485753 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.179189 1034872 logs.go:138] Found kubelet problem: May 05 21:47:59 old-k8s-version-038518 kubelet[658]: E0505 21:47:59.485321 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.181593 1034872 logs.go:138] Found kubelet problem: May 05 21:48:09 old-k8s-version-038518 kubelet[658]: E0505 21:48:09.493238 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0505 21:52:01.181922 1034872 logs.go:138] Found kubelet problem: May 05 21:48:14 old-k8s-version-038518 kubelet[658]: E0505 21:48:14.485469 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.182106 1034872 logs.go:138] Found kubelet problem: May 05 21:48:21 old-k8s-version-038518 kubelet[658]: E0505 21:48:21.485674 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.182690 1034872 logs.go:138] Found kubelet problem: May 05 21:48:25 old-k8s-version-038518 kubelet[658]: E0505 21:48:25.932847 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.183019 1034872 logs.go:138] Found kubelet problem: May 05 21:48:26 old-k8s-version-038518 kubelet[658]: E0505 21:48:26.940259 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.183204 1034872 logs.go:138] Found kubelet problem: May 05 21:48:33 old-k8s-version-038518 kubelet[658]: E0505 21:48:33.485713 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.183526 1034872 logs.go:138] Found kubelet problem: May 05 21:48:40 old-k8s-version-038518 kubelet[658]: E0505 21:48:40.485993 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.183709 1034872 logs.go:138] Found kubelet problem: May 05 21:48:48 old-k8s-version-038518 kubelet[658]: E0505 21:48:48.487195 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.184053 1034872 logs.go:138] Found kubelet problem: May 05 21:48:52 old-k8s-version-038518 kubelet[658]: E0505 21:48:52.485993 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.184236 1034872 logs.go:138] Found kubelet problem: May 05 21:49:01 old-k8s-version-038518 kubelet[658]: E0505 21:49:01.485651 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.184563 1034872 logs.go:138] Found kubelet problem: May 05 21:49:04 old-k8s-version-038518 kubelet[658]: E0505 21:49:04.485476 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.184886 1034872 logs.go:138] Found kubelet problem: May 05 21:49:16 old-k8s-version-038518 kubelet[658]: E0505 21:49:16.485864 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.185067 1034872 logs.go:138] Found kubelet problem: May 05 21:49:16 old-k8s-version-038518 kubelet[658]: E0505 21:49:16.487111 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.185388 1034872 logs.go:138] Found kubelet problem: May 05 21:49:27 old-k8s-version-038518 kubelet[658]: E0505 21:49:27.485780 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.187799 1034872 logs.go:138] Found kubelet problem: May 05 21:49:30 old-k8s-version-038518 kubelet[658]: E0505 21:49:30.495348 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0505 21:52:01.188123 1034872 logs.go:138] Found kubelet problem: May 05 21:49:39 old-k8s-version-038518 kubelet[658]: E0505 21:49:39.485327 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.188306 1034872 logs.go:138] Found kubelet problem: May 05 21:49:44 old-k8s-version-038518 kubelet[658]: E0505 21:49:44.487616 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.188896 1034872 logs.go:138] Found kubelet problem: May 05 21:49:55 old-k8s-version-038518 kubelet[658]: E0505 21:49:55.126919 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.189217 1034872 logs.go:138] Found kubelet problem: May 05 21:49:56 old-k8s-version-038518 kubelet[658]: E0505 21:49:56.703775 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.189398 1034872 logs.go:138] Found kubelet problem: May 05 21:49:59 old-k8s-version-038518 kubelet[658]: E0505 21:49:59.485980 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.189725 1034872 logs.go:138] Found kubelet problem: May 05 21:50:10 old-k8s-version-038518 kubelet[658]: E0505 21:50:10.486742 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.189908 1034872 logs.go:138] Found kubelet problem: May 05 21:50:12 old-k8s-version-038518 kubelet[658]: E0505 21:50:12.485718 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.190229 1034872 logs.go:138] Found kubelet problem: May 05 21:50:25 old-k8s-version-038518 kubelet[658]: E0505 21:50:25.485504 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.190410 1034872 logs.go:138] Found kubelet problem: May 05 21:50:26 old-k8s-version-038518 kubelet[658]: E0505 21:50:26.486167 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.190732 1034872 logs.go:138] Found kubelet problem: May 05 21:50:36 old-k8s-version-038518 kubelet[658]: E0505 21:50:36.485829 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.190923 1034872 logs.go:138] Found kubelet problem: May 05 21:50:37 old-k8s-version-038518 kubelet[658]: E0505 21:50:37.485730 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.191108 1034872 logs.go:138] Found kubelet problem: May 05 21:50:48 old-k8s-version-038518 kubelet[658]: E0505 21:50:48.486641 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.191446 1034872 logs.go:138] Found kubelet problem: May 05 21:50:51 old-k8s-version-038518 kubelet[658]: E0505 21:50:51.485413 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.191627 1034872 logs.go:138] Found kubelet problem: May 05 21:51:00 old-k8s-version-038518 kubelet[658]: E0505 21:51:00.486225 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.191948 1034872 logs.go:138] Found kubelet problem: May 05 21:51:06 old-k8s-version-038518 kubelet[658]: E0505 21:51:06.485743 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.192130 1034872 logs.go:138] Found kubelet problem: May 05 21:51:13 old-k8s-version-038518 kubelet[658]: E0505 21:51:13.485872 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.192451 1034872 logs.go:138] Found kubelet problem: May 05 21:51:20 old-k8s-version-038518 kubelet[658]: E0505 21:51:20.485385 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.192632 1034872 logs.go:138] Found kubelet problem: May 05 21:51:26 old-k8s-version-038518 kubelet[658]: E0505 21:51:26.486692 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.192955 1034872 logs.go:138] Found kubelet problem: May 05 21:51:34 old-k8s-version-038518 kubelet[658]: E0505 21:51:34.485322 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.193137 1034872 logs.go:138] Found kubelet problem: May 05 21:51:37 old-k8s-version-038518 kubelet[658]: E0505 21:51:37.485828 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.193459 1034872 logs.go:138] Found kubelet problem: May 05 21:51:46 old-k8s-version-038518 kubelet[658]: E0505 21:51:46.485958 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.193641 1034872 logs.go:138] Found kubelet problem: May 05 21:51:51 old-k8s-version-038518 kubelet[658]: E0505 21:51:51.485703 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.193978 1034872 logs.go:138] Found kubelet problem: May 05 21:51:59 old-k8s-version-038518 kubelet[658]: E0505 21:51:59.485419 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
I0505 21:52:01.193988 1034872 logs.go:123] Gathering logs for kube-apiserver [e507b898dd4977185ac9e4f35e0538853889d163fb8c2646196f755bfd9aeb50] ...
I0505 21:52:01.194006 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e507b898dd4977185ac9e4f35e0538853889d163fb8c2646196f755bfd9aeb50"
I0505 21:52:01.261024 1034872 logs.go:123] Gathering logs for etcd [580e75f9f31dafb32fc2f7dbacfb021fca77474ee298a6ed5835a83572ff441a] ...
I0505 21:52:01.261059 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 580e75f9f31dafb32fc2f7dbacfb021fca77474ee298a6ed5835a83572ff441a"
I0505 21:52:01.305242 1034872 logs.go:123] Gathering logs for coredns [718b2b382a1dbae2be4f3fe12f41a1c16ad252136b3ffd405f84c2c8dd1cb908] ...
I0505 21:52:01.305274 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 718b2b382a1dbae2be4f3fe12f41a1c16ad252136b3ffd405f84c2c8dd1cb908"
I0505 21:52:01.346601 1034872 logs.go:123] Gathering logs for kube-scheduler [0dc3b13f77012b59a798a53b123a1eb333fec5c5fef1d4e079e3060d22355c74] ...
I0505 21:52:01.346641 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0dc3b13f77012b59a798a53b123a1eb333fec5c5fef1d4e079e3060d22355c74"
I0505 21:52:01.390854 1034872 logs.go:123] Gathering logs for kube-proxy [0eedfa9ede7ada50303473ae02419af0e8e08f080f59c78fde9947be8067a50c] ...
I0505 21:52:01.390885 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0eedfa9ede7ada50303473ae02419af0e8e08f080f59c78fde9947be8067a50c"
I0505 21:52:01.455281 1034872 logs.go:123] Gathering logs for kindnet [7c36c2442ceb7ea588207eeb243a163d370cc67473ad5096314a4b9f8bf196cb] ...
I0505 21:52:01.455315 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7c36c2442ceb7ea588207eeb243a163d370cc67473ad5096314a4b9f8bf196cb"
I0505 21:52:01.493504 1034872 logs.go:123] Gathering logs for storage-provisioner [3fc65d073b431f4914e162dd4c0da74d3a8cc7f545665adbc031bd3869d1bbd2] ...
I0505 21:52:01.493535 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3fc65d073b431f4914e162dd4c0da74d3a8cc7f545665adbc031bd3869d1bbd2"
I0505 21:52:01.532013 1034872 logs.go:123] Gathering logs for containerd ...
I0505 21:52:01.532041 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0505 21:52:01.590293 1034872 logs.go:123] Gathering logs for kube-apiserver [0441347974720e9d65c1d5094d8ca940394afc2d22b6fc51a6a18f4b1ba45061] ...
I0505 21:52:01.590330 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0441347974720e9d65c1d5094d8ca940394afc2d22b6fc51a6a18f4b1ba45061"
I0505 21:52:01.658080 1034872 logs.go:123] Gathering logs for etcd [9067c10ea9a99ed6a32fe6eb91c9516cb585fb511f405daf4626d97a5236dde0] ...
I0505 21:52:01.658116 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9067c10ea9a99ed6a32fe6eb91c9516cb585fb511f405daf4626d97a5236dde0"
I0505 21:52:01.700508 1034872 logs.go:123] Gathering logs for kube-scheduler [a9b1a797d9ee2c00fbed142aaecb2de99854f0ab6cf2c751c17eb782676547d8] ...
I0505 21:52:01.700538 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a9b1a797d9ee2c00fbed142aaecb2de99854f0ab6cf2c751c17eb782676547d8"
I0505 21:52:01.744186 1034872 logs.go:123] Gathering logs for storage-provisioner [48a51b2077e2dec5b1c8092e8da9e537f72f9d962aff852c13a67a6ca472dd16] ...
I0505 21:52:01.744250 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 48a51b2077e2dec5b1c8092e8da9e537f72f9d962aff852c13a67a6ca472dd16"
I0505 21:52:01.781679 1034872 logs.go:123] Gathering logs for dmesg ...
I0505 21:52:01.781707 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0505 21:52:01.800549 1034872 logs.go:123] Gathering logs for kube-proxy [64ef7f857a2f76b261914c70bce060b265f43d38371ea0ca161a99a9d7c3ef2d] ...
I0505 21:52:01.800582 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 64ef7f857a2f76b261914c70bce060b265f43d38371ea0ca161a99a9d7c3ef2d"
I0505 21:52:01.837931 1034872 logs.go:123] Gathering logs for kindnet [faa0225deba398d4a6dbde18c4021422a8598fa18e0944489f35b4a7564593a9] ...
I0505 21:52:01.837957 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 faa0225deba398d4a6dbde18c4021422a8598fa18e0944489f35b4a7564593a9"
I0505 21:52:01.891084 1034872 logs.go:123] Gathering logs for kubernetes-dashboard [e84d32f53ec5f8ce10bda8f22df215950b0a08e1924b9f83fa3e62918c0878b0] ...
I0505 21:52:01.891117 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e84d32f53ec5f8ce10bda8f22df215950b0a08e1924b9f83fa3e62918c0878b0"
I0505 21:52:01.935141 1034872 logs.go:123] Gathering logs for container status ...
I0505 21:52:01.935172 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0505 21:52:01.979531 1034872 logs.go:123] Gathering logs for describe nodes ...
I0505 21:52:01.979563 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0505 21:52:02.125025 1034872 logs.go:123] Gathering logs for coredns [00a9d52255afbc7a5af4b434524704f295b6b305ad9e0f1f57cb51ebc317a563] ...
I0505 21:52:02.125058 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 00a9d52255afbc7a5af4b434524704f295b6b305ad9e0f1f57cb51ebc317a563"
I0505 21:52:02.162482 1034872 out.go:304] Setting ErrFile to fd 2...
I0505 21:52:02.162560 1034872 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0505 21:52:02.162641 1034872 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0505 21:52:02.162682 1034872 out.go:239] May 05 21:51:34 old-k8s-version-038518 kubelet[658]: E0505 21:51:34.485322 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
May 05 21:51:34 old-k8s-version-038518 kubelet[658]: E0505 21:51:34.485322 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:02.162718 1034872 out.go:239] May 05 21:51:37 old-k8s-version-038518 kubelet[658]: E0505 21:51:37.485828 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 05 21:51:37 old-k8s-version-038518 kubelet[658]: E0505 21:51:37.485828 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:02.162797 1034872 out.go:239] May 05 21:51:46 old-k8s-version-038518 kubelet[658]: E0505 21:51:46.485958 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
May 05 21:51:46 old-k8s-version-038518 kubelet[658]: E0505 21:51:46.485958 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:02.162839 1034872 out.go:239] May 05 21:51:51 old-k8s-version-038518 kubelet[658]: E0505 21:51:51.485703 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 05 21:51:51 old-k8s-version-038518 kubelet[658]: E0505 21:51:51.485703 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:02.162883 1034872 out.go:239] May 05 21:51:59 old-k8s-version-038518 kubelet[658]: E0505 21:51:59.485419 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
May 05 21:51:59 old-k8s-version-038518 kubelet[658]: E0505 21:51:59.485419 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
I0505 21:52:02.163166 1034872 out.go:304] Setting ErrFile to fd 2...
I0505 21:52:02.163198 1034872 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0505 21:52:12.164354 1034872 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0505 21:52:12.185776 1034872 api_server.go:72] duration metric: took 5m51.717626471s to wait for apiserver process to appear ...
I0505 21:52:12.185810 1034872 api_server.go:88] waiting for apiserver healthz status ...
I0505 21:52:12.185850 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0505 21:52:12.185922 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0505 21:52:12.249087 1034872 cri.go:89] found id: "e507b898dd4977185ac9e4f35e0538853889d163fb8c2646196f755bfd9aeb50"
I0505 21:52:12.249111 1034872 cri.go:89] found id: "0441347974720e9d65c1d5094d8ca940394afc2d22b6fc51a6a18f4b1ba45061"
I0505 21:52:12.249133 1034872 cri.go:89] found id: ""
I0505 21:52:12.249141 1034872 logs.go:276] 2 containers: [e507b898dd4977185ac9e4f35e0538853889d163fb8c2646196f755bfd9aeb50 0441347974720e9d65c1d5094d8ca940394afc2d22b6fc51a6a18f4b1ba45061]
I0505 21:52:12.249213 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.254264 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.259756 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0505 21:52:12.259849 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0505 21:52:12.320725 1034872 cri.go:89] found id: "580e75f9f31dafb32fc2f7dbacfb021fca77474ee298a6ed5835a83572ff441a"
I0505 21:52:12.320750 1034872 cri.go:89] found id: "9067c10ea9a99ed6a32fe6eb91c9516cb585fb511f405daf4626d97a5236dde0"
I0505 21:52:12.320755 1034872 cri.go:89] found id: ""
I0505 21:52:12.320762 1034872 logs.go:276] 2 containers: [580e75f9f31dafb32fc2f7dbacfb021fca77474ee298a6ed5835a83572ff441a 9067c10ea9a99ed6a32fe6eb91c9516cb585fb511f405daf4626d97a5236dde0]
I0505 21:52:12.320837 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.325724 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.330394 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0505 21:52:12.330465 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0505 21:52:12.397243 1034872 cri.go:89] found id: "00a9d52255afbc7a5af4b434524704f295b6b305ad9e0f1f57cb51ebc317a563"
I0505 21:52:12.397337 1034872 cri.go:89] found id: "718b2b382a1dbae2be4f3fe12f41a1c16ad252136b3ffd405f84c2c8dd1cb908"
I0505 21:52:12.397364 1034872 cri.go:89] found id: ""
I0505 21:52:12.397385 1034872 logs.go:276] 2 containers: [00a9d52255afbc7a5af4b434524704f295b6b305ad9e0f1f57cb51ebc317a563 718b2b382a1dbae2be4f3fe12f41a1c16ad252136b3ffd405f84c2c8dd1cb908]
I0505 21:52:12.397478 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.402689 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.407254 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0505 21:52:12.407420 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0505 21:52:12.470078 1034872 cri.go:89] found id: "a9b1a797d9ee2c00fbed142aaecb2de99854f0ab6cf2c751c17eb782676547d8"
I0505 21:52:12.470169 1034872 cri.go:89] found id: "0dc3b13f77012b59a798a53b123a1eb333fec5c5fef1d4e079e3060d22355c74"
I0505 21:52:12.470190 1034872 cri.go:89] found id: ""
I0505 21:52:12.470211 1034872 logs.go:276] 2 containers: [a9b1a797d9ee2c00fbed142aaecb2de99854f0ab6cf2c751c17eb782676547d8 0dc3b13f77012b59a798a53b123a1eb333fec5c5fef1d4e079e3060d22355c74]
I0505 21:52:12.470324 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.475205 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.479723 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0505 21:52:12.479872 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0505 21:52:12.546150 1034872 cri.go:89] found id: "0eedfa9ede7ada50303473ae02419af0e8e08f080f59c78fde9947be8067a50c"
I0505 21:52:12.546223 1034872 cri.go:89] found id: "64ef7f857a2f76b261914c70bce060b265f43d38371ea0ca161a99a9d7c3ef2d"
I0505 21:52:12.546242 1034872 cri.go:89] found id: ""
I0505 21:52:12.546264 1034872 logs.go:276] 2 containers: [0eedfa9ede7ada50303473ae02419af0e8e08f080f59c78fde9947be8067a50c 64ef7f857a2f76b261914c70bce060b265f43d38371ea0ca161a99a9d7c3ef2d]
I0505 21:52:12.546357 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.550460 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.554574 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0505 21:52:12.554694 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0505 21:52:12.606973 1034872 cri.go:89] found id: "a288efd4ebd942b45a3ca58128b3e8296d0e2c8fda2cd9104f1c23acb6ebdca9"
I0505 21:52:12.607049 1034872 cri.go:89] found id: "6a301dfa69e35bc9c7dfd957f9098189bef6c3a23dfdee95d5dfe176ee47a84e"
I0505 21:52:12.607068 1034872 cri.go:89] found id: ""
I0505 21:52:12.607092 1034872 logs.go:276] 2 containers: [a288efd4ebd942b45a3ca58128b3e8296d0e2c8fda2cd9104f1c23acb6ebdca9 6a301dfa69e35bc9c7dfd957f9098189bef6c3a23dfdee95d5dfe176ee47a84e]
I0505 21:52:12.607178 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.611485 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.615587 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0505 21:52:12.615742 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0505 21:52:12.673585 1034872 cri.go:89] found id: "faa0225deba398d4a6dbde18c4021422a8598fa18e0944489f35b4a7564593a9"
I0505 21:52:12.673668 1034872 cri.go:89] found id: "7c36c2442ceb7ea588207eeb243a163d370cc67473ad5096314a4b9f8bf196cb"
I0505 21:52:12.673688 1034872 cri.go:89] found id: ""
I0505 21:52:12.673727 1034872 logs.go:276] 2 containers: [faa0225deba398d4a6dbde18c4021422a8598fa18e0944489f35b4a7564593a9 7c36c2442ceb7ea588207eeb243a163d370cc67473ad5096314a4b9f8bf196cb]
I0505 21:52:12.673802 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.679682 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.683578 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0505 21:52:12.683711 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0505 21:52:12.779520 1034872 cri.go:89] found id: "48a51b2077e2dec5b1c8092e8da9e537f72f9d962aff852c13a67a6ca472dd16"
I0505 21:52:12.779593 1034872 cri.go:89] found id: "3fc65d073b431f4914e162dd4c0da74d3a8cc7f545665adbc031bd3869d1bbd2"
I0505 21:52:12.779612 1034872 cri.go:89] found id: ""
I0505 21:52:12.779635 1034872 logs.go:276] 2 containers: [48a51b2077e2dec5b1c8092e8da9e537f72f9d962aff852c13a67a6ca472dd16 3fc65d073b431f4914e162dd4c0da74d3a8cc7f545665adbc031bd3869d1bbd2]
I0505 21:52:12.779715 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.783554 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.789343 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0505 21:52:12.789461 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0505 21:52:12.856607 1034872 cri.go:89] found id: "e84d32f53ec5f8ce10bda8f22df215950b0a08e1924b9f83fa3e62918c0878b0"
I0505 21:52:12.856682 1034872 cri.go:89] found id: ""
I0505 21:52:12.856703 1034872 logs.go:276] 1 containers: [e84d32f53ec5f8ce10bda8f22df215950b0a08e1924b9f83fa3e62918c0878b0]
I0505 21:52:12.856793 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.861138 1034872 logs.go:123] Gathering logs for kube-proxy [0eedfa9ede7ada50303473ae02419af0e8e08f080f59c78fde9947be8067a50c] ...
I0505 21:52:12.861211 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0eedfa9ede7ada50303473ae02419af0e8e08f080f59c78fde9947be8067a50c"
I0505 21:52:12.946552 1034872 logs.go:123] Gathering logs for kube-proxy [64ef7f857a2f76b261914c70bce060b265f43d38371ea0ca161a99a9d7c3ef2d] ...
I0505 21:52:12.946654 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 64ef7f857a2f76b261914c70bce060b265f43d38371ea0ca161a99a9d7c3ef2d"
I0505 21:52:13.005335 1034872 logs.go:123] Gathering logs for kube-controller-manager [a288efd4ebd942b45a3ca58128b3e8296d0e2c8fda2cd9104f1c23acb6ebdca9] ...
I0505 21:52:13.005411 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a288efd4ebd942b45a3ca58128b3e8296d0e2c8fda2cd9104f1c23acb6ebdca9"
I0505 21:52:13.141874 1034872 logs.go:123] Gathering logs for kindnet [faa0225deba398d4a6dbde18c4021422a8598fa18e0944489f35b4a7564593a9] ...
I0505 21:52:13.141918 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 faa0225deba398d4a6dbde18c4021422a8598fa18e0944489f35b4a7564593a9"
I0505 21:52:13.207611 1034872 logs.go:123] Gathering logs for container status ...
I0505 21:52:13.207685 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0505 21:52:13.282122 1034872 logs.go:123] Gathering logs for kube-apiserver [e507b898dd4977185ac9e4f35e0538853889d163fb8c2646196f755bfd9aeb50] ...
I0505 21:52:13.282250 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e507b898dd4977185ac9e4f35e0538853889d163fb8c2646196f755bfd9aeb50"
I0505 21:52:13.355443 1034872 logs.go:123] Gathering logs for kube-scheduler [a9b1a797d9ee2c00fbed142aaecb2de99854f0ab6cf2c751c17eb782676547d8] ...
I0505 21:52:13.355525 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a9b1a797d9ee2c00fbed142aaecb2de99854f0ab6cf2c751c17eb782676547d8"
I0505 21:52:13.414114 1034872 logs.go:123] Gathering logs for kube-controller-manager [6a301dfa69e35bc9c7dfd957f9098189bef6c3a23dfdee95d5dfe176ee47a84e] ...
I0505 21:52:13.414149 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6a301dfa69e35bc9c7dfd957f9098189bef6c3a23dfdee95d5dfe176ee47a84e"
I0505 21:52:13.495538 1034872 logs.go:123] Gathering logs for kindnet [7c36c2442ceb7ea588207eeb243a163d370cc67473ad5096314a4b9f8bf196cb] ...
I0505 21:52:13.495618 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7c36c2442ceb7ea588207eeb243a163d370cc67473ad5096314a4b9f8bf196cb"
I0505 21:52:13.578755 1034872 logs.go:123] Gathering logs for kube-apiserver [0441347974720e9d65c1d5094d8ca940394afc2d22b6fc51a6a18f4b1ba45061] ...
I0505 21:52:13.578836 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0441347974720e9d65c1d5094d8ca940394afc2d22b6fc51a6a18f4b1ba45061"
I0505 21:52:13.662367 1034872 logs.go:123] Gathering logs for describe nodes ...
I0505 21:52:13.662445 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0505 21:52:13.840680 1034872 logs.go:123] Gathering logs for etcd [9067c10ea9a99ed6a32fe6eb91c9516cb585fb511f405daf4626d97a5236dde0] ...
I0505 21:52:13.840713 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9067c10ea9a99ed6a32fe6eb91c9516cb585fb511f405daf4626d97a5236dde0"
I0505 21:52:13.890585 1034872 logs.go:123] Gathering logs for coredns [718b2b382a1dbae2be4f3fe12f41a1c16ad252136b3ffd405f84c2c8dd1cb908] ...
I0505 21:52:13.890717 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 718b2b382a1dbae2be4f3fe12f41a1c16ad252136b3ffd405f84c2c8dd1cb908"
I0505 21:52:13.955789 1034872 logs.go:123] Gathering logs for kube-scheduler [0dc3b13f77012b59a798a53b123a1eb333fec5c5fef1d4e079e3060d22355c74] ...
I0505 21:52:13.955870 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0dc3b13f77012b59a798a53b123a1eb333fec5c5fef1d4e079e3060d22355c74"
I0505 21:52:14.012782 1034872 logs.go:123] Gathering logs for storage-provisioner [48a51b2077e2dec5b1c8092e8da9e537f72f9d962aff852c13a67a6ca472dd16] ...
I0505 21:52:14.012816 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 48a51b2077e2dec5b1c8092e8da9e537f72f9d962aff852c13a67a6ca472dd16"
I0505 21:52:14.058127 1034872 logs.go:123] Gathering logs for dmesg ...
I0505 21:52:14.058156 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0505 21:52:14.078372 1034872 logs.go:123] Gathering logs for etcd [580e75f9f31dafb32fc2f7dbacfb021fca77474ee298a6ed5835a83572ff441a] ...
I0505 21:52:14.078461 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 580e75f9f31dafb32fc2f7dbacfb021fca77474ee298a6ed5835a83572ff441a"
I0505 21:52:14.141503 1034872 logs.go:123] Gathering logs for coredns [00a9d52255afbc7a5af4b434524704f295b6b305ad9e0f1f57cb51ebc317a563] ...
I0505 21:52:14.141581 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 00a9d52255afbc7a5af4b434524704f295b6b305ad9e0f1f57cb51ebc317a563"
I0505 21:52:14.194614 1034872 logs.go:123] Gathering logs for storage-provisioner [3fc65d073b431f4914e162dd4c0da74d3a8cc7f545665adbc031bd3869d1bbd2] ...
I0505 21:52:14.194640 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3fc65d073b431f4914e162dd4c0da74d3a8cc7f545665adbc031bd3869d1bbd2"
I0505 21:52:14.247067 1034872 logs.go:123] Gathering logs for kubernetes-dashboard [e84d32f53ec5f8ce10bda8f22df215950b0a08e1924b9f83fa3e62918c0878b0] ...
I0505 21:52:14.247092 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e84d32f53ec5f8ce10bda8f22df215950b0a08e1924b9f83fa3e62918c0878b0"
I0505 21:52:14.300631 1034872 logs.go:123] Gathering logs for containerd ...
I0505 21:52:14.300706 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0505 21:52:14.384868 1034872 logs.go:123] Gathering logs for kubelet ...
I0505 21:52:14.384987 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0505 21:52:14.448591 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.362969 658 reflector.go:138] object-"kube-system"/"storage-provisioner-token-2246n": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-2246n" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:14.450055 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.364071 658 reflector.go:138] object-"kube-system"/"kube-proxy-token-kvlt6": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-kvlt6" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:14.450325 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.392090 658 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:14.450621 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.392198 658 reflector.go:138] object-"kube-system"/"kindnet-token-6nwjh": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-6nwjh" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:14.450934 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.392264 658 reflector.go:138] object-"kube-system"/"coredns-token-kbxdj": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-kbxdj" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:14.451166 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.392330 658 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:14.456428 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.536174 658 reflector.go:138] object-"default"/"default-token-xtgrf": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-xtgrf" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:14.456707 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.536174 658 reflector.go:138] object-"kube-system"/"metrics-server-token-77bv5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-77bv5" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:14.466305 1034872 logs.go:138] Found kubelet problem: May 05 21:46:38 old-k8s-version-038518 kubelet[658]: E0505 21:46:38.675127 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0505 21:52:14.467847 1034872 logs.go:138] Found kubelet problem: May 05 21:46:39 old-k8s-version-038518 kubelet[658]: E0505 21:46:39.593155 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.471602 1034872 logs.go:138] Found kubelet problem: May 05 21:46:53 old-k8s-version-038518 kubelet[658]: E0505 21:46:53.494945 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0505 21:52:14.473752 1034872 logs.go:138] Found kubelet problem: May 05 21:47:00 old-k8s-version-038518 kubelet[658]: E0505 21:47:00.699177 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.474144 1034872 logs.go:138] Found kubelet problem: May 05 21:47:01 old-k8s-version-038518 kubelet[658]: E0505 21:47:01.687241 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.474602 1034872 logs.go:138] Found kubelet problem: May 05 21:47:06 old-k8s-version-038518 kubelet[658]: E0505 21:47:06.703880 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.475630 1034872 logs.go:138] Found kubelet problem: May 05 21:47:07 old-k8s-version-038518 kubelet[658]: E0505 21:47:07.485645 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.476214 1034872 logs.go:138] Found kubelet problem: May 05 21:47:08 old-k8s-version-038518 kubelet[658]: E0505 21:47:08.728799 658 pod_workers.go:191] Error syncing pod 3b3b675d-496d-431d-8171-51d0320491be ("storage-provisioner_kube-system(3b3b675d-496d-431d-8171-51d0320491be)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(3b3b675d-496d-431d-8171-51d0320491be)"
W0505 21:52:14.482149 1034872 logs.go:138] Found kubelet problem: May 05 21:47:19 old-k8s-version-038518 kubelet[658]: E0505 21:47:19.494034 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0505 21:52:14.482675 1034872 logs.go:138] Found kubelet problem: May 05 21:47:19 old-k8s-version-038518 kubelet[658]: E0505 21:47:19.762150 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.483194 1034872 logs.go:138] Found kubelet problem: May 05 21:47:26 old-k8s-version-038518 kubelet[658]: E0505 21:47:26.703935 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.483405 1034872 logs.go:138] Found kubelet problem: May 05 21:47:30 old-k8s-version-038518 kubelet[658]: E0505 21:47:30.485820 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.484041 1034872 logs.go:138] Found kubelet problem: May 05 21:47:41 old-k8s-version-038518 kubelet[658]: E0505 21:47:41.822533 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.484256 1034872 logs.go:138] Found kubelet problem: May 05 21:47:43 old-k8s-version-038518 kubelet[658]: E0505 21:47:43.485594 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.486463 1034872 logs.go:138] Found kubelet problem: May 05 21:47:46 old-k8s-version-038518 kubelet[658]: E0505 21:47:46.704245 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.486708 1034872 logs.go:138] Found kubelet problem: May 05 21:47:57 old-k8s-version-038518 kubelet[658]: E0505 21:47:57.485753 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.487133 1034872 logs.go:138] Found kubelet problem: May 05 21:47:59 old-k8s-version-038518 kubelet[658]: E0505 21:47:59.485321 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.489578 1034872 logs.go:138] Found kubelet problem: May 05 21:48:09 old-k8s-version-038518 kubelet[658]: E0505 21:48:09.493238 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0505 21:52:14.489940 1034872 logs.go:138] Found kubelet problem: May 05 21:48:14 old-k8s-version-038518 kubelet[658]: E0505 21:48:14.485469 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.490151 1034872 logs.go:138] Found kubelet problem: May 05 21:48:21 old-k8s-version-038518 kubelet[658]: E0505 21:48:21.485674 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.490785 1034872 logs.go:138] Found kubelet problem: May 05 21:48:25 old-k8s-version-038518 kubelet[658]: E0505 21:48:25.932847 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.491140 1034872 logs.go:138] Found kubelet problem: May 05 21:48:26 old-k8s-version-038518 kubelet[658]: E0505 21:48:26.940259 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.491350 1034872 logs.go:138] Found kubelet problem: May 05 21:48:33 old-k8s-version-038518 kubelet[658]: E0505 21:48:33.485713 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.491704 1034872 logs.go:138] Found kubelet problem: May 05 21:48:40 old-k8s-version-038518 kubelet[658]: E0505 21:48:40.485993 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.491914 1034872 logs.go:138] Found kubelet problem: May 05 21:48:48 old-k8s-version-038518 kubelet[658]: E0505 21:48:48.487195 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.494527 1034872 logs.go:138] Found kubelet problem: May 05 21:48:52 old-k8s-version-038518 kubelet[658]: E0505 21:48:52.485993 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.494779 1034872 logs.go:138] Found kubelet problem: May 05 21:49:01 old-k8s-version-038518 kubelet[658]: E0505 21:49:01.485651 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.495149 1034872 logs.go:138] Found kubelet problem: May 05 21:49:04 old-k8s-version-038518 kubelet[658]: E0505 21:49:04.485476 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.495505 1034872 logs.go:138] Found kubelet problem: May 05 21:49:16 old-k8s-version-038518 kubelet[658]: E0505 21:49:16.485864 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.495715 1034872 logs.go:138] Found kubelet problem: May 05 21:49:16 old-k8s-version-038518 kubelet[658]: E0505 21:49:16.487111 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.496067 1034872 logs.go:138] Found kubelet problem: May 05 21:49:27 old-k8s-version-038518 kubelet[658]: E0505 21:49:27.485780 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.498525 1034872 logs.go:138] Found kubelet problem: May 05 21:49:30 old-k8s-version-038518 kubelet[658]: E0505 21:49:30.495348 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0505 21:52:14.498886 1034872 logs.go:138] Found kubelet problem: May 05 21:49:39 old-k8s-version-038518 kubelet[658]: E0505 21:49:39.485327 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.499097 1034872 logs.go:138] Found kubelet problem: May 05 21:49:44 old-k8s-version-038518 kubelet[658]: E0505 21:49:44.487616 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.499709 1034872 logs.go:138] Found kubelet problem: May 05 21:49:55 old-k8s-version-038518 kubelet[658]: E0505 21:49:55.126919 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.500062 1034872 logs.go:138] Found kubelet problem: May 05 21:49:56 old-k8s-version-038518 kubelet[658]: E0505 21:49:56.703775 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.500498 1034872 logs.go:138] Found kubelet problem: May 05 21:49:59 old-k8s-version-038518 kubelet[658]: E0505 21:49:59.485980 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.500852 1034872 logs.go:138] Found kubelet problem: May 05 21:50:10 old-k8s-version-038518 kubelet[658]: E0505 21:50:10.486742 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.501081 1034872 logs.go:138] Found kubelet problem: May 05 21:50:12 old-k8s-version-038518 kubelet[658]: E0505 21:50:12.485718 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.501434 1034872 logs.go:138] Found kubelet problem: May 05 21:50:25 old-k8s-version-038518 kubelet[658]: E0505 21:50:25.485504 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.501719 1034872 logs.go:138] Found kubelet problem: May 05 21:50:26 old-k8s-version-038518 kubelet[658]: E0505 21:50:26.486167 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.502078 1034872 logs.go:138] Found kubelet problem: May 05 21:50:36 old-k8s-version-038518 kubelet[658]: E0505 21:50:36.485829 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.502288 1034872 logs.go:138] Found kubelet problem: May 05 21:50:37 old-k8s-version-038518 kubelet[658]: E0505 21:50:37.485730 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.502502 1034872 logs.go:138] Found kubelet problem: May 05 21:50:48 old-k8s-version-038518 kubelet[658]: E0505 21:50:48.486641 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.502900 1034872 logs.go:138] Found kubelet problem: May 05 21:50:51 old-k8s-version-038518 kubelet[658]: E0505 21:50:51.485413 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.503174 1034872 logs.go:138] Found kubelet problem: May 05 21:51:00 old-k8s-version-038518 kubelet[658]: E0505 21:51:00.486225 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.503620 1034872 logs.go:138] Found kubelet problem: May 05 21:51:06 old-k8s-version-038518 kubelet[658]: E0505 21:51:06.485743 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.503842 1034872 logs.go:138] Found kubelet problem: May 05 21:51:13 old-k8s-version-038518 kubelet[658]: E0505 21:51:13.485872 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.504202 1034872 logs.go:138] Found kubelet problem: May 05 21:51:20 old-k8s-version-038518 kubelet[658]: E0505 21:51:20.485385 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.504460 1034872 logs.go:138] Found kubelet problem: May 05 21:51:26 old-k8s-version-038518 kubelet[658]: E0505 21:51:26.486692 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.504822 1034872 logs.go:138] Found kubelet problem: May 05 21:51:34 old-k8s-version-038518 kubelet[658]: E0505 21:51:34.485322 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.505039 1034872 logs.go:138] Found kubelet problem: May 05 21:51:37 old-k8s-version-038518 kubelet[658]: E0505 21:51:37.485828 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.505390 1034872 logs.go:138] Found kubelet problem: May 05 21:51:46 old-k8s-version-038518 kubelet[658]: E0505 21:51:46.485958 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.505611 1034872 logs.go:138] Found kubelet problem: May 05 21:51:51 old-k8s-version-038518 kubelet[658]: E0505 21:51:51.485703 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.505963 1034872 logs.go:138] Found kubelet problem: May 05 21:51:59 old-k8s-version-038518 kubelet[658]: E0505 21:51:59.485419 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.506182 1034872 logs.go:138] Found kubelet problem: May 05 21:52:04 old-k8s-version-038518 kubelet[658]: E0505 21:52:04.489232 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.506532 1034872 logs.go:138] Found kubelet problem: May 05 21:52:13 old-k8s-version-038518 kubelet[658]: E0505 21:52:13.485407 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
I0505 21:52:14.506568 1034872 out.go:304] Setting ErrFile to fd 2...
I0505 21:52:14.506593 1034872 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0505 21:52:14.506731 1034872 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0505 21:52:14.506834 1034872 out.go:239] May 05 21:51:46 old-k8s-version-038518 kubelet[658]: E0505 21:51:46.485958 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
May 05 21:51:46 old-k8s-version-038518 kubelet[658]: E0505 21:51:46.485958 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.506879 1034872 out.go:239] May 05 21:51:51 old-k8s-version-038518 kubelet[658]: E0505 21:51:51.485703 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 05 21:51:51 old-k8s-version-038518 kubelet[658]: E0505 21:51:51.485703 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.506909 1034872 out.go:239] May 05 21:51:59 old-k8s-version-038518 kubelet[658]: E0505 21:51:59.485419 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
May 05 21:51:59 old-k8s-version-038518 kubelet[658]: E0505 21:51:59.485419 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.506952 1034872 out.go:239] May 05 21:52:04 old-k8s-version-038518 kubelet[658]: E0505 21:52:04.489232 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 05 21:52:04 old-k8s-version-038518 kubelet[658]: E0505 21:52:04.489232 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.506989 1034872 out.go:239] May 05 21:52:13 old-k8s-version-038518 kubelet[658]: E0505 21:52:13.485407 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
May 05 21:52:13 old-k8s-version-038518 kubelet[658]: E0505 21:52:13.485407 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
I0505 21:52:14.507021 1034872 out.go:304] Setting ErrFile to fd 2...
I0505 21:52:14.507051 1034872 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0505 21:52:24.508272 1034872 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0505 21:52:24.524338 1034872 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0505 21:52:24.527372 1034872 out.go:177]
W0505 21:52:24.530009 1034872 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0505 21:52:24.530056 1034872 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0505 21:52:24.530074 1034872 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0505 21:52:24.530079 1034872 out.go:239] *
*
W0505 21:52:24.531028 1034872 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0505 21:52:24.534395 1034872 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-038518 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-038518
helpers_test.go:235: (dbg) docker inspect old-k8s-version-038518:
-- stdout --
[
{
"Id": "9724c5f4ed8ade76604a6565c28e9498c4256d8eabb500666ddaea3298d1618e",
"Created": "2024-05-05T21:43:15.623675131Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 1035089,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-05-05T21:46:13.267030566Z",
"FinishedAt": "2024-05-05T21:46:11.898010685Z"
},
"Image": "sha256:4533aa13d934d2be0502c1910fc7af9f0be7380359488f8c9633fd5e374b2c06",
"ResolvConfPath": "/var/lib/docker/containers/9724c5f4ed8ade76604a6565c28e9498c4256d8eabb500666ddaea3298d1618e/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/9724c5f4ed8ade76604a6565c28e9498c4256d8eabb500666ddaea3298d1618e/hostname",
"HostsPath": "/var/lib/docker/containers/9724c5f4ed8ade76604a6565c28e9498c4256d8eabb500666ddaea3298d1618e/hosts",
"LogPath": "/var/lib/docker/containers/9724c5f4ed8ade76604a6565c28e9498c4256d8eabb500666ddaea3298d1618e/9724c5f4ed8ade76604a6565c28e9498c4256d8eabb500666ddaea3298d1618e-json.log",
"Name": "/old-k8s-version-038518",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-038518:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-038518",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/e3886fb31d440be961261de2a1efcfad8944faf1319497ae83909dbb3b761b7d-init/diff:/var/lib/docker/overlay2/f68d472d8525b43f1ab8cb897fd9faa12a52b5266a8601222a506897d5f72960/diff",
"MergedDir": "/var/lib/docker/overlay2/e3886fb31d440be961261de2a1efcfad8944faf1319497ae83909dbb3b761b7d/merged",
"UpperDir": "/var/lib/docker/overlay2/e3886fb31d440be961261de2a1efcfad8944faf1319497ae83909dbb3b761b7d/diff",
"WorkDir": "/var/lib/docker/overlay2/e3886fb31d440be961261de2a1efcfad8944faf1319497ae83909dbb3b761b7d/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-038518",
"Source": "/var/lib/docker/volumes/old-k8s-version-038518/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-038518",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-038518",
"name.minikube.sigs.k8s.io": "old-k8s-version-038518",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "51936fa1662a5e17a264fc2577e1ee2b1694e9e67081bc6ecacb2a2ca6e27982",
"SandboxKey": "/var/run/docker/netns/51936fa1662a",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34178"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34177"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34174"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34176"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34175"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-038518": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:55:02",
"NetworkID": "377990ad1459567428afa48b7e06103f298fb8ddf09229e81eb24ac86ea8d5fd",
"EndpointID": "70d64a00a9ceeac4020cfd109aea8b9abbbd89675699308d186aa37544b64c88",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DriverOpts": null,
"DNSNames": [
"old-k8s-version-038518",
"9724c5f4ed8a"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-038518 -n old-k8s-version-038518
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-038518 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-038518 logs -n 25: (2.501883636s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| start | -p force-systemd-flag-351908 | force-systemd-flag-351908 | jenkins | v1.33.0 | 05 May 24 21:41 UTC | 05 May 24 21:42 UTC |
| | --memory=2048 --force-systemd | | | | | |
| | --alsologtostderr | | | | | |
| | -v=5 --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-flag-351908 | force-systemd-flag-351908 | jenkins | v1.33.0 | 05 May 24 21:42 UTC | 05 May 24 21:42 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-flag-351908 | force-systemd-flag-351908 | jenkins | v1.33.0 | 05 May 24 21:42 UTC | 05 May 24 21:42 UTC |
| start | -p cert-options-834431 | cert-options-834431 | jenkins | v1.33.0 | 05 May 24 21:42 UTC | 05 May 24 21:43 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-834431 ssh | cert-options-834431 | jenkins | v1.33.0 | 05 May 24 21:43 UTC | 05 May 24 21:43 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-834431 -- sudo | cert-options-834431 | jenkins | v1.33.0 | 05 May 24 21:43 UTC | 05 May 24 21:43 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-834431 | cert-options-834431 | jenkins | v1.33.0 | 05 May 24 21:43 UTC | 05 May 24 21:43 UTC |
| start | -p old-k8s-version-038518 | old-k8s-version-038518 | jenkins | v1.33.0 | 05 May 24 21:43 UTC | 05 May 24 21:45 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-044805 | cert-expiration-044805 | jenkins | v1.33.0 | 05 May 24 21:45 UTC | 05 May 24 21:45 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-044805 | cert-expiration-044805 | jenkins | v1.33.0 | 05 May 24 21:45 UTC | 05 May 24 21:45 UTC |
| start | -p no-preload-059814 | no-preload-059814 | jenkins | v1.33.0 | 05 May 24 21:45 UTC | 05 May 24 21:46 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.30.0 | | | | | |
| addons | enable metrics-server -p old-k8s-version-038518 | old-k8s-version-038518 | jenkins | v1.33.0 | 05 May 24 21:45 UTC | 05 May 24 21:45 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-038518 | old-k8s-version-038518 | jenkins | v1.33.0 | 05 May 24 21:45 UTC | 05 May 24 21:46 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-038518 | old-k8s-version-038518 | jenkins | v1.33.0 | 05 May 24 21:46 UTC | 05 May 24 21:46 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-038518 | old-k8s-version-038518 | jenkins | v1.33.0 | 05 May 24 21:46 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-059814 | no-preload-059814 | jenkins | v1.33.0 | 05 May 24 21:46 UTC | 05 May 24 21:46 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-059814 | no-preload-059814 | jenkins | v1.33.0 | 05 May 24 21:46 UTC | 05 May 24 21:47 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-059814 | no-preload-059814 | jenkins | v1.33.0 | 05 May 24 21:47 UTC | 05 May 24 21:47 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-059814 | no-preload-059814 | jenkins | v1.33.0 | 05 May 24 21:47 UTC | 05 May 24 21:51 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.30.0 | | | | | |
| image | no-preload-059814 image list | no-preload-059814 | jenkins | v1.33.0 | 05 May 24 21:51 UTC | 05 May 24 21:51 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-059814 | no-preload-059814 | jenkins | v1.33.0 | 05 May 24 21:51 UTC | 05 May 24 21:51 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-059814 | no-preload-059814 | jenkins | v1.33.0 | 05 May 24 21:51 UTC | 05 May 24 21:51 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-059814 | no-preload-059814 | jenkins | v1.33.0 | 05 May 24 21:51 UTC | 05 May 24 21:51 UTC |
| delete | -p no-preload-059814 | no-preload-059814 | jenkins | v1.33.0 | 05 May 24 21:51 UTC | 05 May 24 21:51 UTC |
| start | -p embed-certs-688821 | embed-certs-688821 | jenkins | v1.33.0 | 05 May 24 21:51 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.30.0 | | | | | |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/05/05 21:51:52
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.22.1 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0505 21:51:52.356921 1044903 out.go:291] Setting OutFile to fd 1 ...
I0505 21:51:52.357089 1044903 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0505 21:51:52.357119 1044903 out.go:304] Setting ErrFile to fd 2...
I0505 21:51:52.357139 1044903 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0505 21:51:52.357404 1044903 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18602-834174/.minikube/bin
I0505 21:51:52.357846 1044903 out.go:298] Setting JSON to false
I0505 21:51:52.358995 1044903 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":20059,"bootTime":1714925853,"procs":223,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0505 21:51:52.359099 1044903 start.go:139] virtualization:
I0505 21:51:52.362014 1044903 out.go:177] * [embed-certs-688821] minikube v1.33.0 on Ubuntu 20.04 (arm64)
I0505 21:51:52.363627 1044903 out.go:177] - MINIKUBE_LOCATION=18602
I0505 21:51:52.365408 1044903 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0505 21:51:52.363680 1044903 notify.go:220] Checking for updates...
I0505 21:51:52.369175 1044903 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18602-834174/kubeconfig
I0505 21:51:52.371454 1044903 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18602-834174/.minikube
I0505 21:51:52.372890 1044903 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0505 21:51:52.374570 1044903 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0505 21:51:52.376672 1044903 config.go:182] Loaded profile config "old-k8s-version-038518": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0505 21:51:52.376772 1044903 driver.go:392] Setting default libvirt URI to qemu:///system
I0505 21:51:52.396886 1044903 docker.go:122] docker version: linux-26.1.1:Docker Engine - Community
I0505 21:51:52.397012 1044903 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0505 21:51:52.462546 1044903 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:33 OomKillDisable:true NGoroutines:52 SystemTime:2024-05-05 21:51:52.452211333 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215101440 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:26.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.0]] Warnings:<nil>}}
I0505 21:51:52.462674 1044903 docker.go:295] overlay module found
I0505 21:51:52.465056 1044903 out.go:177] * Using the docker driver based on user configuration
I0505 21:51:52.466518 1044903 start.go:297] selected driver: docker
I0505 21:51:52.466536 1044903 start.go:901] validating driver "docker" against <nil>
I0505 21:51:52.466549 1044903 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0505 21:51:52.467379 1044903 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0505 21:51:52.532198 1044903 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:33 OomKillDisable:true NGoroutines:52 SystemTime:2024-05-05 21:51:52.51872088 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215101440 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:26.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.0]] Warnings:<nil>}}
I0505 21:51:52.532363 1044903 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0505 21:51:52.532597 1044903 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0505 21:51:52.534170 1044903 out.go:177] * Using Docker driver with root privileges
I0505 21:51:52.535771 1044903 cni.go:84] Creating CNI manager for ""
I0505 21:51:52.535793 1044903 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0505 21:51:52.535804 1044903 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0505 21:51:52.535881 1044903 start.go:340] cluster config:
{Name:embed-certs-688821 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:embed-certs-688821 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Stati
cIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0505 21:51:52.537723 1044903 out.go:177] * Starting "embed-certs-688821" primary control-plane node in "embed-certs-688821" cluster
I0505 21:51:52.539492 1044903 cache.go:121] Beginning downloading kic base image for docker with containerd
I0505 21:51:52.541022 1044903 out.go:177] * Pulling base image v0.0.43-1714386659-18769 ...
I0505 21:51:49.029308 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:51.531876 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:52.542565 1044903 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime containerd
I0505 21:51:52.542605 1044903 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e in local docker daemon
I0505 21:51:52.542633 1044903 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18602-834174/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-containerd-overlay2-arm64.tar.lz4
I0505 21:51:52.542643 1044903 cache.go:56] Caching tarball of preloaded images
I0505 21:51:52.542726 1044903 preload.go:173] Found /home/jenkins/minikube-integration/18602-834174/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0505 21:51:52.542736 1044903 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0 on containerd
I0505 21:51:52.542882 1044903 profile.go:143] Saving config to /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/config.json ...
I0505 21:51:52.542910 1044903 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/config.json: {Name:mk6931836746b9ca5c49edbd1493be13ca518f4d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0505 21:51:52.559613 1044903 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e in local docker daemon, skipping pull
I0505 21:51:52.559653 1044903 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e exists in daemon, skipping load
I0505 21:51:52.559676 1044903 cache.go:194] Successfully downloaded all kic artifacts
I0505 21:51:52.559776 1044903 start.go:360] acquireMachinesLock for embed-certs-688821: {Name:mkb48d4faf55749a0e9910813db2212708e0239a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0505 21:51:52.559910 1044903 start.go:364] duration metric: took 107.585µs to acquireMachinesLock for "embed-certs-688821"
I0505 21:51:52.559943 1044903 start.go:93] Provisioning new machine with config: &{Name:embed-certs-688821 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:embed-certs-688821 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableM
etrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0505 21:51:52.560037 1044903 start.go:125] createHost starting for "" (driver="docker")
I0505 21:51:52.562048 1044903 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0505 21:51:52.562303 1044903 start.go:159] libmachine.API.Create for "embed-certs-688821" (driver="docker")
I0505 21:51:52.562345 1044903 client.go:168] LocalClient.Create starting
I0505 21:51:52.562424 1044903 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18602-834174/.minikube/certs/ca.pem
I0505 21:51:52.562461 1044903 main.go:141] libmachine: Decoding PEM data...
I0505 21:51:52.562478 1044903 main.go:141] libmachine: Parsing certificate...
I0505 21:51:52.562537 1044903 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18602-834174/.minikube/certs/cert.pem
I0505 21:51:52.562554 1044903 main.go:141] libmachine: Decoding PEM data...
I0505 21:51:52.562563 1044903 main.go:141] libmachine: Parsing certificate...
I0505 21:51:52.563057 1044903 cli_runner.go:164] Run: docker network inspect embed-certs-688821 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0505 21:51:52.576844 1044903 cli_runner.go:211] docker network inspect embed-certs-688821 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0505 21:51:52.576945 1044903 network_create.go:281] running [docker network inspect embed-certs-688821] to gather additional debugging logs...
I0505 21:51:52.576965 1044903 cli_runner.go:164] Run: docker network inspect embed-certs-688821
W0505 21:51:52.590350 1044903 cli_runner.go:211] docker network inspect embed-certs-688821 returned with exit code 1
I0505 21:51:52.590384 1044903 network_create.go:284] error running [docker network inspect embed-certs-688821]: docker network inspect embed-certs-688821: exit status 1
stdout:
[]
stderr:
Error response from daemon: network embed-certs-688821 not found
I0505 21:51:52.590397 1044903 network_create.go:286] output of [docker network inspect embed-certs-688821]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network embed-certs-688821 not found
** /stderr **
I0505 21:51:52.590502 1044903 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0505 21:51:52.604981 1044903 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-04f122ea84be IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:33:34:f4:41} reservation:<nil>}
I0505 21:51:52.605600 1044903 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-ff9f9337bb39 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:8b:7e:b9:0a} reservation:<nil>}
I0505 21:51:52.605955 1044903 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-7f433ca5a3ec IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:bd:61:7a:4c} reservation:<nil>}
I0505 21:51:52.606515 1044903 network.go:206] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40027674e0}
I0505 21:51:52.606555 1044903 network_create.go:124] attempt to create docker network embed-certs-688821 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I0505 21:51:52.606622 1044903 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-688821 embed-certs-688821
I0505 21:51:52.672593 1044903 network_create.go:108] docker network embed-certs-688821 192.168.76.0/24 created
I0505 21:51:52.672633 1044903 kic.go:121] calculated static IP "192.168.76.2" for the "embed-certs-688821" container
I0505 21:51:52.672723 1044903 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0505 21:51:52.687296 1044903 cli_runner.go:164] Run: docker volume create embed-certs-688821 --label name.minikube.sigs.k8s.io=embed-certs-688821 --label created_by.minikube.sigs.k8s.io=true
I0505 21:51:52.703440 1044903 oci.go:103] Successfully created a docker volume embed-certs-688821
I0505 21:51:52.703566 1044903 cli_runner.go:164] Run: docker run --rm --name embed-certs-688821-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-688821 --entrypoint /usr/bin/test -v embed-certs-688821:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e -d /var/lib
I0505 21:51:53.358076 1044903 oci.go:107] Successfully prepared a docker volume embed-certs-688821
I0505 21:51:53.358135 1044903 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime containerd
I0505 21:51:53.358156 1044903 kic.go:194] Starting extracting preloaded images to volume ...
I0505 21:51:53.358235 1044903 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/18602-834174/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-688821:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e -I lz4 -xf /preloaded.tar -C /extractDir
I0505 21:51:53.532617 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:56.028934 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:51:58.212732 1044903 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/18602-834174/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-688821:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e -I lz4 -xf /preloaded.tar -C /extractDir: (4.854438347s)
I0505 21:51:58.212762 1044903 kic.go:203] duration metric: took 4.854601225s to extract preloaded images to volume ...
W0505 21:51:58.212902 1044903 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0505 21:51:58.213021 1044903 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0505 21:51:58.271079 1044903 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-688821 --name embed-certs-688821 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-688821 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-688821 --network embed-certs-688821 --ip 192.168.76.2 --volume embed-certs-688821:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e
I0505 21:51:58.624547 1044903 cli_runner.go:164] Run: docker container inspect embed-certs-688821 --format={{.State.Running}}
I0505 21:51:58.649958 1044903 cli_runner.go:164] Run: docker container inspect embed-certs-688821 --format={{.State.Status}}
I0505 21:51:58.669884 1044903 cli_runner.go:164] Run: docker exec embed-certs-688821 stat /var/lib/dpkg/alternatives/iptables
I0505 21:51:58.746706 1044903 oci.go:144] the created container "embed-certs-688821" has a running status.
I0505 21:51:58.746735 1044903 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/18602-834174/.minikube/machines/embed-certs-688821/id_rsa...
I0505 21:51:59.149858 1044903 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/18602-834174/.minikube/machines/embed-certs-688821/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0505 21:51:59.184616 1044903 cli_runner.go:164] Run: docker container inspect embed-certs-688821 --format={{.State.Status}}
I0505 21:51:59.206194 1044903 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0505 21:51:59.206214 1044903 kic_runner.go:114] Args: [docker exec --privileged embed-certs-688821 chown docker:docker /home/docker/.ssh/authorized_keys]
I0505 21:51:59.310854 1044903 cli_runner.go:164] Run: docker container inspect embed-certs-688821 --format={{.State.Status}}
I0505 21:51:59.341008 1044903 machine.go:94] provisionDockerMachine start ...
I0505 21:51:59.341108 1044903 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-688821
I0505 21:51:59.370511 1044903 main.go:141] libmachine: Using SSH client type: native
I0505 21:51:59.370816 1044903 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 34188 <nil> <nil>}
I0505 21:51:59.370826 1044903 main.go:141] libmachine: About to run SSH command:
hostname
I0505 21:51:59.371503 1044903 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:56646->127.0.0.1:34188: read: connection reset by peer
I0505 21:51:58.528323 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:52:00.529341 1034872 pod_ready.go:102] pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace has status "Ready":"False"
I0505 21:52:00.529376 1034872 pod_ready.go:81] duration metric: took 4m0.007260823s for pod "metrics-server-9975d5f86-chxxc" in "kube-system" namespace to be "Ready" ...
E0505 21:52:00.529388 1034872 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0505 21:52:00.529397 1034872 pod_ready.go:38] duration metric: took 5m23.791524111s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0505 21:52:00.529411 1034872 api_server.go:52] waiting for apiserver process to appear ...
I0505 21:52:00.529447 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0505 21:52:00.529516 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0505 21:52:00.570401 1034872 cri.go:89] found id: "e507b898dd4977185ac9e4f35e0538853889d163fb8c2646196f755bfd9aeb50"
I0505 21:52:00.570421 1034872 cri.go:89] found id: "0441347974720e9d65c1d5094d8ca940394afc2d22b6fc51a6a18f4b1ba45061"
I0505 21:52:00.570426 1034872 cri.go:89] found id: ""
I0505 21:52:00.570433 1034872 logs.go:276] 2 containers: [e507b898dd4977185ac9e4f35e0538853889d163fb8c2646196f755bfd9aeb50 0441347974720e9d65c1d5094d8ca940394afc2d22b6fc51a6a18f4b1ba45061]
I0505 21:52:00.570490 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.574432 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.578004 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0505 21:52:00.578083 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0505 21:52:00.616222 1034872 cri.go:89] found id: "580e75f9f31dafb32fc2f7dbacfb021fca77474ee298a6ed5835a83572ff441a"
I0505 21:52:00.616246 1034872 cri.go:89] found id: "9067c10ea9a99ed6a32fe6eb91c9516cb585fb511f405daf4626d97a5236dde0"
I0505 21:52:00.616252 1034872 cri.go:89] found id: ""
I0505 21:52:00.616258 1034872 logs.go:276] 2 containers: [580e75f9f31dafb32fc2f7dbacfb021fca77474ee298a6ed5835a83572ff441a 9067c10ea9a99ed6a32fe6eb91c9516cb585fb511f405daf4626d97a5236dde0]
I0505 21:52:00.616315 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.620626 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.624756 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0505 21:52:00.624866 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0505 21:52:00.663784 1034872 cri.go:89] found id: "00a9d52255afbc7a5af4b434524704f295b6b305ad9e0f1f57cb51ebc317a563"
I0505 21:52:00.663809 1034872 cri.go:89] found id: "718b2b382a1dbae2be4f3fe12f41a1c16ad252136b3ffd405f84c2c8dd1cb908"
I0505 21:52:00.663815 1034872 cri.go:89] found id: ""
I0505 21:52:00.663822 1034872 logs.go:276] 2 containers: [00a9d52255afbc7a5af4b434524704f295b6b305ad9e0f1f57cb51ebc317a563 718b2b382a1dbae2be4f3fe12f41a1c16ad252136b3ffd405f84c2c8dd1cb908]
I0505 21:52:00.663907 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.667561 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.670928 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0505 21:52:00.671055 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0505 21:52:00.714347 1034872 cri.go:89] found id: "a9b1a797d9ee2c00fbed142aaecb2de99854f0ab6cf2c751c17eb782676547d8"
I0505 21:52:00.714370 1034872 cri.go:89] found id: "0dc3b13f77012b59a798a53b123a1eb333fec5c5fef1d4e079e3060d22355c74"
I0505 21:52:00.714375 1034872 cri.go:89] found id: ""
I0505 21:52:00.714382 1034872 logs.go:276] 2 containers: [a9b1a797d9ee2c00fbed142aaecb2de99854f0ab6cf2c751c17eb782676547d8 0dc3b13f77012b59a798a53b123a1eb333fec5c5fef1d4e079e3060d22355c74]
I0505 21:52:00.714461 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.717889 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.721368 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0505 21:52:00.721477 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0505 21:52:00.775897 1034872 cri.go:89] found id: "0eedfa9ede7ada50303473ae02419af0e8e08f080f59c78fde9947be8067a50c"
I0505 21:52:00.775924 1034872 cri.go:89] found id: "64ef7f857a2f76b261914c70bce060b265f43d38371ea0ca161a99a9d7c3ef2d"
I0505 21:52:00.775930 1034872 cri.go:89] found id: ""
I0505 21:52:00.775937 1034872 logs.go:276] 2 containers: [0eedfa9ede7ada50303473ae02419af0e8e08f080f59c78fde9947be8067a50c 64ef7f857a2f76b261914c70bce060b265f43d38371ea0ca161a99a9d7c3ef2d]
I0505 21:52:00.775993 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.780204 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.785097 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0505 21:52:00.785165 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0505 21:52:00.826033 1034872 cri.go:89] found id: "a288efd4ebd942b45a3ca58128b3e8296d0e2c8fda2cd9104f1c23acb6ebdca9"
I0505 21:52:00.826056 1034872 cri.go:89] found id: "6a301dfa69e35bc9c7dfd957f9098189bef6c3a23dfdee95d5dfe176ee47a84e"
I0505 21:52:00.826061 1034872 cri.go:89] found id: ""
I0505 21:52:00.826069 1034872 logs.go:276] 2 containers: [a288efd4ebd942b45a3ca58128b3e8296d0e2c8fda2cd9104f1c23acb6ebdca9 6a301dfa69e35bc9c7dfd957f9098189bef6c3a23dfdee95d5dfe176ee47a84e]
I0505 21:52:00.826123 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.829684 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.832986 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0505 21:52:00.833107 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0505 21:52:00.870181 1034872 cri.go:89] found id: "faa0225deba398d4a6dbde18c4021422a8598fa18e0944489f35b4a7564593a9"
I0505 21:52:00.870208 1034872 cri.go:89] found id: "7c36c2442ceb7ea588207eeb243a163d370cc67473ad5096314a4b9f8bf196cb"
I0505 21:52:00.870213 1034872 cri.go:89] found id: ""
I0505 21:52:00.870220 1034872 logs.go:276] 2 containers: [faa0225deba398d4a6dbde18c4021422a8598fa18e0944489f35b4a7564593a9 7c36c2442ceb7ea588207eeb243a163d370cc67473ad5096314a4b9f8bf196cb]
I0505 21:52:00.870276 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.873960 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.877442 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0505 21:52:00.877525 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0505 21:52:00.923912 1034872 cri.go:89] found id: "48a51b2077e2dec5b1c8092e8da9e537f72f9d962aff852c13a67a6ca472dd16"
I0505 21:52:00.923933 1034872 cri.go:89] found id: "3fc65d073b431f4914e162dd4c0da74d3a8cc7f545665adbc031bd3869d1bbd2"
I0505 21:52:00.923937 1034872 cri.go:89] found id: ""
I0505 21:52:00.923945 1034872 logs.go:276] 2 containers: [48a51b2077e2dec5b1c8092e8da9e537f72f9d962aff852c13a67a6ca472dd16 3fc65d073b431f4914e162dd4c0da74d3a8cc7f545665adbc031bd3869d1bbd2]
I0505 21:52:00.923997 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.927484 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.930579 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0505 21:52:00.930647 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0505 21:52:00.969489 1034872 cri.go:89] found id: "e84d32f53ec5f8ce10bda8f22df215950b0a08e1924b9f83fa3e62918c0878b0"
I0505 21:52:00.969553 1034872 cri.go:89] found id: ""
I0505 21:52:00.969574 1034872 logs.go:276] 1 containers: [e84d32f53ec5f8ce10bda8f22df215950b0a08e1924b9f83fa3e62918c0878b0]
I0505 21:52:00.969673 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:00.973313 1034872 logs.go:123] Gathering logs for kube-controller-manager [a288efd4ebd942b45a3ca58128b3e8296d0e2c8fda2cd9104f1c23acb6ebdca9] ...
I0505 21:52:00.973342 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a288efd4ebd942b45a3ca58128b3e8296d0e2c8fda2cd9104f1c23acb6ebdca9"
I0505 21:52:01.034141 1034872 logs.go:123] Gathering logs for kube-controller-manager [6a301dfa69e35bc9c7dfd957f9098189bef6c3a23dfdee95d5dfe176ee47a84e] ...
I0505 21:52:01.034175 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6a301dfa69e35bc9c7dfd957f9098189bef6c3a23dfdee95d5dfe176ee47a84e"
I0505 21:52:01.107457 1034872 logs.go:123] Gathering logs for kubelet ...
I0505 21:52:01.107495 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0505 21:52:01.154099 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.362969 658 reflector.go:138] object-"kube-system"/"storage-provisioner-token-2246n": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-2246n" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:01.154420 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.364071 658 reflector.go:138] object-"kube-system"/"kube-proxy-token-kvlt6": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-kvlt6" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:01.154627 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.392090 658 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:01.154848 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.392198 658 reflector.go:138] object-"kube-system"/"kindnet-token-6nwjh": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-6nwjh" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:01.155057 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.392264 658 reflector.go:138] object-"kube-system"/"coredns-token-kbxdj": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-kbxdj" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:01.155256 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.392330 658 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:01.158861 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.536174 658 reflector.go:138] object-"default"/"default-token-xtgrf": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-xtgrf" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:01.159082 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.536174 658 reflector.go:138] object-"kube-system"/"metrics-server-token-77bv5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-77bv5" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:01.166115 1034872 logs.go:138] Found kubelet problem: May 05 21:46:38 old-k8s-version-038518 kubelet[658]: E0505 21:46:38.675127 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0505 21:52:01.167076 1034872 logs.go:138] Found kubelet problem: May 05 21:46:39 old-k8s-version-038518 kubelet[658]: E0505 21:46:39.593155 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.169834 1034872 logs.go:138] Found kubelet problem: May 05 21:46:53 old-k8s-version-038518 kubelet[658]: E0505 21:46:53.494945 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0505 21:52:01.171917 1034872 logs.go:138] Found kubelet problem: May 05 21:47:00 old-k8s-version-038518 kubelet[658]: E0505 21:47:00.699177 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.172255 1034872 logs.go:138] Found kubelet problem: May 05 21:47:01 old-k8s-version-038518 kubelet[658]: E0505 21:47:01.687241 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.172581 1034872 logs.go:138] Found kubelet problem: May 05 21:47:06 old-k8s-version-038518 kubelet[658]: E0505 21:47:06.703880 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.172769 1034872 logs.go:138] Found kubelet problem: May 05 21:47:07 old-k8s-version-038518 kubelet[658]: E0505 21:47:07.485645 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.173205 1034872 logs.go:138] Found kubelet problem: May 05 21:47:08 old-k8s-version-038518 kubelet[658]: E0505 21:47:08.728799 658 pod_workers.go:191] Error syncing pod 3b3b675d-496d-431d-8171-51d0320491be ("storage-provisioner_kube-system(3b3b675d-496d-431d-8171-51d0320491be)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(3b3b675d-496d-431d-8171-51d0320491be)"
W0505 21:52:01.176435 1034872 logs.go:138] Found kubelet problem: May 05 21:47:19 old-k8s-version-038518 kubelet[658]: E0505 21:47:19.494034 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0505 21:52:01.176895 1034872 logs.go:138] Found kubelet problem: May 05 21:47:19 old-k8s-version-038518 kubelet[658]: E0505 21:47:19.762150 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.177344 1034872 logs.go:138] Found kubelet problem: May 05 21:47:26 old-k8s-version-038518 kubelet[658]: E0505 21:47:26.703935 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.177527 1034872 logs.go:138] Found kubelet problem: May 05 21:47:30 old-k8s-version-038518 kubelet[658]: E0505 21:47:30.485820 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.178107 1034872 logs.go:138] Found kubelet problem: May 05 21:47:41 old-k8s-version-038518 kubelet[658]: E0505 21:47:41.822533 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.178291 1034872 logs.go:138] Found kubelet problem: May 05 21:47:43 old-k8s-version-038518 kubelet[658]: E0505 21:47:43.485594 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.178613 1034872 logs.go:138] Found kubelet problem: May 05 21:47:46 old-k8s-version-038518 kubelet[658]: E0505 21:47:46.704245 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.178865 1034872 logs.go:138] Found kubelet problem: May 05 21:47:57 old-k8s-version-038518 kubelet[658]: E0505 21:47:57.485753 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.179189 1034872 logs.go:138] Found kubelet problem: May 05 21:47:59 old-k8s-version-038518 kubelet[658]: E0505 21:47:59.485321 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.181593 1034872 logs.go:138] Found kubelet problem: May 05 21:48:09 old-k8s-version-038518 kubelet[658]: E0505 21:48:09.493238 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0505 21:52:01.181922 1034872 logs.go:138] Found kubelet problem: May 05 21:48:14 old-k8s-version-038518 kubelet[658]: E0505 21:48:14.485469 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.182106 1034872 logs.go:138] Found kubelet problem: May 05 21:48:21 old-k8s-version-038518 kubelet[658]: E0505 21:48:21.485674 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.182690 1034872 logs.go:138] Found kubelet problem: May 05 21:48:25 old-k8s-version-038518 kubelet[658]: E0505 21:48:25.932847 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.183019 1034872 logs.go:138] Found kubelet problem: May 05 21:48:26 old-k8s-version-038518 kubelet[658]: E0505 21:48:26.940259 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.183204 1034872 logs.go:138] Found kubelet problem: May 05 21:48:33 old-k8s-version-038518 kubelet[658]: E0505 21:48:33.485713 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.183526 1034872 logs.go:138] Found kubelet problem: May 05 21:48:40 old-k8s-version-038518 kubelet[658]: E0505 21:48:40.485993 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.183709 1034872 logs.go:138] Found kubelet problem: May 05 21:48:48 old-k8s-version-038518 kubelet[658]: E0505 21:48:48.487195 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.184053 1034872 logs.go:138] Found kubelet problem: May 05 21:48:52 old-k8s-version-038518 kubelet[658]: E0505 21:48:52.485993 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.184236 1034872 logs.go:138] Found kubelet problem: May 05 21:49:01 old-k8s-version-038518 kubelet[658]: E0505 21:49:01.485651 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.184563 1034872 logs.go:138] Found kubelet problem: May 05 21:49:04 old-k8s-version-038518 kubelet[658]: E0505 21:49:04.485476 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.184886 1034872 logs.go:138] Found kubelet problem: May 05 21:49:16 old-k8s-version-038518 kubelet[658]: E0505 21:49:16.485864 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.185067 1034872 logs.go:138] Found kubelet problem: May 05 21:49:16 old-k8s-version-038518 kubelet[658]: E0505 21:49:16.487111 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.185388 1034872 logs.go:138] Found kubelet problem: May 05 21:49:27 old-k8s-version-038518 kubelet[658]: E0505 21:49:27.485780 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.187799 1034872 logs.go:138] Found kubelet problem: May 05 21:49:30 old-k8s-version-038518 kubelet[658]: E0505 21:49:30.495348 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0505 21:52:01.188123 1034872 logs.go:138] Found kubelet problem: May 05 21:49:39 old-k8s-version-038518 kubelet[658]: E0505 21:49:39.485327 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.188306 1034872 logs.go:138] Found kubelet problem: May 05 21:49:44 old-k8s-version-038518 kubelet[658]: E0505 21:49:44.487616 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.188896 1034872 logs.go:138] Found kubelet problem: May 05 21:49:55 old-k8s-version-038518 kubelet[658]: E0505 21:49:55.126919 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.189217 1034872 logs.go:138] Found kubelet problem: May 05 21:49:56 old-k8s-version-038518 kubelet[658]: E0505 21:49:56.703775 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.189398 1034872 logs.go:138] Found kubelet problem: May 05 21:49:59 old-k8s-version-038518 kubelet[658]: E0505 21:49:59.485980 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.189725 1034872 logs.go:138] Found kubelet problem: May 05 21:50:10 old-k8s-version-038518 kubelet[658]: E0505 21:50:10.486742 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.189908 1034872 logs.go:138] Found kubelet problem: May 05 21:50:12 old-k8s-version-038518 kubelet[658]: E0505 21:50:12.485718 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.190229 1034872 logs.go:138] Found kubelet problem: May 05 21:50:25 old-k8s-version-038518 kubelet[658]: E0505 21:50:25.485504 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.190410 1034872 logs.go:138] Found kubelet problem: May 05 21:50:26 old-k8s-version-038518 kubelet[658]: E0505 21:50:26.486167 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.190732 1034872 logs.go:138] Found kubelet problem: May 05 21:50:36 old-k8s-version-038518 kubelet[658]: E0505 21:50:36.485829 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.190923 1034872 logs.go:138] Found kubelet problem: May 05 21:50:37 old-k8s-version-038518 kubelet[658]: E0505 21:50:37.485730 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.191108 1034872 logs.go:138] Found kubelet problem: May 05 21:50:48 old-k8s-version-038518 kubelet[658]: E0505 21:50:48.486641 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.191446 1034872 logs.go:138] Found kubelet problem: May 05 21:50:51 old-k8s-version-038518 kubelet[658]: E0505 21:50:51.485413 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.191627 1034872 logs.go:138] Found kubelet problem: May 05 21:51:00 old-k8s-version-038518 kubelet[658]: E0505 21:51:00.486225 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.191948 1034872 logs.go:138] Found kubelet problem: May 05 21:51:06 old-k8s-version-038518 kubelet[658]: E0505 21:51:06.485743 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.192130 1034872 logs.go:138] Found kubelet problem: May 05 21:51:13 old-k8s-version-038518 kubelet[658]: E0505 21:51:13.485872 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.192451 1034872 logs.go:138] Found kubelet problem: May 05 21:51:20 old-k8s-version-038518 kubelet[658]: E0505 21:51:20.485385 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.192632 1034872 logs.go:138] Found kubelet problem: May 05 21:51:26 old-k8s-version-038518 kubelet[658]: E0505 21:51:26.486692 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.192955 1034872 logs.go:138] Found kubelet problem: May 05 21:51:34 old-k8s-version-038518 kubelet[658]: E0505 21:51:34.485322 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.193137 1034872 logs.go:138] Found kubelet problem: May 05 21:51:37 old-k8s-version-038518 kubelet[658]: E0505 21:51:37.485828 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.193459 1034872 logs.go:138] Found kubelet problem: May 05 21:51:46 old-k8s-version-038518 kubelet[658]: E0505 21:51:46.485958 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:01.193641 1034872 logs.go:138] Found kubelet problem: May 05 21:51:51 old-k8s-version-038518 kubelet[658]: E0505 21:51:51.485703 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:01.193978 1034872 logs.go:138] Found kubelet problem: May 05 21:51:59 old-k8s-version-038518 kubelet[658]: E0505 21:51:59.485419 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
I0505 21:52:01.193988 1034872 logs.go:123] Gathering logs for kube-apiserver [e507b898dd4977185ac9e4f35e0538853889d163fb8c2646196f755bfd9aeb50] ...
I0505 21:52:01.194006 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e507b898dd4977185ac9e4f35e0538853889d163fb8c2646196f755bfd9aeb50"
I0505 21:52:01.261024 1034872 logs.go:123] Gathering logs for etcd [580e75f9f31dafb32fc2f7dbacfb021fca77474ee298a6ed5835a83572ff441a] ...
I0505 21:52:01.261059 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 580e75f9f31dafb32fc2f7dbacfb021fca77474ee298a6ed5835a83572ff441a"
I0505 21:52:01.305242 1034872 logs.go:123] Gathering logs for coredns [718b2b382a1dbae2be4f3fe12f41a1c16ad252136b3ffd405f84c2c8dd1cb908] ...
I0505 21:52:01.305274 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 718b2b382a1dbae2be4f3fe12f41a1c16ad252136b3ffd405f84c2c8dd1cb908"
I0505 21:52:01.346601 1034872 logs.go:123] Gathering logs for kube-scheduler [0dc3b13f77012b59a798a53b123a1eb333fec5c5fef1d4e079e3060d22355c74] ...
I0505 21:52:01.346641 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0dc3b13f77012b59a798a53b123a1eb333fec5c5fef1d4e079e3060d22355c74"
I0505 21:52:01.390854 1034872 logs.go:123] Gathering logs for kube-proxy [0eedfa9ede7ada50303473ae02419af0e8e08f080f59c78fde9947be8067a50c] ...
I0505 21:52:01.390885 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0eedfa9ede7ada50303473ae02419af0e8e08f080f59c78fde9947be8067a50c"
I0505 21:52:01.455281 1034872 logs.go:123] Gathering logs for kindnet [7c36c2442ceb7ea588207eeb243a163d370cc67473ad5096314a4b9f8bf196cb] ...
I0505 21:52:01.455315 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7c36c2442ceb7ea588207eeb243a163d370cc67473ad5096314a4b9f8bf196cb"
I0505 21:52:01.493504 1034872 logs.go:123] Gathering logs for storage-provisioner [3fc65d073b431f4914e162dd4c0da74d3a8cc7f545665adbc031bd3869d1bbd2] ...
I0505 21:52:01.493535 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3fc65d073b431f4914e162dd4c0da74d3a8cc7f545665adbc031bd3869d1bbd2"
I0505 21:52:01.532013 1034872 logs.go:123] Gathering logs for containerd ...
I0505 21:52:01.532041 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0505 21:52:01.590293 1034872 logs.go:123] Gathering logs for kube-apiserver [0441347974720e9d65c1d5094d8ca940394afc2d22b6fc51a6a18f4b1ba45061] ...
I0505 21:52:01.590330 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0441347974720e9d65c1d5094d8ca940394afc2d22b6fc51a6a18f4b1ba45061"
I0505 21:52:01.658080 1034872 logs.go:123] Gathering logs for etcd [9067c10ea9a99ed6a32fe6eb91c9516cb585fb511f405daf4626d97a5236dde0] ...
I0505 21:52:01.658116 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9067c10ea9a99ed6a32fe6eb91c9516cb585fb511f405daf4626d97a5236dde0"
I0505 21:52:01.700508 1034872 logs.go:123] Gathering logs for kube-scheduler [a9b1a797d9ee2c00fbed142aaecb2de99854f0ab6cf2c751c17eb782676547d8] ...
I0505 21:52:01.700538 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a9b1a797d9ee2c00fbed142aaecb2de99854f0ab6cf2c751c17eb782676547d8"
I0505 21:52:01.744186 1034872 logs.go:123] Gathering logs for storage-provisioner [48a51b2077e2dec5b1c8092e8da9e537f72f9d962aff852c13a67a6ca472dd16] ...
I0505 21:52:01.744250 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 48a51b2077e2dec5b1c8092e8da9e537f72f9d962aff852c13a67a6ca472dd16"
I0505 21:52:01.781679 1034872 logs.go:123] Gathering logs for dmesg ...
I0505 21:52:01.781707 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0505 21:52:01.800549 1034872 logs.go:123] Gathering logs for kube-proxy [64ef7f857a2f76b261914c70bce060b265f43d38371ea0ca161a99a9d7c3ef2d] ...
I0505 21:52:01.800582 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 64ef7f857a2f76b261914c70bce060b265f43d38371ea0ca161a99a9d7c3ef2d"
I0505 21:52:01.837931 1034872 logs.go:123] Gathering logs for kindnet [faa0225deba398d4a6dbde18c4021422a8598fa18e0944489f35b4a7564593a9] ...
I0505 21:52:01.837957 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 faa0225deba398d4a6dbde18c4021422a8598fa18e0944489f35b4a7564593a9"
I0505 21:52:01.891084 1034872 logs.go:123] Gathering logs for kubernetes-dashboard [e84d32f53ec5f8ce10bda8f22df215950b0a08e1924b9f83fa3e62918c0878b0] ...
I0505 21:52:01.891117 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e84d32f53ec5f8ce10bda8f22df215950b0a08e1924b9f83fa3e62918c0878b0"
I0505 21:52:01.935141 1034872 logs.go:123] Gathering logs for container status ...
I0505 21:52:01.935172 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0505 21:52:01.979531 1034872 logs.go:123] Gathering logs for describe nodes ...
I0505 21:52:01.979563 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0505 21:52:02.125025 1034872 logs.go:123] Gathering logs for coredns [00a9d52255afbc7a5af4b434524704f295b6b305ad9e0f1f57cb51ebc317a563] ...
I0505 21:52:02.125058 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 00a9d52255afbc7a5af4b434524704f295b6b305ad9e0f1f57cb51ebc317a563"
I0505 21:52:02.162482 1034872 out.go:304] Setting ErrFile to fd 2...
I0505 21:52:02.162560 1034872 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0505 21:52:02.162641 1034872 out.go:239] X Problems detected in kubelet:
W0505 21:52:02.162682 1034872 out.go:239] May 05 21:51:34 old-k8s-version-038518 kubelet[658]: E0505 21:51:34.485322 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:02.162718 1034872 out.go:239] May 05 21:51:37 old-k8s-version-038518 kubelet[658]: E0505 21:51:37.485828 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:02.162797 1034872 out.go:239] May 05 21:51:46 old-k8s-version-038518 kubelet[658]: E0505 21:51:46.485958 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:02.162839 1034872 out.go:239] May 05 21:51:51 old-k8s-version-038518 kubelet[658]: E0505 21:51:51.485703 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:02.162883 1034872 out.go:239] May 05 21:51:59 old-k8s-version-038518 kubelet[658]: E0505 21:51:59.485419 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
I0505 21:52:02.163166 1034872 out.go:304] Setting ErrFile to fd 2...
I0505 21:52:02.163198 1034872 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0505 21:52:02.511412 1044903 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-688821
I0505 21:52:02.511433 1044903 ubuntu.go:169] provisioning hostname "embed-certs-688821"
I0505 21:52:02.511500 1044903 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-688821
I0505 21:52:02.530259 1044903 main.go:141] libmachine: Using SSH client type: native
I0505 21:52:02.530508 1044903 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 34188 <nil> <nil>}
I0505 21:52:02.530519 1044903 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-688821 && echo "embed-certs-688821" | sudo tee /etc/hostname
I0505 21:52:02.684180 1044903 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-688821
I0505 21:52:02.684260 1044903 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-688821
I0505 21:52:02.701029 1044903 main.go:141] libmachine: Using SSH client type: native
I0505 21:52:02.701282 1044903 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 34188 <nil> <nil>}
I0505 21:52:02.701305 1044903 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-688821' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-688821/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-688821' | sudo tee -a /etc/hosts;
fi
fi
I0505 21:52:02.838990 1044903 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0505 21:52:02.839016 1044903 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18602-834174/.minikube CaCertPath:/home/jenkins/minikube-integration/18602-834174/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18602-834174/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18602-834174/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18602-834174/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18602-834174/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18602-834174/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18602-834174/.minikube}
I0505 21:52:02.839046 1044903 ubuntu.go:177] setting up certificates
I0505 21:52:02.839054 1044903 provision.go:84] configureAuth start
I0505 21:52:02.839116 1044903 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-688821
I0505 21:52:02.856003 1044903 provision.go:143] copyHostCerts
I0505 21:52:02.856086 1044903 exec_runner.go:144] found /home/jenkins/minikube-integration/18602-834174/.minikube/ca.pem, removing ...
I0505 21:52:02.856099 1044903 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18602-834174/.minikube/ca.pem
I0505 21:52:02.856209 1044903 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18602-834174/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18602-834174/.minikube/ca.pem (1082 bytes)
I0505 21:52:02.856348 1044903 exec_runner.go:144] found /home/jenkins/minikube-integration/18602-834174/.minikube/cert.pem, removing ...
I0505 21:52:02.856357 1044903 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18602-834174/.minikube/cert.pem
I0505 21:52:02.856402 1044903 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18602-834174/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18602-834174/.minikube/cert.pem (1123 bytes)
I0505 21:52:02.856473 1044903 exec_runner.go:144] found /home/jenkins/minikube-integration/18602-834174/.minikube/key.pem, removing ...
I0505 21:52:02.856482 1044903 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18602-834174/.minikube/key.pem
I0505 21:52:02.856513 1044903 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18602-834174/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18602-834174/.minikube/key.pem (1675 bytes)
I0505 21:52:02.856577 1044903 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18602-834174/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18602-834174/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18602-834174/.minikube/certs/ca-key.pem org=jenkins.embed-certs-688821 san=[127.0.0.1 192.168.76.2 embed-certs-688821 localhost minikube]
I0505 21:52:03.501952 1044903 provision.go:177] copyRemoteCerts
I0505 21:52:03.502048 1044903 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0505 21:52:03.502099 1044903 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-688821
I0505 21:52:03.518907 1044903 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34188 SSHKeyPath:/home/jenkins/minikube-integration/18602-834174/.minikube/machines/embed-certs-688821/id_rsa Username:docker}
I0505 21:52:03.615649 1044903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0505 21:52:03.641743 1044903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
I0505 21:52:03.668045 1044903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0505 21:52:03.693094 1044903 provision.go:87] duration metric: took 854.025848ms to configureAuth
I0505 21:52:03.693124 1044903 ubuntu.go:193] setting minikube options for container-runtime
I0505 21:52:03.693302 1044903 config.go:182] Loaded profile config "embed-certs-688821": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.0
I0505 21:52:03.693319 1044903 machine.go:97] duration metric: took 4.352289728s to provisionDockerMachine
I0505 21:52:03.693327 1044903 client.go:171] duration metric: took 11.130971017s to LocalClient.Create
I0505 21:52:03.693340 1044903 start.go:167] duration metric: took 11.131037626s to libmachine.API.Create "embed-certs-688821"
I0505 21:52:03.693347 1044903 start.go:293] postStartSetup for "embed-certs-688821" (driver="docker")
I0505 21:52:03.693356 1044903 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0505 21:52:03.693405 1044903 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0505 21:52:03.693454 1044903 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-688821
I0505 21:52:03.710972 1044903 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34188 SSHKeyPath:/home/jenkins/minikube-integration/18602-834174/.minikube/machines/embed-certs-688821/id_rsa Username:docker}
I0505 21:52:03.812465 1044903 ssh_runner.go:195] Run: cat /etc/os-release
I0505 21:52:03.815724 1044903 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0505 21:52:03.815763 1044903 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0505 21:52:03.815775 1044903 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0505 21:52:03.815782 1044903 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0505 21:52:03.815793 1044903 filesync.go:126] Scanning /home/jenkins/minikube-integration/18602-834174/.minikube/addons for local assets ...
I0505 21:52:03.815860 1044903 filesync.go:126] Scanning /home/jenkins/minikube-integration/18602-834174/.minikube/files for local assets ...
I0505 21:52:03.815950 1044903 filesync.go:149] local asset: /home/jenkins/minikube-integration/18602-834174/.minikube/files/etc/ssl/certs/8396002.pem -> 8396002.pem in /etc/ssl/certs
I0505 21:52:03.816060 1044903 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0505 21:52:03.824588 1044903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/files/etc/ssl/certs/8396002.pem --> /etc/ssl/certs/8396002.pem (1708 bytes)
I0505 21:52:03.849128 1044903 start.go:296] duration metric: took 155.766341ms for postStartSetup
I0505 21:52:03.849549 1044903 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-688821
I0505 21:52:03.865308 1044903 profile.go:143] Saving config to /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/config.json ...
I0505 21:52:03.865604 1044903 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0505 21:52:03.865669 1044903 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-688821
I0505 21:52:03.884074 1044903 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34188 SSHKeyPath:/home/jenkins/minikube-integration/18602-834174/.minikube/machines/embed-certs-688821/id_rsa Username:docker}
I0505 21:52:03.979753 1044903 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0505 21:52:03.984119 1044903 start.go:128] duration metric: took 11.424066898s to createHost
I0505 21:52:03.984144 1044903 start.go:83] releasing machines lock for "embed-certs-688821", held for 11.42422044s
I0505 21:52:03.984214 1044903 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-688821
I0505 21:52:04.002155 1044903 ssh_runner.go:195] Run: cat /version.json
I0505 21:52:04.002221 1044903 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-688821
I0505 21:52:04.002472 1044903 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0505 21:52:04.002510 1044903 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-688821
I0505 21:52:04.021673 1044903 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34188 SSHKeyPath:/home/jenkins/minikube-integration/18602-834174/.minikube/machines/embed-certs-688821/id_rsa Username:docker}
I0505 21:52:04.032413 1044903 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34188 SSHKeyPath:/home/jenkins/minikube-integration/18602-834174/.minikube/machines/embed-certs-688821/id_rsa Username:docker}
I0505 21:52:04.118736 1044903 ssh_runner.go:195] Run: systemctl --version
I0505 21:52:04.235661 1044903 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0505 21:52:04.239882 1044903 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0505 21:52:04.266391 1044903 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0505 21:52:04.266547 1044903 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0505 21:52:04.296379 1044903 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0505 21:52:04.296456 1044903 start.go:494] detecting cgroup driver to use...
I0505 21:52:04.296495 1044903 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0505 21:52:04.296561 1044903 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0505 21:52:04.309737 1044903 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0505 21:52:04.323834 1044903 docker.go:217] disabling cri-docker service (if available) ...
I0505 21:52:04.323938 1044903 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0505 21:52:04.338245 1044903 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0505 21:52:04.352778 1044903 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0505 21:52:04.450617 1044903 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0505 21:52:04.554225 1044903 docker.go:233] disabling docker service ...
I0505 21:52:04.554342 1044903 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0505 21:52:04.578128 1044903 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0505 21:52:04.592110 1044903 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0505 21:52:04.679894 1044903 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0505 21:52:04.770973 1044903 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0505 21:52:04.782535 1044903 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0505 21:52:04.798870 1044903 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0505 21:52:04.809501 1044903 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0505 21:52:04.819883 1044903 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0505 21:52:04.819953 1044903 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0505 21:52:04.830264 1044903 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0505 21:52:04.840844 1044903 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0505 21:52:04.850905 1044903 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0505 21:52:04.862093 1044903 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0505 21:52:04.871757 1044903 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0505 21:52:04.881745 1044903 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0505 21:52:04.899470 1044903 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0505 21:52:04.911930 1044903 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0505 21:52:04.920365 1044903 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0505 21:52:04.928927 1044903 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0505 21:52:05.017062 1044903 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0505 21:52:05.166446 1044903 start.go:541] Will wait 60s for socket path /run/containerd/containerd.sock
I0505 21:52:05.166571 1044903 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0505 21:52:05.170634 1044903 start.go:562] Will wait 60s for crictl version
I0505 21:52:05.170727 1044903 ssh_runner.go:195] Run: which crictl
I0505 21:52:05.176271 1044903 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0505 21:52:05.214344 1044903 start.go:578] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.6.31
RuntimeApiVersion: v1
I0505 21:52:05.214434 1044903 ssh_runner.go:195] Run: containerd --version
I0505 21:52:05.237633 1044903 ssh_runner.go:195] Run: containerd --version
I0505 21:52:05.262275 1044903 out.go:177] * Preparing Kubernetes v1.30.0 on containerd 1.6.31 ...
I0505 21:52:05.264101 1044903 cli_runner.go:164] Run: docker network inspect embed-certs-688821 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0505 21:52:05.278129 1044903 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0505 21:52:05.281714 1044903 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0505 21:52:05.292499 1044903 kubeadm.go:877] updating cluster {Name:embed-certs-688821 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:embed-certs-688821 Namespace:default APIServerHAVIP: APIServerName:minikubeCA AP
IServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:
false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0505 21:52:05.292631 1044903 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime containerd
I0505 21:52:05.292706 1044903 ssh_runner.go:195] Run: sudo crictl images --output json
I0505 21:52:05.328941 1044903 containerd.go:627] all images are preloaded for containerd runtime.
I0505 21:52:05.328965 1044903 containerd.go:534] Images already preloaded, skipping extraction
I0505 21:52:05.329024 1044903 ssh_runner.go:195] Run: sudo crictl images --output json
I0505 21:52:05.366206 1044903 containerd.go:627] all images are preloaded for containerd runtime.
I0505 21:52:05.366227 1044903 cache_images.go:84] Images are preloaded, skipping loading
I0505 21:52:05.366235 1044903 kubeadm.go:928] updating node { 192.168.76.2 8443 v1.30.0 containerd true true} ...
I0505 21:52:05.366341 1044903 kubeadm.go:940] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.30.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=embed-certs-688821 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.30.0 ClusterName:embed-certs-688821 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0505 21:52:05.366408 1044903 ssh_runner.go:195] Run: sudo crictl info
I0505 21:52:05.408485 1044903 cni.go:84] Creating CNI manager for ""
I0505 21:52:05.408509 1044903 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0505 21:52:05.408521 1044903 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0505 21:52:05.408543 1044903 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.30.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-688821 NodeName:embed-certs-688821 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0505 21:52:05.408682 1044903 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "embed-certs-688821"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.30.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0505 21:52:05.408765 1044903 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0
I0505 21:52:05.417772 1044903 binaries.go:44] Found k8s binaries, skipping transfer
I0505 21:52:05.417849 1044903 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0505 21:52:05.426669 1044903 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (322 bytes)
I0505 21:52:05.445430 1044903 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0505 21:52:05.464574 1044903 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2172 bytes)
I0505 21:52:05.491628 1044903 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0505 21:52:05.495143 1044903 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0505 21:52:05.506253 1044903 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0505 21:52:05.592770 1044903 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0505 21:52:05.608599 1044903 certs.go:68] Setting up /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821 for IP: 192.168.76.2
I0505 21:52:05.608621 1044903 certs.go:194] generating shared ca certs ...
I0505 21:52:05.608637 1044903 certs.go:226] acquiring lock for ca certs: {Name:mk992a03e977f4c41ac615dd6f7b5b5a59a04251 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0505 21:52:05.608769 1044903 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18602-834174/.minikube/ca.key
I0505 21:52:05.608819 1044903 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18602-834174/.minikube/proxy-client-ca.key
I0505 21:52:05.608831 1044903 certs.go:256] generating profile certs ...
I0505 21:52:05.608888 1044903 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/client.key
I0505 21:52:05.608901 1044903 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/client.crt with IP's: []
I0505 21:52:06.051387 1044903 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/client.crt ...
I0505 21:52:06.051421 1044903 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/client.crt: {Name:mk7e2490b4977c33830553104530e97d87c66315 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0505 21:52:06.052248 1044903 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/client.key ...
I0505 21:52:06.052273 1044903 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/client.key: {Name:mk1b3bc289908626bf7e4327ae991890dfd3cdda Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0505 21:52:06.053009 1044903 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/apiserver.key.509f4211
I0505 21:52:06.053032 1044903 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/apiserver.crt.509f4211 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.76.2]
I0505 21:52:07.671501 1044903 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/apiserver.crt.509f4211 ...
I0505 21:52:07.671625 1044903 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/apiserver.crt.509f4211: {Name:mkbac51dafe530d26b76225c2c47e426ef4ff39c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0505 21:52:07.671905 1044903 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/apiserver.key.509f4211 ...
I0505 21:52:07.671951 1044903 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/apiserver.key.509f4211: {Name:mk39644a54b728b680c48b71b7007d011222f869 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0505 21:52:07.672718 1044903 certs.go:381] copying /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/apiserver.crt.509f4211 -> /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/apiserver.crt
I0505 21:52:07.673012 1044903 certs.go:385] copying /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/apiserver.key.509f4211 -> /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/apiserver.key
I0505 21:52:07.673218 1044903 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/proxy-client.key
I0505 21:52:07.673289 1044903 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/proxy-client.crt with IP's: []
I0505 21:52:08.324627 1044903 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/proxy-client.crt ...
I0505 21:52:08.324666 1044903 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/proxy-client.crt: {Name:mka246780b637a373b214e16f19af8db798bb551 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0505 21:52:08.325467 1044903 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/proxy-client.key ...
I0505 21:52:08.325492 1044903 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/proxy-client.key: {Name:mk9d4c9f714cedb369826f9f7f6058a9c8a20f1b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0505 21:52:08.325734 1044903 certs.go:484] found cert: /home/jenkins/minikube-integration/18602-834174/.minikube/certs/839600.pem (1338 bytes)
W0505 21:52:08.325779 1044903 certs.go:480] ignoring /home/jenkins/minikube-integration/18602-834174/.minikube/certs/839600_empty.pem, impossibly tiny 0 bytes
I0505 21:52:08.325792 1044903 certs.go:484] found cert: /home/jenkins/minikube-integration/18602-834174/.minikube/certs/ca-key.pem (1675 bytes)
I0505 21:52:08.325818 1044903 certs.go:484] found cert: /home/jenkins/minikube-integration/18602-834174/.minikube/certs/ca.pem (1082 bytes)
I0505 21:52:08.325847 1044903 certs.go:484] found cert: /home/jenkins/minikube-integration/18602-834174/.minikube/certs/cert.pem (1123 bytes)
I0505 21:52:08.325875 1044903 certs.go:484] found cert: /home/jenkins/minikube-integration/18602-834174/.minikube/certs/key.pem (1675 bytes)
I0505 21:52:08.325919 1044903 certs.go:484] found cert: /home/jenkins/minikube-integration/18602-834174/.minikube/files/etc/ssl/certs/8396002.pem (1708 bytes)
I0505 21:52:08.326526 1044903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0505 21:52:08.353252 1044903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0505 21:52:08.379425 1044903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0505 21:52:08.405035 1044903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0505 21:52:08.429371 1044903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
I0505 21:52:08.454725 1044903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0505 21:52:08.479866 1044903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0505 21:52:08.508535 1044903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/profiles/embed-certs-688821/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0505 21:52:08.533997 1044903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/certs/839600.pem --> /usr/share/ca-certificates/839600.pem (1338 bytes)
I0505 21:52:08.559890 1044903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/files/etc/ssl/certs/8396002.pem --> /usr/share/ca-certificates/8396002.pem (1708 bytes)
I0505 21:52:08.584700 1044903 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18602-834174/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0505 21:52:08.609146 1044903 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0505 21:52:08.628252 1044903 ssh_runner.go:195] Run: openssl version
I0505 21:52:08.634283 1044903 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/8396002.pem && ln -fs /usr/share/ca-certificates/8396002.pem /etc/ssl/certs/8396002.pem"
I0505 21:52:08.644338 1044903 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/8396002.pem
I0505 21:52:08.649301 1044903 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 May 5 21:05 /usr/share/ca-certificates/8396002.pem
I0505 21:52:08.649382 1044903 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/8396002.pem
I0505 21:52:08.656111 1044903 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/8396002.pem /etc/ssl/certs/3ec20f2e.0"
I0505 21:52:08.665336 1044903 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0505 21:52:08.674890 1044903 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0505 21:52:08.678480 1044903 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 May 5 20:58 /usr/share/ca-certificates/minikubeCA.pem
I0505 21:52:08.678539 1044903 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0505 21:52:08.685634 1044903 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0505 21:52:08.695188 1044903 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/839600.pem && ln -fs /usr/share/ca-certificates/839600.pem /etc/ssl/certs/839600.pem"
I0505 21:52:08.704868 1044903 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/839600.pem
I0505 21:52:08.708486 1044903 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 May 5 21:05 /usr/share/ca-certificates/839600.pem
I0505 21:52:08.708582 1044903 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/839600.pem
I0505 21:52:08.715574 1044903 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/839600.pem /etc/ssl/certs/51391683.0"
I0505 21:52:08.725136 1044903 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0505 21:52:08.728445 1044903 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0505 21:52:08.728524 1044903 kubeadm.go:391] StartCluster: {Name:embed-certs-688821 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1714386659-18769@sha256:2307161b966936863fe51493570c92a8ccd6d1ed9c62870159694db91f271d1e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:embed-certs-688821 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fal
se CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0505 21:52:08.728617 1044903 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0505 21:52:08.728686 1044903 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0505 21:52:08.788888 1044903 cri.go:89] found id: ""
I0505 21:52:08.788960 1044903 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0505 21:52:08.800187 1044903 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0505 21:52:08.809152 1044903 kubeadm.go:213] ignoring SystemVerification for kubeadm because of docker driver
I0505 21:52:08.809213 1044903 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0505 21:52:08.819709 1044903 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0505 21:52:08.819776 1044903 kubeadm.go:156] found existing configuration files:
I0505 21:52:08.819868 1044903 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0505 21:52:08.830302 1044903 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0505 21:52:08.830431 1044903 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0505 21:52:08.840995 1044903 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0505 21:52:08.853626 1044903 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0505 21:52:08.853762 1044903 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0505 21:52:08.866245 1044903 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0505 21:52:08.875807 1044903 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0505 21:52:08.875897 1044903 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0505 21:52:08.885006 1044903 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0505 21:52:08.894885 1044903 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0505 21:52:08.894952 1044903 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0505 21:52:08.904288 1044903 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0505 21:52:08.953867 1044903 kubeadm.go:309] [init] Using Kubernetes version: v1.30.0
I0505 21:52:08.953936 1044903 kubeadm.go:309] [preflight] Running pre-flight checks
I0505 21:52:08.995565 1044903 kubeadm.go:309] [preflight] The system verification failed. Printing the output from the verification:
I0505 21:52:08.995636 1044903 kubeadm.go:309] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1058-aws[0m
I0505 21:52:08.995673 1044903 kubeadm.go:309] [0;37mOS[0m: [0;32mLinux[0m
I0505 21:52:08.995724 1044903 kubeadm.go:309] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0505 21:52:08.995774 1044903 kubeadm.go:309] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0505 21:52:08.995831 1044903 kubeadm.go:309] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0505 21:52:08.995882 1044903 kubeadm.go:309] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0505 21:52:08.995935 1044903 kubeadm.go:309] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0505 21:52:08.995984 1044903 kubeadm.go:309] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0505 21:52:08.996031 1044903 kubeadm.go:309] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0505 21:52:08.996081 1044903 kubeadm.go:309] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0505 21:52:08.996130 1044903 kubeadm.go:309] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0505 21:52:09.068903 1044903 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0505 21:52:09.069013 1044903 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0505 21:52:09.069107 1044903 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0505 21:52:09.311271 1044903 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0505 21:52:09.314989 1044903 out.go:204] - Generating certificates and keys ...
I0505 21:52:09.315096 1044903 kubeadm.go:309] [certs] Using existing ca certificate authority
I0505 21:52:09.315166 1044903 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0505 21:52:09.679829 1044903 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0505 21:52:10.781573 1044903 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0505 21:52:11.525024 1044903 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0505 21:52:11.806982 1044903 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0505 21:52:12.157447 1044903 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0505 21:52:12.157797 1044903 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [embed-certs-688821 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I0505 21:52:12.164354 1034872 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0505 21:52:12.185776 1034872 api_server.go:72] duration metric: took 5m51.717626471s to wait for apiserver process to appear ...
I0505 21:52:12.185810 1034872 api_server.go:88] waiting for apiserver healthz status ...
I0505 21:52:12.185850 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0505 21:52:12.185922 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0505 21:52:12.249087 1034872 cri.go:89] found id: "e507b898dd4977185ac9e4f35e0538853889d163fb8c2646196f755bfd9aeb50"
I0505 21:52:12.249111 1034872 cri.go:89] found id: "0441347974720e9d65c1d5094d8ca940394afc2d22b6fc51a6a18f4b1ba45061"
I0505 21:52:12.249133 1034872 cri.go:89] found id: ""
I0505 21:52:12.249141 1034872 logs.go:276] 2 containers: [e507b898dd4977185ac9e4f35e0538853889d163fb8c2646196f755bfd9aeb50 0441347974720e9d65c1d5094d8ca940394afc2d22b6fc51a6a18f4b1ba45061]
I0505 21:52:12.249213 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.254264 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.259756 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0505 21:52:12.259849 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0505 21:52:12.320725 1034872 cri.go:89] found id: "580e75f9f31dafb32fc2f7dbacfb021fca77474ee298a6ed5835a83572ff441a"
I0505 21:52:12.320750 1034872 cri.go:89] found id: "9067c10ea9a99ed6a32fe6eb91c9516cb585fb511f405daf4626d97a5236dde0"
I0505 21:52:12.320755 1034872 cri.go:89] found id: ""
I0505 21:52:12.320762 1034872 logs.go:276] 2 containers: [580e75f9f31dafb32fc2f7dbacfb021fca77474ee298a6ed5835a83572ff441a 9067c10ea9a99ed6a32fe6eb91c9516cb585fb511f405daf4626d97a5236dde0]
I0505 21:52:12.320837 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.325724 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.330394 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0505 21:52:12.330465 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0505 21:52:12.397243 1034872 cri.go:89] found id: "00a9d52255afbc7a5af4b434524704f295b6b305ad9e0f1f57cb51ebc317a563"
I0505 21:52:12.397337 1034872 cri.go:89] found id: "718b2b382a1dbae2be4f3fe12f41a1c16ad252136b3ffd405f84c2c8dd1cb908"
I0505 21:52:12.397364 1034872 cri.go:89] found id: ""
I0505 21:52:12.397385 1034872 logs.go:276] 2 containers: [00a9d52255afbc7a5af4b434524704f295b6b305ad9e0f1f57cb51ebc317a563 718b2b382a1dbae2be4f3fe12f41a1c16ad252136b3ffd405f84c2c8dd1cb908]
I0505 21:52:12.397478 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.402689 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.407254 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0505 21:52:12.407420 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0505 21:52:12.470078 1034872 cri.go:89] found id: "a9b1a797d9ee2c00fbed142aaecb2de99854f0ab6cf2c751c17eb782676547d8"
I0505 21:52:12.470169 1034872 cri.go:89] found id: "0dc3b13f77012b59a798a53b123a1eb333fec5c5fef1d4e079e3060d22355c74"
I0505 21:52:12.470190 1034872 cri.go:89] found id: ""
I0505 21:52:12.470211 1034872 logs.go:276] 2 containers: [a9b1a797d9ee2c00fbed142aaecb2de99854f0ab6cf2c751c17eb782676547d8 0dc3b13f77012b59a798a53b123a1eb333fec5c5fef1d4e079e3060d22355c74]
I0505 21:52:12.470324 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.475205 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.479723 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0505 21:52:12.479872 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0505 21:52:12.677697 1044903 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0505 21:52:12.677828 1044903 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [embed-certs-688821 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I0505 21:52:13.423055 1044903 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0505 21:52:13.773019 1044903 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0505 21:52:14.539307 1044903 kubeadm.go:309] [certs] Generating "sa" key and public key
I0505 21:52:14.539633 1044903 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0505 21:52:14.870750 1044903 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0505 21:52:15.296544 1044903 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0505 21:52:15.525988 1044903 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0505 21:52:16.052193 1044903 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0505 21:52:16.995174 1044903 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0505 21:52:16.995858 1044903 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0505 21:52:16.999912 1044903 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0505 21:52:17.002370 1044903 out.go:204] - Booting up control plane ...
I0505 21:52:17.002486 1044903 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0505 21:52:17.003713 1044903 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0505 21:52:17.004945 1044903 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0505 21:52:17.016818 1044903 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0505 21:52:17.017747 1044903 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0505 21:52:17.017988 1044903 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0505 21:52:17.118058 1044903 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0505 21:52:17.118145 1044903 kubeadm.go:309] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s
I0505 21:52:12.546150 1034872 cri.go:89] found id: "0eedfa9ede7ada50303473ae02419af0e8e08f080f59c78fde9947be8067a50c"
I0505 21:52:12.546223 1034872 cri.go:89] found id: "64ef7f857a2f76b261914c70bce060b265f43d38371ea0ca161a99a9d7c3ef2d"
I0505 21:52:12.546242 1034872 cri.go:89] found id: ""
I0505 21:52:12.546264 1034872 logs.go:276] 2 containers: [0eedfa9ede7ada50303473ae02419af0e8e08f080f59c78fde9947be8067a50c 64ef7f857a2f76b261914c70bce060b265f43d38371ea0ca161a99a9d7c3ef2d]
I0505 21:52:12.546357 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.550460 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.554574 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0505 21:52:12.554694 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0505 21:52:12.606973 1034872 cri.go:89] found id: "a288efd4ebd942b45a3ca58128b3e8296d0e2c8fda2cd9104f1c23acb6ebdca9"
I0505 21:52:12.607049 1034872 cri.go:89] found id: "6a301dfa69e35bc9c7dfd957f9098189bef6c3a23dfdee95d5dfe176ee47a84e"
I0505 21:52:12.607068 1034872 cri.go:89] found id: ""
I0505 21:52:12.607092 1034872 logs.go:276] 2 containers: [a288efd4ebd942b45a3ca58128b3e8296d0e2c8fda2cd9104f1c23acb6ebdca9 6a301dfa69e35bc9c7dfd957f9098189bef6c3a23dfdee95d5dfe176ee47a84e]
I0505 21:52:12.607178 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.611485 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.615587 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0505 21:52:12.615742 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0505 21:52:12.673585 1034872 cri.go:89] found id: "faa0225deba398d4a6dbde18c4021422a8598fa18e0944489f35b4a7564593a9"
I0505 21:52:12.673668 1034872 cri.go:89] found id: "7c36c2442ceb7ea588207eeb243a163d370cc67473ad5096314a4b9f8bf196cb"
I0505 21:52:12.673688 1034872 cri.go:89] found id: ""
I0505 21:52:12.673727 1034872 logs.go:276] 2 containers: [faa0225deba398d4a6dbde18c4021422a8598fa18e0944489f35b4a7564593a9 7c36c2442ceb7ea588207eeb243a163d370cc67473ad5096314a4b9f8bf196cb]
I0505 21:52:12.673802 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.679682 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.683578 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0505 21:52:12.683711 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0505 21:52:12.779520 1034872 cri.go:89] found id: "48a51b2077e2dec5b1c8092e8da9e537f72f9d962aff852c13a67a6ca472dd16"
I0505 21:52:12.779593 1034872 cri.go:89] found id: "3fc65d073b431f4914e162dd4c0da74d3a8cc7f545665adbc031bd3869d1bbd2"
I0505 21:52:12.779612 1034872 cri.go:89] found id: ""
I0505 21:52:12.779635 1034872 logs.go:276] 2 containers: [48a51b2077e2dec5b1c8092e8da9e537f72f9d962aff852c13a67a6ca472dd16 3fc65d073b431f4914e162dd4c0da74d3a8cc7f545665adbc031bd3869d1bbd2]
I0505 21:52:12.779715 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.783554 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.789343 1034872 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0505 21:52:12.789461 1034872 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0505 21:52:12.856607 1034872 cri.go:89] found id: "e84d32f53ec5f8ce10bda8f22df215950b0a08e1924b9f83fa3e62918c0878b0"
I0505 21:52:12.856682 1034872 cri.go:89] found id: ""
I0505 21:52:12.856703 1034872 logs.go:276] 1 containers: [e84d32f53ec5f8ce10bda8f22df215950b0a08e1924b9f83fa3e62918c0878b0]
I0505 21:52:12.856793 1034872 ssh_runner.go:195] Run: which crictl
I0505 21:52:12.861138 1034872 logs.go:123] Gathering logs for kube-proxy [0eedfa9ede7ada50303473ae02419af0e8e08f080f59c78fde9947be8067a50c] ...
I0505 21:52:12.861211 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0eedfa9ede7ada50303473ae02419af0e8e08f080f59c78fde9947be8067a50c"
I0505 21:52:12.946552 1034872 logs.go:123] Gathering logs for kube-proxy [64ef7f857a2f76b261914c70bce060b265f43d38371ea0ca161a99a9d7c3ef2d] ...
I0505 21:52:12.946654 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 64ef7f857a2f76b261914c70bce060b265f43d38371ea0ca161a99a9d7c3ef2d"
I0505 21:52:13.005335 1034872 logs.go:123] Gathering logs for kube-controller-manager [a288efd4ebd942b45a3ca58128b3e8296d0e2c8fda2cd9104f1c23acb6ebdca9] ...
I0505 21:52:13.005411 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a288efd4ebd942b45a3ca58128b3e8296d0e2c8fda2cd9104f1c23acb6ebdca9"
I0505 21:52:13.141874 1034872 logs.go:123] Gathering logs for kindnet [faa0225deba398d4a6dbde18c4021422a8598fa18e0944489f35b4a7564593a9] ...
I0505 21:52:13.141918 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 faa0225deba398d4a6dbde18c4021422a8598fa18e0944489f35b4a7564593a9"
I0505 21:52:13.207611 1034872 logs.go:123] Gathering logs for container status ...
I0505 21:52:13.207685 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0505 21:52:13.282122 1034872 logs.go:123] Gathering logs for kube-apiserver [e507b898dd4977185ac9e4f35e0538853889d163fb8c2646196f755bfd9aeb50] ...
I0505 21:52:13.282250 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e507b898dd4977185ac9e4f35e0538853889d163fb8c2646196f755bfd9aeb50"
I0505 21:52:13.355443 1034872 logs.go:123] Gathering logs for kube-scheduler [a9b1a797d9ee2c00fbed142aaecb2de99854f0ab6cf2c751c17eb782676547d8] ...
I0505 21:52:13.355525 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a9b1a797d9ee2c00fbed142aaecb2de99854f0ab6cf2c751c17eb782676547d8"
I0505 21:52:13.414114 1034872 logs.go:123] Gathering logs for kube-controller-manager [6a301dfa69e35bc9c7dfd957f9098189bef6c3a23dfdee95d5dfe176ee47a84e] ...
I0505 21:52:13.414149 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6a301dfa69e35bc9c7dfd957f9098189bef6c3a23dfdee95d5dfe176ee47a84e"
I0505 21:52:13.495538 1034872 logs.go:123] Gathering logs for kindnet [7c36c2442ceb7ea588207eeb243a163d370cc67473ad5096314a4b9f8bf196cb] ...
I0505 21:52:13.495618 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7c36c2442ceb7ea588207eeb243a163d370cc67473ad5096314a4b9f8bf196cb"
I0505 21:52:13.578755 1034872 logs.go:123] Gathering logs for kube-apiserver [0441347974720e9d65c1d5094d8ca940394afc2d22b6fc51a6a18f4b1ba45061] ...
I0505 21:52:13.578836 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0441347974720e9d65c1d5094d8ca940394afc2d22b6fc51a6a18f4b1ba45061"
I0505 21:52:13.662367 1034872 logs.go:123] Gathering logs for describe nodes ...
I0505 21:52:13.662445 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0505 21:52:13.840680 1034872 logs.go:123] Gathering logs for etcd [9067c10ea9a99ed6a32fe6eb91c9516cb585fb511f405daf4626d97a5236dde0] ...
I0505 21:52:13.840713 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9067c10ea9a99ed6a32fe6eb91c9516cb585fb511f405daf4626d97a5236dde0"
I0505 21:52:13.890585 1034872 logs.go:123] Gathering logs for coredns [718b2b382a1dbae2be4f3fe12f41a1c16ad252136b3ffd405f84c2c8dd1cb908] ...
I0505 21:52:13.890717 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 718b2b382a1dbae2be4f3fe12f41a1c16ad252136b3ffd405f84c2c8dd1cb908"
I0505 21:52:13.955789 1034872 logs.go:123] Gathering logs for kube-scheduler [0dc3b13f77012b59a798a53b123a1eb333fec5c5fef1d4e079e3060d22355c74] ...
I0505 21:52:13.955870 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0dc3b13f77012b59a798a53b123a1eb333fec5c5fef1d4e079e3060d22355c74"
I0505 21:52:14.012782 1034872 logs.go:123] Gathering logs for storage-provisioner [48a51b2077e2dec5b1c8092e8da9e537f72f9d962aff852c13a67a6ca472dd16] ...
I0505 21:52:14.012816 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 48a51b2077e2dec5b1c8092e8da9e537f72f9d962aff852c13a67a6ca472dd16"
I0505 21:52:14.058127 1034872 logs.go:123] Gathering logs for dmesg ...
I0505 21:52:14.058156 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0505 21:52:14.078372 1034872 logs.go:123] Gathering logs for etcd [580e75f9f31dafb32fc2f7dbacfb021fca77474ee298a6ed5835a83572ff441a] ...
I0505 21:52:14.078461 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 580e75f9f31dafb32fc2f7dbacfb021fca77474ee298a6ed5835a83572ff441a"
I0505 21:52:14.141503 1034872 logs.go:123] Gathering logs for coredns [00a9d52255afbc7a5af4b434524704f295b6b305ad9e0f1f57cb51ebc317a563] ...
I0505 21:52:14.141581 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 00a9d52255afbc7a5af4b434524704f295b6b305ad9e0f1f57cb51ebc317a563"
I0505 21:52:14.194614 1034872 logs.go:123] Gathering logs for storage-provisioner [3fc65d073b431f4914e162dd4c0da74d3a8cc7f545665adbc031bd3869d1bbd2] ...
I0505 21:52:14.194640 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3fc65d073b431f4914e162dd4c0da74d3a8cc7f545665adbc031bd3869d1bbd2"
I0505 21:52:14.247067 1034872 logs.go:123] Gathering logs for kubernetes-dashboard [e84d32f53ec5f8ce10bda8f22df215950b0a08e1924b9f83fa3e62918c0878b0] ...
I0505 21:52:14.247092 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e84d32f53ec5f8ce10bda8f22df215950b0a08e1924b9f83fa3e62918c0878b0"
I0505 21:52:14.300631 1034872 logs.go:123] Gathering logs for containerd ...
I0505 21:52:14.300706 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0505 21:52:14.384868 1034872 logs.go:123] Gathering logs for kubelet ...
I0505 21:52:14.384987 1034872 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0505 21:52:14.448591 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.362969 658 reflector.go:138] object-"kube-system"/"storage-provisioner-token-2246n": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-2246n" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:14.450055 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.364071 658 reflector.go:138] object-"kube-system"/"kube-proxy-token-kvlt6": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-kvlt6" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:14.450325 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.392090 658 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:14.450621 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.392198 658 reflector.go:138] object-"kube-system"/"kindnet-token-6nwjh": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-6nwjh" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:14.450934 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.392264 658 reflector.go:138] object-"kube-system"/"coredns-token-kbxdj": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-kbxdj" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:14.451166 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.392330 658 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:14.456428 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.536174 658 reflector.go:138] object-"default"/"default-token-xtgrf": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-xtgrf" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:14.456707 1034872 logs.go:138] Found kubelet problem: May 05 21:46:36 old-k8s-version-038518 kubelet[658]: E0505 21:46:36.536174 658 reflector.go:138] object-"kube-system"/"metrics-server-token-77bv5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-77bv5" is forbidden: User "system:node:old-k8s-version-038518" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-038518' and this object
W0505 21:52:14.466305 1034872 logs.go:138] Found kubelet problem: May 05 21:46:38 old-k8s-version-038518 kubelet[658]: E0505 21:46:38.675127 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0505 21:52:14.467847 1034872 logs.go:138] Found kubelet problem: May 05 21:46:39 old-k8s-version-038518 kubelet[658]: E0505 21:46:39.593155 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.471602 1034872 logs.go:138] Found kubelet problem: May 05 21:46:53 old-k8s-version-038518 kubelet[658]: E0505 21:46:53.494945 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0505 21:52:14.473752 1034872 logs.go:138] Found kubelet problem: May 05 21:47:00 old-k8s-version-038518 kubelet[658]: E0505 21:47:00.699177 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.474144 1034872 logs.go:138] Found kubelet problem: May 05 21:47:01 old-k8s-version-038518 kubelet[658]: E0505 21:47:01.687241 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.474602 1034872 logs.go:138] Found kubelet problem: May 05 21:47:06 old-k8s-version-038518 kubelet[658]: E0505 21:47:06.703880 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.475630 1034872 logs.go:138] Found kubelet problem: May 05 21:47:07 old-k8s-version-038518 kubelet[658]: E0505 21:47:07.485645 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.476214 1034872 logs.go:138] Found kubelet problem: May 05 21:47:08 old-k8s-version-038518 kubelet[658]: E0505 21:47:08.728799 658 pod_workers.go:191] Error syncing pod 3b3b675d-496d-431d-8171-51d0320491be ("storage-provisioner_kube-system(3b3b675d-496d-431d-8171-51d0320491be)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(3b3b675d-496d-431d-8171-51d0320491be)"
W0505 21:52:14.482149 1034872 logs.go:138] Found kubelet problem: May 05 21:47:19 old-k8s-version-038518 kubelet[658]: E0505 21:47:19.494034 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0505 21:52:14.482675 1034872 logs.go:138] Found kubelet problem: May 05 21:47:19 old-k8s-version-038518 kubelet[658]: E0505 21:47:19.762150 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.483194 1034872 logs.go:138] Found kubelet problem: May 05 21:47:26 old-k8s-version-038518 kubelet[658]: E0505 21:47:26.703935 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.483405 1034872 logs.go:138] Found kubelet problem: May 05 21:47:30 old-k8s-version-038518 kubelet[658]: E0505 21:47:30.485820 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.484041 1034872 logs.go:138] Found kubelet problem: May 05 21:47:41 old-k8s-version-038518 kubelet[658]: E0505 21:47:41.822533 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.484256 1034872 logs.go:138] Found kubelet problem: May 05 21:47:43 old-k8s-version-038518 kubelet[658]: E0505 21:47:43.485594 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.486463 1034872 logs.go:138] Found kubelet problem: May 05 21:47:46 old-k8s-version-038518 kubelet[658]: E0505 21:47:46.704245 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.486708 1034872 logs.go:138] Found kubelet problem: May 05 21:47:57 old-k8s-version-038518 kubelet[658]: E0505 21:47:57.485753 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.487133 1034872 logs.go:138] Found kubelet problem: May 05 21:47:59 old-k8s-version-038518 kubelet[658]: E0505 21:47:59.485321 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.489578 1034872 logs.go:138] Found kubelet problem: May 05 21:48:09 old-k8s-version-038518 kubelet[658]: E0505 21:48:09.493238 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0505 21:52:14.489940 1034872 logs.go:138] Found kubelet problem: May 05 21:48:14 old-k8s-version-038518 kubelet[658]: E0505 21:48:14.485469 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.490151 1034872 logs.go:138] Found kubelet problem: May 05 21:48:21 old-k8s-version-038518 kubelet[658]: E0505 21:48:21.485674 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.490785 1034872 logs.go:138] Found kubelet problem: May 05 21:48:25 old-k8s-version-038518 kubelet[658]: E0505 21:48:25.932847 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.491140 1034872 logs.go:138] Found kubelet problem: May 05 21:48:26 old-k8s-version-038518 kubelet[658]: E0505 21:48:26.940259 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.491350 1034872 logs.go:138] Found kubelet problem: May 05 21:48:33 old-k8s-version-038518 kubelet[658]: E0505 21:48:33.485713 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.491704 1034872 logs.go:138] Found kubelet problem: May 05 21:48:40 old-k8s-version-038518 kubelet[658]: E0505 21:48:40.485993 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.491914 1034872 logs.go:138] Found kubelet problem: May 05 21:48:48 old-k8s-version-038518 kubelet[658]: E0505 21:48:48.487195 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.494527 1034872 logs.go:138] Found kubelet problem: May 05 21:48:52 old-k8s-version-038518 kubelet[658]: E0505 21:48:52.485993 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.494779 1034872 logs.go:138] Found kubelet problem: May 05 21:49:01 old-k8s-version-038518 kubelet[658]: E0505 21:49:01.485651 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.495149 1034872 logs.go:138] Found kubelet problem: May 05 21:49:04 old-k8s-version-038518 kubelet[658]: E0505 21:49:04.485476 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.495505 1034872 logs.go:138] Found kubelet problem: May 05 21:49:16 old-k8s-version-038518 kubelet[658]: E0505 21:49:16.485864 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.495715 1034872 logs.go:138] Found kubelet problem: May 05 21:49:16 old-k8s-version-038518 kubelet[658]: E0505 21:49:16.487111 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.496067 1034872 logs.go:138] Found kubelet problem: May 05 21:49:27 old-k8s-version-038518 kubelet[658]: E0505 21:49:27.485780 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.498525 1034872 logs.go:138] Found kubelet problem: May 05 21:49:30 old-k8s-version-038518 kubelet[658]: E0505 21:49:30.495348 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0505 21:52:14.498886 1034872 logs.go:138] Found kubelet problem: May 05 21:49:39 old-k8s-version-038518 kubelet[658]: E0505 21:49:39.485327 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.499097 1034872 logs.go:138] Found kubelet problem: May 05 21:49:44 old-k8s-version-038518 kubelet[658]: E0505 21:49:44.487616 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.499709 1034872 logs.go:138] Found kubelet problem: May 05 21:49:55 old-k8s-version-038518 kubelet[658]: E0505 21:49:55.126919 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.500062 1034872 logs.go:138] Found kubelet problem: May 05 21:49:56 old-k8s-version-038518 kubelet[658]: E0505 21:49:56.703775 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.500498 1034872 logs.go:138] Found kubelet problem: May 05 21:49:59 old-k8s-version-038518 kubelet[658]: E0505 21:49:59.485980 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.500852 1034872 logs.go:138] Found kubelet problem: May 05 21:50:10 old-k8s-version-038518 kubelet[658]: E0505 21:50:10.486742 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.501081 1034872 logs.go:138] Found kubelet problem: May 05 21:50:12 old-k8s-version-038518 kubelet[658]: E0505 21:50:12.485718 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.501434 1034872 logs.go:138] Found kubelet problem: May 05 21:50:25 old-k8s-version-038518 kubelet[658]: E0505 21:50:25.485504 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.501719 1034872 logs.go:138] Found kubelet problem: May 05 21:50:26 old-k8s-version-038518 kubelet[658]: E0505 21:50:26.486167 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.502078 1034872 logs.go:138] Found kubelet problem: May 05 21:50:36 old-k8s-version-038518 kubelet[658]: E0505 21:50:36.485829 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.502288 1034872 logs.go:138] Found kubelet problem: May 05 21:50:37 old-k8s-version-038518 kubelet[658]: E0505 21:50:37.485730 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.502502 1034872 logs.go:138] Found kubelet problem: May 05 21:50:48 old-k8s-version-038518 kubelet[658]: E0505 21:50:48.486641 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.502900 1034872 logs.go:138] Found kubelet problem: May 05 21:50:51 old-k8s-version-038518 kubelet[658]: E0505 21:50:51.485413 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.503174 1034872 logs.go:138] Found kubelet problem: May 05 21:51:00 old-k8s-version-038518 kubelet[658]: E0505 21:51:00.486225 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.503620 1034872 logs.go:138] Found kubelet problem: May 05 21:51:06 old-k8s-version-038518 kubelet[658]: E0505 21:51:06.485743 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.503842 1034872 logs.go:138] Found kubelet problem: May 05 21:51:13 old-k8s-version-038518 kubelet[658]: E0505 21:51:13.485872 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.504202 1034872 logs.go:138] Found kubelet problem: May 05 21:51:20 old-k8s-version-038518 kubelet[658]: E0505 21:51:20.485385 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.504460 1034872 logs.go:138] Found kubelet problem: May 05 21:51:26 old-k8s-version-038518 kubelet[658]: E0505 21:51:26.486692 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.504822 1034872 logs.go:138] Found kubelet problem: May 05 21:51:34 old-k8s-version-038518 kubelet[658]: E0505 21:51:34.485322 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.505039 1034872 logs.go:138] Found kubelet problem: May 05 21:51:37 old-k8s-version-038518 kubelet[658]: E0505 21:51:37.485828 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.505390 1034872 logs.go:138] Found kubelet problem: May 05 21:51:46 old-k8s-version-038518 kubelet[658]: E0505 21:51:46.485958 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.505611 1034872 logs.go:138] Found kubelet problem: May 05 21:51:51 old-k8s-version-038518 kubelet[658]: E0505 21:51:51.485703 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.505963 1034872 logs.go:138] Found kubelet problem: May 05 21:51:59 old-k8s-version-038518 kubelet[658]: E0505 21:51:59.485419 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.506182 1034872 logs.go:138] Found kubelet problem: May 05 21:52:04 old-k8s-version-038518 kubelet[658]: E0505 21:52:04.489232 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.506532 1034872 logs.go:138] Found kubelet problem: May 05 21:52:13 old-k8s-version-038518 kubelet[658]: E0505 21:52:13.485407 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
I0505 21:52:14.506568 1034872 out.go:304] Setting ErrFile to fd 2...
I0505 21:52:14.506593 1034872 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0505 21:52:14.506731 1034872 out.go:239] X Problems detected in kubelet:
W0505 21:52:14.506834 1034872 out.go:239] May 05 21:51:46 old-k8s-version-038518 kubelet[658]: E0505 21:51:46.485958 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.506879 1034872 out.go:239] May 05 21:51:51 old-k8s-version-038518 kubelet[658]: E0505 21:51:51.485703 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.506909 1034872 out.go:239] May 05 21:51:59 old-k8s-version-038518 kubelet[658]: E0505 21:51:59.485419 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
W0505 21:52:14.506952 1034872 out.go:239] May 05 21:52:04 old-k8s-version-038518 kubelet[658]: E0505 21:52:04.489232 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0505 21:52:14.506989 1034872 out.go:239] May 05 21:52:13 old-k8s-version-038518 kubelet[658]: E0505 21:52:13.485407 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
I0505 21:52:14.507021 1034872 out.go:304] Setting ErrFile to fd 2...
I0505 21:52:14.507051 1034872 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0505 21:52:17.641438 1044903 kubeadm.go:309] [kubelet-check] The kubelet is healthy after 513.16491ms
I0505 21:52:17.641525 1044903 kubeadm.go:309] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0505 21:52:24.508272 1034872 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0505 21:52:24.524338 1034872 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0505 21:52:24.527372 1034872 out.go:177]
W0505 21:52:24.530009 1034872 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0505 21:52:24.530056 1034872 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0505 21:52:24.530074 1034872 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0505 21:52:24.530079 1034872 out.go:239] *
W0505 21:52:24.531028 1034872 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0505 21:52:24.534395 1034872 out.go:177]
I0505 21:52:24.638080 1044903 kubeadm.go:309] [api-check] The API server is healthy after 7.007280966s
I0505 21:52:24.678702 1044903 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0505 21:52:25.198850 1044903 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0505 21:52:25.244208 1044903 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0505 21:52:25.244405 1044903 kubeadm.go:309] [mark-control-plane] Marking the node embed-certs-688821 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0505 21:52:25.262394 1044903 kubeadm.go:309] [bootstrap-token] Using token: bq4eiv.012wyurokunxbce4
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
0ff0bca8c2ebe 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 f3bf270c917b9 dashboard-metrics-scraper-8d5bb5db8-fzgzb
48a51b2077e2d ba04bb24b9575 5 minutes ago Running storage-provisioner 2 e563cfcaf196a storage-provisioner
e84d32f53ec5f 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 43b9b8972b5ce kubernetes-dashboard-cd95d586-jx84w
00a9d52255afb db91994f4ee8f 5 minutes ago Running coredns 1 08ac19c791df5 coredns-74ff55c5b-6mbxd
faa0225deba39 4740c1948d3fc 5 minutes ago Running kindnet-cni 1 094f7910004f8 kindnet-phdxn
0eedfa9ede7ad 25a5233254979 5 minutes ago Running kube-proxy 1 8670b0e26ef22 kube-proxy-cfmwt
e451a85a60b32 1611cd07b61d5 5 minutes ago Running busybox 1 3a0931b58e3cd busybox
3fc65d073b431 ba04bb24b9575 5 minutes ago Exited storage-provisioner 1 e563cfcaf196a storage-provisioner
a288efd4ebd94 1df8a2b116bd1 5 minutes ago Running kube-controller-manager 1 553ace7d8201b kube-controller-manager-old-k8s-version-038518
a9b1a797d9ee2 e7605f88f17d6 5 minutes ago Running kube-scheduler 1 00c03632a85f0 kube-scheduler-old-k8s-version-038518
e507b898dd497 2c08bbbc02d3a 5 minutes ago Running kube-apiserver 1 551cc86e6430c kube-apiserver-old-k8s-version-038518
580e75f9f31da 05b738aa1bc63 5 minutes ago Running etcd 1 0baba8660f6a1 etcd-old-k8s-version-038518
4006440ed8853 1611cd07b61d5 6 minutes ago Exited busybox 0 a4d28bc1f63ce busybox
718b2b382a1db db91994f4ee8f 8 minutes ago Exited coredns 0 f10468b997461 coredns-74ff55c5b-6mbxd
7c36c2442ceb7 4740c1948d3fc 8 minutes ago Exited kindnet-cni 0 6d069540718e7 kindnet-phdxn
64ef7f857a2f7 25a5233254979 8 minutes ago Exited kube-proxy 0 4f3a6091c1ac8 kube-proxy-cfmwt
6a301dfa69e35 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 5d8e4e84a71f7 kube-controller-manager-old-k8s-version-038518
0441347974720 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 d46b3d77fb589 kube-apiserver-old-k8s-version-038518
9067c10ea9a99 05b738aa1bc63 8 minutes ago Exited etcd 0 2fd95be2259f2 etcd-old-k8s-version-038518
0dc3b13f77012 e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 0b128be3cfb2c kube-scheduler-old-k8s-version-038518
==> containerd <==
May 05 21:48:25 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:48:25.505459968Z" level=info msg="CreateContainer within sandbox \"f3bf270c917b9d3cea93cad07ec144496206334446814119b1bc65fd7a9380b7\" for &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:4,} returns container id \"20370ddf9a7cb72639111525d684fde63439a423945c52baec1f805c92aa6120\""
May 05 21:48:25 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:48:25.506028089Z" level=info msg="StartContainer for \"20370ddf9a7cb72639111525d684fde63439a423945c52baec1f805c92aa6120\""
May 05 21:48:25 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:48:25.594231229Z" level=info msg="StartContainer for \"20370ddf9a7cb72639111525d684fde63439a423945c52baec1f805c92aa6120\" returns successfully"
May 05 21:48:25 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:48:25.618901020Z" level=info msg="shim disconnected" id=20370ddf9a7cb72639111525d684fde63439a423945c52baec1f805c92aa6120
May 05 21:48:25 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:48:25.618964921Z" level=warning msg="cleaning up after shim disconnected" id=20370ddf9a7cb72639111525d684fde63439a423945c52baec1f805c92aa6120 namespace=k8s.io
May 05 21:48:25 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:48:25.618977024Z" level=info msg="cleaning up dead shim"
May 05 21:48:25 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:48:25.628363296Z" level=warning msg="cleanup warnings time=\"2024-05-05T21:48:25Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2967 runtime=io.containerd.runc.v2\n"
May 05 21:48:25 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:48:25.934653690Z" level=info msg="RemoveContainer for \"941b72a5f8cb8ce13850378db585436c2bafadfda262a5626db110ff9ad7445c\""
May 05 21:48:25 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:48:25.942088923Z" level=info msg="RemoveContainer for \"941b72a5f8cb8ce13850378db585436c2bafadfda262a5626db110ff9ad7445c\" returns successfully"
May 05 21:49:30 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:49:30.486183910Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 05 21:49:30 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:49:30.493237828Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" host=fake.domain
May 05 21:49:30 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:49:30.494864455Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
May 05 21:49:54 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:49:54.491690708Z" level=info msg="CreateContainer within sandbox \"f3bf270c917b9d3cea93cad07ec144496206334446814119b1bc65fd7a9380b7\" for container &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:5,}"
May 05 21:49:54 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:49:54.505344416Z" level=info msg="CreateContainer within sandbox \"f3bf270c917b9d3cea93cad07ec144496206334446814119b1bc65fd7a9380b7\" for &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:5,} returns container id \"0ff0bca8c2ebed85a790886c4ab1dcd515228ec21e5882a99940fda26c050ae7\""
May 05 21:49:54 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:49:54.506101886Z" level=info msg="StartContainer for \"0ff0bca8c2ebed85a790886c4ab1dcd515228ec21e5882a99940fda26c050ae7\""
May 05 21:49:54 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:49:54.583116840Z" level=info msg="StartContainer for \"0ff0bca8c2ebed85a790886c4ab1dcd515228ec21e5882a99940fda26c050ae7\" returns successfully"
May 05 21:49:54 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:49:54.606519009Z" level=info msg="shim disconnected" id=0ff0bca8c2ebed85a790886c4ab1dcd515228ec21e5882a99940fda26c050ae7
May 05 21:49:54 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:49:54.606582024Z" level=warning msg="cleaning up after shim disconnected" id=0ff0bca8c2ebed85a790886c4ab1dcd515228ec21e5882a99940fda26c050ae7 namespace=k8s.io
May 05 21:49:54 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:49:54.606595194Z" level=info msg="cleaning up dead shim"
May 05 21:49:54 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:49:54.616365555Z" level=warning msg="cleanup warnings time=\"2024-05-05T21:49:54Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=3223 runtime=io.containerd.runc.v2\n"
May 05 21:49:55 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:49:55.137013027Z" level=info msg="RemoveContainer for \"20370ddf9a7cb72639111525d684fde63439a423945c52baec1f805c92aa6120\""
May 05 21:49:55 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:49:55.141735968Z" level=info msg="RemoveContainer for \"20370ddf9a7cb72639111525d684fde63439a423945c52baec1f805c92aa6120\" returns successfully"
May 05 21:52:15 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:52:15.486382276Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 05 21:52:15 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:52:15.500939274Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" host=fake.domain
May 05 21:52:15 old-k8s-version-038518 containerd[566]: time="2024-05-05T21:52:15.502371563Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
==> coredns [00a9d52255afbc7a5af4b434524704f295b6b305ad9e0f1f57cb51ebc317a563] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:41409 - 9262 "HINFO IN 6269128947954652031.8193708455748503257. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.031880943s
==> coredns [718b2b382a1dbae2be4f3fe12f41a1c16ad252136b3ffd405f84c2c8dd1cb908] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:44350 - 58105 "HINFO IN 4565594270089262504.9041914718871027682. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.019292011s
==> describe nodes <==
Name: old-k8s-version-038518
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-038518
kubernetes.io/os=linux
minikube.k8s.io/commit=182cbbc99574885c654f8e32902368a71f76ddd3
minikube.k8s.io/name=old-k8s-version-038518
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_05_05T21_43_53_0700
minikube.k8s.io/version=v1.33.0
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sun, 05 May 2024 21:43:49 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-038518
AcquireTime: <unset>
RenewTime: Sun, 05 May 2024 21:52:19 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sun, 05 May 2024 21:47:37 +0000 Sun, 05 May 2024 21:43:43 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sun, 05 May 2024 21:47:37 +0000 Sun, 05 May 2024 21:43:43 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sun, 05 May 2024 21:47:37 +0000 Sun, 05 May 2024 21:43:43 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sun, 05 May 2024 21:47:37 +0000 Sun, 05 May 2024 21:44:09 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.85.2
Hostname: old-k8s-version-038518
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022560Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022560Ki
pods: 110
System Info:
Machine ID: 8c916546898b477783830855ef20e0bf
System UUID: 3e807815-91f0-429f-835d-736976cf9411
Boot ID: b80f7f77-6f48-4e21-bf0a-ad7f3175b1cd
Kernel Version: 5.15.0-1058-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.6.31
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m38s
kube-system coredns-74ff55c5b-6mbxd 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m17s
kube-system etcd-old-k8s-version-038518 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m25s
kube-system kindnet-phdxn 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 8m17s
kube-system kube-apiserver-old-k8s-version-038518 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m25s
kube-system kube-controller-manager-old-k8s-version-038518 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m25s
kube-system kube-proxy-cfmwt 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m17s
kube-system kube-scheduler-old-k8s-version-038518 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m25s
kube-system metrics-server-9975d5f86-chxxc 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m26s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m16s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-fzgzb 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m32s
kubernetes-dashboard kubernetes-dashboard-cd95d586-jx84w 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m32s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m44s (x5 over 8m44s) kubelet Node old-k8s-version-038518 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m44s (x4 over 8m44s) kubelet Node old-k8s-version-038518 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m44s (x5 over 8m44s) kubelet Node old-k8s-version-038518 status is now: NodeHasSufficientPID
Normal Starting 8m25s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m25s kubelet Node old-k8s-version-038518 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m25s kubelet Node old-k8s-version-038518 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m25s kubelet Node old-k8s-version-038518 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m25s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m17s kubelet Node old-k8s-version-038518 status is now: NodeReady
Normal Starting 8m16s kube-proxy Starting kube-proxy.
Normal Starting 5m58s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 5m58s (x8 over 5m58s) kubelet Node old-k8s-version-038518 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m58s (x7 over 5m58s) kubelet Node old-k8s-version-038518 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m58s (x8 over 5m58s) kubelet Node old-k8s-version-038518 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 5m58s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m47s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.001148] FS-Cache: O-key=[8] 'c83e5c0100000000'
[ +0.000760] FS-Cache: N-cookie c=00000043 [p=00000039 fl=2 nc=0 na=1]
[ +0.001004] FS-Cache: N-cookie d=000000000fe991e0{9p.inode} n=00000000bf18b6e8
[ +0.001126] FS-Cache: N-key=[8] 'c83e5c0100000000'
[ +2.757618] FS-Cache: Duplicate cookie detected
[ +0.000703] FS-Cache: O-cookie c=0000003a [p=00000039 fl=226 nc=0 na=1]
[ +0.001052] FS-Cache: O-cookie d=000000000fe991e0{9p.inode} n=00000000b564bb6e
[ +0.001094] FS-Cache: O-key=[8] 'c73e5c0100000000'
[ +0.000812] FS-Cache: N-cookie c=00000045 [p=00000039 fl=2 nc=0 na=1]
[ +0.000938] FS-Cache: N-cookie d=000000000fe991e0{9p.inode} n=00000000778622a1
[ +0.001058] FS-Cache: N-key=[8] 'c73e5c0100000000'
[ +0.354704] FS-Cache: Duplicate cookie detected
[ +0.000704] FS-Cache: O-cookie c=0000003f [p=00000039 fl=226 nc=0 na=1]
[ +0.000968] FS-Cache: O-cookie d=000000000fe991e0{9p.inode} n=00000000a043877c
[ +0.001146] FS-Cache: O-key=[8] 'cd3e5c0100000000'
[ +0.000706] FS-Cache: N-cookie c=00000046 [p=00000039 fl=2 nc=0 na=1]
[ +0.000975] FS-Cache: N-cookie d=000000000fe991e0{9p.inode} n=000000004aee4f1f
[ +0.001059] FS-Cache: N-key=[8] 'cd3e5c0100000000'
[ +3.637649] FS-Cache: Duplicate cookie detected
[ +0.000709] FS-Cache: O-cookie c=00000049 [p=00000002 fl=222 nc=0 na=1]
[ +0.001060] FS-Cache: O-cookie d=000000005a3e37e8{9P.session} n=000000009a84e7b1
[ +0.001216] FS-Cache: O-key=[10] '34323939323632373931'
[ +0.000828] FS-Cache: N-cookie c=0000004a [p=00000002 fl=2 nc=0 na=1]
[ +0.000912] FS-Cache: N-cookie d=000000005a3e37e8{9P.session} n=00000000702de98a
[ +0.001228] FS-Cache: N-key=[10] '34323939323632373931'
==> etcd [580e75f9f31dafb32fc2f7dbacfb021fca77474ee298a6ed5835a83572ff441a] <==
2024-05-05 21:48:19.319773 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:48:29.318921 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:48:39.318858 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:48:49.318747 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:48:59.318808 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:49:09.318741 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:49:19.318860 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:49:29.318731 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:49:39.318883 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:49:49.318843 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:49:59.319015 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:50:09.318716 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:50:19.318903 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:50:29.318987 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:50:39.318735 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:50:49.318728 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:50:59.318791 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:51:09.318831 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:51:19.319205 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:51:29.318840 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:51:39.318840 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:51:49.318891 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:51:59.325248 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:52:09.319020 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:52:19.318702 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [9067c10ea9a99ed6a32fe6eb91c9516cb585fb511f405daf4626d97a5236dde0] <==
raft2024/05/05 21:43:43 INFO: 9f0758e1c58a86ed is starting a new election at term 1
raft2024/05/05 21:43:43 INFO: 9f0758e1c58a86ed became candidate at term 2
raft2024/05/05 21:43:43 INFO: 9f0758e1c58a86ed received MsgVoteResp from 9f0758e1c58a86ed at term 2
raft2024/05/05 21:43:43 INFO: 9f0758e1c58a86ed became leader at term 2
raft2024/05/05 21:43:43 INFO: raft.node: 9f0758e1c58a86ed elected leader 9f0758e1c58a86ed at term 2
2024-05-05 21:43:43.431429 I | etcdserver: published {Name:old-k8s-version-038518 ClientURLs:[https://192.168.85.2:2379]} to cluster 68eaea490fab4e05
2024-05-05 21:43:43.431762 I | embed: ready to serve client requests
2024-05-05 21:43:43.431930 I | etcdserver: setting up the initial cluster version to 3.4
2024-05-05 21:43:43.432080 I | embed: ready to serve client requests
2024-05-05 21:43:43.432549 N | etcdserver/membership: set the initial cluster version to 3.4
2024-05-05 21:43:43.432724 I | etcdserver/api: enabled capabilities for version 3.4
2024-05-05 21:43:43.439509 I | embed: serving client requests on 192.168.85.2:2379
2024-05-05 21:43:43.451699 I | embed: serving client requests on 127.0.0.1:2379
2024-05-05 21:44:07.239282 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:44:14.417998 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:44:24.418050 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:44:34.417970 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:44:44.417936 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:44:54.418063 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:45:04.418002 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:45:14.419135 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:45:24.418014 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:45:34.418587 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:45:44.417855 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-05 21:45:54.418393 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
21:52:26 up 5:34, 0 users, load average: 2.48, 1.91, 2.24
Linux old-k8s-version-038518 5.15.0-1058-aws #64~20.04.1-Ubuntu SMP Tue Apr 9 11:11:55 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [7c36c2442ceb7ea588207eeb243a163d370cc67473ad5096314a4b9f8bf196cb] <==
I0505 21:44:11.605217 1 main.go:116] setting mtu 1500 for CNI
I0505 21:44:11.605227 1 main.go:146] kindnetd IP family: "ipv4"
I0505 21:44:11.605239 1 main.go:150] noMask IPv4 subnets: [10.244.0.0/16]
I0505 21:44:11.997751 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:44:11.998029 1 main.go:227] handling current node
I0505 21:44:22.018561 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:44:22.018591 1 main.go:227] handling current node
I0505 21:44:32.036258 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:44:32.036288 1 main.go:227] handling current node
I0505 21:44:42.045081 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:44:42.045110 1 main.go:227] handling current node
I0505 21:44:52.063323 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:44:52.063350 1 main.go:227] handling current node
I0505 21:45:02.074429 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:45:02.074467 1 main.go:227] handling current node
I0505 21:45:12.087759 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:45:12.087787 1 main.go:227] handling current node
I0505 21:45:22.127838 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:45:22.128200 1 main.go:227] handling current node
I0505 21:45:32.143995 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:45:32.144021 1 main.go:227] handling current node
I0505 21:45:42.152428 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:45:42.152458 1 main.go:227] handling current node
I0505 21:45:52.166832 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:45:52.166861 1 main.go:227] handling current node
==> kindnet [faa0225deba398d4a6dbde18c4021422a8598fa18e0944489f35b4a7564593a9] <==
I0505 21:50:20.302740 1 main.go:227] handling current node
I0505 21:50:30.321587 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:50:30.321615 1 main.go:227] handling current node
I0505 21:50:40.325430 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:50:40.325462 1 main.go:227] handling current node
I0505 21:50:50.344033 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:50:50.344058 1 main.go:227] handling current node
I0505 21:51:00.360320 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:51:00.360354 1 main.go:227] handling current node
I0505 21:51:10.370178 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:51:10.370209 1 main.go:227] handling current node
I0505 21:51:20.387240 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:51:20.387268 1 main.go:227] handling current node
I0505 21:51:30.406206 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:51:30.406235 1 main.go:227] handling current node
I0505 21:51:40.415477 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:51:40.415507 1 main.go:227] handling current node
I0505 21:51:50.431093 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:51:50.431122 1 main.go:227] handling current node
I0505 21:52:00.446430 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:52:00.446463 1 main.go:227] handling current node
I0505 21:52:10.455490 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:52:10.458125 1 main.go:227] handling current node
I0505 21:52:20.474617 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0505 21:52:20.474644 1 main.go:227] handling current node
==> kube-apiserver [0441347974720e9d65c1d5094d8ca940394afc2d22b6fc51a6a18f4b1ba45061] <==
I0505 21:43:50.427138 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I0505 21:43:50.427164 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0505 21:43:50.916361 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0505 21:43:50.958335 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0505 21:43:51.071643 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.85.2]
I0505 21:43:51.072907 1 controller.go:606] quota admission added evaluator for: endpoints
I0505 21:43:51.077830 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0505 21:43:51.424646 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0505 21:43:52.177106 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0505 21:43:52.857430 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0505 21:43:52.944094 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0505 21:44:09.054046 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0505 21:44:09.062136 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0505 21:44:21.214265 1 client.go:360] parsed scheme: "passthrough"
I0505 21:44:21.214312 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0505 21:44:21.214321 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0505 21:44:52.283436 1 client.go:360] parsed scheme: "passthrough"
I0505 21:44:52.283477 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0505 21:44:52.283486 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0505 21:45:29.486714 1 client.go:360] parsed scheme: "passthrough"
I0505 21:45:29.486801 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0505 21:45:29.486812 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
E0505 21:45:58.263366 1 upgradeaware.go:387] Error proxying data from backend to client: write tcp 192.168.85.2:8443->192.168.85.1:48354: write: connection reset by peer
E0505 21:45:58.263662 1 upgradeaware.go:373] Error proxying data from client to backend: write tcp 192.168.85.2:55636->192.168.85.2:10250: write: broken pipe
E0505 21:45:59.805726 1 available_controller.go:508] v1beta1.metrics.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1beta1.metrics.k8s.io": the object has been modified; please apply your changes to the latest version and try again
==> kube-apiserver [e507b898dd4977185ac9e4f35e0538853889d163fb8c2646196f755bfd9aeb50] <==
I0505 21:49:00.100362 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0505 21:49:00.100371 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0505 21:49:39.208629 1 handler_proxy.go:102] no RequestInfo found in the context
E0505 21:49:39.208702 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0505 21:49:39.208710 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0505 21:49:43.151424 1 client.go:360] parsed scheme: "passthrough"
I0505 21:49:43.151475 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0505 21:49:43.151485 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0505 21:50:18.669311 1 client.go:360] parsed scheme: "passthrough"
I0505 21:50:18.669363 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0505 21:50:18.669373 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0505 21:50:58.782657 1 client.go:360] parsed scheme: "passthrough"
I0505 21:50:58.782873 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0505 21:50:58.782916 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0505 21:51:33.759923 1 client.go:360] parsed scheme: "passthrough"
I0505 21:51:33.759971 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0505 21:51:33.760128 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0505 21:51:37.524940 1 handler_proxy.go:102] no RequestInfo found in the context
E0505 21:51:37.525017 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0505 21:51:37.525025 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0505 21:52:12.719161 1 client.go:360] parsed scheme: "passthrough"
I0505 21:52:12.719218 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0505 21:52:12.719227 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [6a301dfa69e35bc9c7dfd957f9098189bef6c3a23dfdee95d5dfe176ee47a84e] <==
I0505 21:44:09.078661 1 shared_informer.go:247] Caches are synced for job
I0505 21:44:09.083262 1 shared_informer.go:247] Caches are synced for endpoint_slice
I0505 21:44:09.120157 1 event.go:291] "Event occurred" object="kube-system/kube-controller-manager-old-k8s-version-038518" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0505 21:44:09.121603 1 event.go:291] "Event occurred" object="kube-system/kube-apiserver-old-k8s-version-038518" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0505 21:44:09.123120 1 shared_informer.go:247] Caches are synced for endpoint_slice_mirroring
I0505 21:44:09.133512 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-n6rq4"
I0505 21:44:09.171575 1 shared_informer.go:247] Caches are synced for endpoint
I0505 21:44:09.171642 1 shared_informer.go:247] Caches are synced for resource quota
I0505 21:44:09.176354 1 shared_informer.go:247] Caches are synced for resource quota
I0505 21:44:09.191532 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-6mbxd"
I0505 21:44:09.222196 1 shared_informer.go:247] Caches are synced for disruption
I0505 21:44:09.222411 1 disruption.go:339] Sending events to api server.
I0505 21:44:09.269051 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-cfmwt"
I0505 21:44:09.269854 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-phdxn"
I0505 21:44:09.328154 1 shared_informer.go:247] Caches are synced for attach detach
I0505 21:44:09.457902 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
E0505 21:44:09.503608 1 daemon_controller.go:320] kube-system/kindnet failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kindnet", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"de7efa94-223b-4167-ad2d-d3f38250966b", ResourceVersion:"282", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63850542233, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1", "kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"apps/v1\",\"kind\":\"DaemonSet\",\"metadata\":{\"annotations\":{},\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"},\"name\":\"kindnet\",\"namespace\":\"kube-system\"},\"spec\":{\"selector\":{\"matchLabels\":{\"app\":\"k
indnet\"}},\"template\":{\"metadata\":{\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"}},\"spec\":{\"containers\":[{\"env\":[{\"name\":\"HOST_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.hostIP\"}}},{\"name\":\"POD_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.podIP\"}}},{\"name\":\"POD_SUBNET\",\"value\":\"10.244.0.0/16\"}],\"image\":\"docker.io/kindest/kindnetd:v20240202-8f1494ea\",\"name\":\"kindnet-cni\",\"resources\":{\"limits\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"},\"requests\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"}},\"securityContext\":{\"capabilities\":{\"add\":[\"NET_RAW\",\"NET_ADMIN\"]},\"privileged\":false},\"volumeMounts\":[{\"mountPath\":\"/etc/cni/net.d\",\"name\":\"cni-cfg\"},{\"mountPath\":\"/run/xtables.lock\",\"name\":\"xtables-lock\",\"readOnly\":false},{\"mountPath\":\"/lib/modules\",\"name\":\"lib-modules\",\"readOnly\":true}]}],\"hostNetwork\":true,\"serviceAccountName\":\"kindnet\",\"tolerations\":[{\"effect\":\"NoSchedule\",\"operator\
":\"Exists\"}],\"volumes\":[{\"hostPath\":{\"path\":\"/etc/cni/net.d\",\"type\":\"DirectoryOrCreate\"},\"name\":\"cni-cfg\"},{\"hostPath\":{\"path\":\"/run/xtables.lock\",\"type\":\"FileOrCreate\"},\"name\":\"xtables-lock\"},{\"hostPath\":{\"path\":\"/lib/modules\"},\"name\":\"lib-modules\"}]}}}}\n"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubectl-client-side-apply", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4000e4e460), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4000e4e480)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0x4000e4e4a0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string
{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"cni-cfg", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4000e4e4c0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil),
FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4000e4e4e0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Glust
erfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4000e4e500), EmptyDi
r:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil),
PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kindnet-cni", Image:"docker.io/kindest/kindnetd:v20240202-8f1494ea", Command:[]string(nil), Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"HOST_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4000e4e520)}, v1.EnvVar{Name:"POD_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4000e4e560)}, v1.EnvVar{Name:"POD_SUBNET", Value:"10.244.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:
0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"cni-cfg", ReadOnly:false, MountPath:"/etc/cni/net.d", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:
(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x40008385a0), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4000e75ec8), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"kindnet", DeprecatedServiceAccount:"kindnet", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x4000db6000), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}},
HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x400000f998)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4000e75f10)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kindnet": the object has been modified; please apply your changes to the latest version and try again
E0505 21:44:09.507473 1 daemon_controller.go:320] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"4e9cb4bf-921e-4d73-a905-f48eb9df9cea", ResourceVersion:"269", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63850542232, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4000e4e340), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4000e4e360)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.
LabelSelector)(0x4000e4e380), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Gl
usterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0x4000e103c0), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4000e4e
3a0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeS
ource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4000e4e3c0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil),
AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.20.0", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4000e4e400)}}, Resources:v1.R
esourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x4000838540), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPo
licy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4000e75b58), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x4000d1df10), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), Runtime
ClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x400000f988)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4000e75c28)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest version and try again
I0505 21:44:09.722944 1 shared_informer.go:247] Caches are synced for garbage collector
I0505 21:44:09.722966 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0505 21:44:09.758120 1 shared_informer.go:247] Caches are synced for garbage collector
I0505 21:44:10.597807 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0505 21:44:10.616969 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-n6rq4"
I0505 21:44:14.272626 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I0505 21:45:59.274157 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
==> kube-controller-manager [a288efd4ebd942b45a3ca58128b3e8296d0e2c8fda2cd9104f1c23acb6ebdca9] <==
W0505 21:47:59.623843 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0505 21:48:25.714693 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0505 21:48:31.274397 1 request.go:655] Throttling request took 1.048303619s, request: GET:https://192.168.85.2:8443/apis/scheduling.k8s.io/v1?timeout=32s
W0505 21:48:32.125815 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0505 21:48:56.216528 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0505 21:49:03.776380 1 request.go:655] Throttling request took 1.048244503s, request: GET:https://192.168.85.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0505 21:49:04.628279 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0505 21:49:26.721531 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0505 21:49:36.278743 1 request.go:655] Throttling request took 1.047985676s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0505 21:49:37.130094 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0505 21:49:57.222691 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0505 21:50:08.780581 1 request.go:655] Throttling request took 1.048394455s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0505 21:50:09.632045 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0505 21:50:27.724378 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0505 21:50:41.282451 1 request.go:655] Throttling request took 1.048220445s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0505 21:50:42.134213 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0505 21:50:58.226327 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0505 21:51:13.784844 1 request.go:655] Throttling request took 1.048490149s, request: GET:https://192.168.85.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0505 21:51:14.636584 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0505 21:51:28.728136 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0505 21:51:46.286564 1 request.go:655] Throttling request took 1.048243958s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0505 21:51:47.138086 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0505 21:51:59.398308 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0505 21:52:18.788765 1 request.go:655] Throttling request took 1.048326456s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0505 21:52:19.643522 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-proxy [0eedfa9ede7ada50303473ae02419af0e8e08f080f59c78fde9947be8067a50c] <==
I0505 21:46:39.339694 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0505 21:46:39.340387 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0505 21:46:39.362521 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0505 21:46:39.363082 1 server_others.go:185] Using iptables Proxier.
I0505 21:46:39.364099 1 server.go:650] Version: v1.20.0
I0505 21:46:39.365148 1 config.go:315] Starting service config controller
I0505 21:46:39.365291 1 shared_informer.go:240] Waiting for caches to sync for service config
I0505 21:46:39.365455 1 config.go:224] Starting endpoint slice config controller
I0505 21:46:39.367881 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0505 21:46:39.368049 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0505 21:46:39.465439 1 shared_informer.go:247] Caches are synced for service config
==> kube-proxy [64ef7f857a2f76b261914c70bce060b265f43d38371ea0ca161a99a9d7c3ef2d] <==
I0505 21:44:10.125373 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0505 21:44:10.125469 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0505 21:44:10.145368 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0505 21:44:10.145459 1 server_others.go:185] Using iptables Proxier.
I0505 21:44:10.145683 1 server.go:650] Version: v1.20.0
I0505 21:44:10.146193 1 config.go:315] Starting service config controller
I0505 21:44:10.146202 1 shared_informer.go:240] Waiting for caches to sync for service config
I0505 21:44:10.147041 1 config.go:224] Starting endpoint slice config controller
I0505 21:44:10.147090 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0505 21:44:10.246867 1 shared_informer.go:247] Caches are synced for service config
I0505 21:44:10.247923 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-scheduler [0dc3b13f77012b59a798a53b123a1eb333fec5c5fef1d4e079e3060d22355c74] <==
W0505 21:43:49.588926 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0505 21:43:49.588938 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0505 21:43:49.588943 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0505 21:43:49.731352 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0505 21:43:49.731650 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0505 21:43:49.735391 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0505 21:43:49.735591 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0505 21:43:49.754467 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0505 21:43:49.764593 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0505 21:43:49.764835 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0505 21:43:49.765040 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0505 21:43:49.765244 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0505 21:43:49.765442 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0505 21:43:49.765646 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0505 21:43:49.765891 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0505 21:43:49.766206 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0505 21:43:49.766393 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0505 21:43:49.766589 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0505 21:43:49.766794 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0505 21:43:50.652088 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0505 21:43:50.654310 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0505 21:43:50.678423 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0505 21:43:50.744695 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0505 21:43:50.904828 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
I0505 21:43:52.735705 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [a9b1a797d9ee2c00fbed142aaecb2de99854f0ab6cf2c751c17eb782676547d8] <==
I0505 21:46:31.091734 1 serving.go:331] Generated self-signed cert in-memory
W0505 21:46:36.322205 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0505 21:46:36.322495 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0505 21:46:36.322599 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0505 21:46:36.322752 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0505 21:46:36.758735 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0505 21:46:36.759000 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0505 21:46:36.759168 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0505 21:46:36.759187 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0505 21:46:36.959753 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
May 05 21:50:51 old-k8s-version-038518 kubelet[658]: I0505 21:50:51.485073 658 scope.go:95] [topologymanager] RemoveContainer - Container ID: 0ff0bca8c2ebed85a790886c4ab1dcd515228ec21e5882a99940fda26c050ae7
May 05 21:50:51 old-k8s-version-038518 kubelet[658]: E0505 21:50:51.485413 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
May 05 21:51:00 old-k8s-version-038518 kubelet[658]: E0505 21:51:00.486225 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 05 21:51:06 old-k8s-version-038518 kubelet[658]: I0505 21:51:06.484986 658 scope.go:95] [topologymanager] RemoveContainer - Container ID: 0ff0bca8c2ebed85a790886c4ab1dcd515228ec21e5882a99940fda26c050ae7
May 05 21:51:06 old-k8s-version-038518 kubelet[658]: E0505 21:51:06.485743 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
May 05 21:51:13 old-k8s-version-038518 kubelet[658]: E0505 21:51:13.485872 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 05 21:51:20 old-k8s-version-038518 kubelet[658]: I0505 21:51:20.485071 658 scope.go:95] [topologymanager] RemoveContainer - Container ID: 0ff0bca8c2ebed85a790886c4ab1dcd515228ec21e5882a99940fda26c050ae7
May 05 21:51:20 old-k8s-version-038518 kubelet[658]: E0505 21:51:20.485385 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
May 05 21:51:26 old-k8s-version-038518 kubelet[658]: E0505 21:51:26.486692 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 05 21:51:34 old-k8s-version-038518 kubelet[658]: I0505 21:51:34.484976 658 scope.go:95] [topologymanager] RemoveContainer - Container ID: 0ff0bca8c2ebed85a790886c4ab1dcd515228ec21e5882a99940fda26c050ae7
May 05 21:51:34 old-k8s-version-038518 kubelet[658]: E0505 21:51:34.485322 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
May 05 21:51:37 old-k8s-version-038518 kubelet[658]: E0505 21:51:37.485828 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 05 21:51:46 old-k8s-version-038518 kubelet[658]: I0505 21:51:46.485090 658 scope.go:95] [topologymanager] RemoveContainer - Container ID: 0ff0bca8c2ebed85a790886c4ab1dcd515228ec21e5882a99940fda26c050ae7
May 05 21:51:46 old-k8s-version-038518 kubelet[658]: E0505 21:51:46.485958 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
May 05 21:51:51 old-k8s-version-038518 kubelet[658]: E0505 21:51:51.485703 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 05 21:51:59 old-k8s-version-038518 kubelet[658]: I0505 21:51:59.485041 658 scope.go:95] [topologymanager] RemoveContainer - Container ID: 0ff0bca8c2ebed85a790886c4ab1dcd515228ec21e5882a99940fda26c050ae7
May 05 21:51:59 old-k8s-version-038518 kubelet[658]: E0505 21:51:59.485419 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
May 05 21:52:04 old-k8s-version-038518 kubelet[658]: E0505 21:52:04.489232 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 05 21:52:13 old-k8s-version-038518 kubelet[658]: I0505 21:52:13.485002 658 scope.go:95] [topologymanager] RemoveContainer - Container ID: 0ff0bca8c2ebed85a790886c4ab1dcd515228ec21e5882a99940fda26c050ae7
May 05 21:52:13 old-k8s-version-038518 kubelet[658]: E0505 21:52:13.485407 658 pod_workers.go:191] Error syncing pod 4371e120-527e-4364-8242-6c954cd47c0c ("dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fzgzb_kubernetes-dashboard(4371e120-527e-4364-8242-6c954cd47c0c)"
May 05 21:52:15 old-k8s-version-038518 kubelet[658]: E0505 21:52:15.502632 658 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host
May 05 21:52:15 old-k8s-version-038518 kubelet[658]: E0505 21:52:15.503066 658 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host
May 05 21:52:15 old-k8s-version-038518 kubelet[658]: E0505 21:52:15.503258 658 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-77bv5,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-chxxc_kube-system(e6807ce
3-ac2d-480a-884f-a68aace2c0d9): ErrImagePull: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host
May 05 21:52:15 old-k8s-version-038518 kubelet[658]: E0505 21:52:15.503299 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
May 05 21:52:26 old-k8s-version-038518 kubelet[658]: E0505 21:52:26.518621 658 pod_workers.go:191] Error syncing pod e6807ce3-ac2d-480a-884f-a68aace2c0d9 ("metrics-server-9975d5f86-chxxc_kube-system(e6807ce3-ac2d-480a-884f-a68aace2c0d9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
==> kubernetes-dashboard [e84d32f53ec5f8ce10bda8f22df215950b0a08e1924b9f83fa3e62918c0878b0] <==
2024/05/05 21:47:02 Using namespace: kubernetes-dashboard
2024/05/05 21:47:02 Using in-cluster config to connect to apiserver
2024/05/05 21:47:02 Using secret token for csrf signing
2024/05/05 21:47:02 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/05/05 21:47:02 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/05/05 21:47:02 Successful initial request to the apiserver, version: v1.20.0
2024/05/05 21:47:02 Generating JWE encryption key
2024/05/05 21:47:02 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/05/05 21:47:02 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/05/05 21:47:03 Initializing JWE encryption key from synchronized object
2024/05/05 21:47:03 Creating in-cluster Sidecar client
2024/05/05 21:47:03 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/05 21:47:03 Serving insecurely on HTTP port: 9090
2024/05/05 21:47:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/05 21:48:03 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/05 21:48:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/05 21:49:03 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/05 21:49:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/05 21:50:03 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/05 21:50:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/05 21:51:03 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/05 21:51:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/05 21:52:03 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/05 21:47:02 Starting overwatch
==> storage-provisioner [3fc65d073b431f4914e162dd4c0da74d3a8cc7f545665adbc031bd3869d1bbd2] <==
I0505 21:46:38.348605 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0505 21:47:08.351023 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
==> storage-provisioner [48a51b2077e2dec5b1c8092e8da9e537f72f9d962aff852c13a67a6ca472dd16] <==
I0505 21:47:23.679896 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0505 21:47:23.701380 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0505 21:47:23.701591 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0505 21:47:41.181739 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0505 21:47:41.182250 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-038518_93d22fe8-4e8f-48a5-baab-1567b0917951!
I0505 21:47:41.182047 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"f67d90c3-9e60-4a48-b6c3-ec6d75dd49ee", APIVersion:"v1", ResourceVersion:"861", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-038518_93d22fe8-4e8f-48a5-baab-1567b0917951 became leader
I0505 21:47:41.282817 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-038518_93d22fe8-4e8f-48a5-baab-1567b0917951!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-038518 -n old-k8s-version-038518
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-038518 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-chxxc
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-038518 describe pod metrics-server-9975d5f86-chxxc
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-038518 describe pod metrics-server-9975d5f86-chxxc: exit status 1 (103.058185ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-chxxc" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-038518 describe pod metrics-server-9975d5f86-chxxc: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (375.93s)