=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-986384 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=docker --kubernetes-version=v1.20.0
E0422 18:01:40.126600 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/flannel-060426/client.crt: no such file or directory
E0422 18:01:49.507665 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/kindnet-060426/client.crt: no such file or directory
E0422 18:02:00.607125 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/flannel-060426/client.crt: no such file or directory
E0422 18:02:17.192199 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/kindnet-060426/client.crt: no such file or directory
E0422 18:02:17.421354 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/enable-default-cni-060426/client.crt: no such file or directory
E0422 18:02:24.998007 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/false-060426/client.crt: no such file or directory
E0422 18:02:31.894015 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/skaffold-819699/client.crt: no such file or directory
E0422 18:02:41.567931 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/flannel-060426/client.crt: no such file or directory
E0422 18:02:57.000255 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/calico-060426/client.crt: no such file or directory
E0422 18:03:03.110437 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/bridge-060426/client.crt: no such file or directory
E0422 18:03:03.115810 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/bridge-060426/client.crt: no such file or directory
E0422 18:03:03.126100 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/bridge-060426/client.crt: no such file or directory
E0422 18:03:03.146427 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/bridge-060426/client.crt: no such file or directory
E0422 18:03:03.186802 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/bridge-060426/client.crt: no such file or directory
E0422 18:03:03.267076 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/bridge-060426/client.crt: no such file or directory
E0422 18:03:03.427454 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/bridge-060426/client.crt: no such file or directory
E0422 18:03:03.747863 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/bridge-060426/client.crt: no such file or directory
E0422 18:03:04.388751 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/bridge-060426/client.crt: no such file or directory
E0422 18:03:05.669227 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/bridge-060426/client.crt: no such file or directory
E0422 18:03:08.229940 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/bridge-060426/client.crt: no such file or directory
E0422 18:03:13.350147 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/bridge-060426/client.crt: no such file or directory
E0422 18:03:23.590304 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/bridge-060426/client.crt: no such file or directory
E0422 18:03:24.685479 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/calico-060426/client.crt: no such file or directory
E0422 18:03:37.114822 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/kubenet-060426/client.crt: no such file or directory
E0422 18:03:37.120052 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/kubenet-060426/client.crt: no such file or directory
E0422 18:03:37.130291 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/kubenet-060426/client.crt: no such file or directory
E0422 18:03:37.150534 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/kubenet-060426/client.crt: no such file or directory
E0422 18:03:37.190773 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/kubenet-060426/client.crt: no such file or directory
E0422 18:03:37.271038 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/kubenet-060426/client.crt: no such file or directory
E0422 18:03:37.431445 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/kubenet-060426/client.crt: no such file or directory
E0422 18:03:37.751879 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/kubenet-060426/client.crt: no such file or directory
E0422 18:03:38.392169 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/kubenet-060426/client.crt: no such file or directory
E0422 18:03:39.341968 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/enable-default-cni-060426/client.crt: no such file or directory
E0422 18:03:39.672764 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/kubenet-060426/client.crt: no such file or directory
E0422 18:03:42.233123 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/kubenet-060426/client.crt: no such file or directory
E0422 18:03:44.071020 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/bridge-060426/client.crt: no such file or directory
E0422 18:03:46.154639 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/custom-flannel-060426/client.crt: no such file or directory
E0422 18:03:47.354061 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/kubenet-060426/client.crt: no such file or directory
E0422 18:03:57.595276 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/kubenet-060426/client.crt: no such file or directory
E0422 18:04:03.488239 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/flannel-060426/client.crt: no such file or directory
E0422 18:04:13.841711 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/custom-flannel-060426/client.crt: no such file or directory
E0422 18:04:18.075610 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/kubenet-060426/client.crt: no such file or directory
E0422 18:04:25.032102 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/bridge-060426/client.crt: no such file or directory
E0422 18:04:41.154759 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/false-060426/client.crt: no such file or directory
E0422 18:04:45.110120 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/addons-613799/client.crt: no such file or directory
E0422 18:04:59.036044 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/kubenet-060426/client.crt: no such file or directory
E0422 18:05:08.839165 7728 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/false-060426/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-986384 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=docker --kubernetes-version=v1.20.0: exit status 102 (6m12.810640522s)
-- stdout --
* [old-k8s-version-986384] minikube v1.33.0 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=18706
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18706-2371/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18706-2371/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.30.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.0
* Using the docker driver based on existing profile
* Starting "old-k8s-version-986384" primary control-plane node in "old-k8s-version-986384" cluster
* Pulling base image v0.0.43-1713736339-18706 ...
* Restarting existing docker container for "old-k8s-version-986384" ...
* Preparing Kubernetes v1.20.0 on Docker 26.0.2 ...
* Verifying Kubernetes components...
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-986384 addons enable metrics-server
* Enabled addons: storage-provisioner, dashboard, metrics-server, default-storageclass
-- /stdout --
** stderr **
I0422 18:01:39.097567 365956 out.go:291] Setting OutFile to fd 1 ...
I0422 18:01:39.097748 365956 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0422 18:01:39.097757 365956 out.go:304] Setting ErrFile to fd 2...
I0422 18:01:39.097763 365956 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0422 18:01:39.098004 365956 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18706-2371/.minikube/bin
I0422 18:01:39.098390 365956 out.go:298] Setting JSON to false
I0422 18:01:39.099593 365956 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":6246,"bootTime":1713802653,"procs":263,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
I0422 18:01:39.099667 365956 start.go:139] virtualization:
I0422 18:01:39.104069 365956 out.go:177] * [old-k8s-version-986384] minikube v1.33.0 on Ubuntu 20.04 (arm64)
I0422 18:01:39.106595 365956 out.go:177] - MINIKUBE_LOCATION=18706
I0422 18:01:39.109008 365956 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0422 18:01:39.106625 365956 notify.go:220] Checking for updates...
I0422 18:01:39.113385 365956 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18706-2371/kubeconfig
I0422 18:01:39.116201 365956 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18706-2371/.minikube
I0422 18:01:39.118454 365956 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0422 18:01:39.120587 365956 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0422 18:01:39.123368 365956 config.go:182] Loaded profile config "old-k8s-version-986384": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0
I0422 18:01:39.125860 365956 out.go:177] * Kubernetes 1.30.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.0
I0422 18:01:39.127666 365956 driver.go:392] Setting default libvirt URI to qemu:///system
I0422 18:01:39.147403 365956 docker.go:122] docker version: linux-26.0.2:Docker Engine - Community
I0422 18:01:39.147585 365956 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0422 18:01:39.210519 365956 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:37 OomKillDisable:true NGoroutines:52 SystemTime:2024-04-22 18:01:39.200168424 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215101440 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:26.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1]] Warnings:<nil>}}
I0422 18:01:39.210627 365956 docker.go:295] overlay module found
I0422 18:01:39.213502 365956 out.go:177] * Using the docker driver based on existing profile
I0422 18:01:39.215421 365956 start.go:297] selected driver: docker
I0422 18:01:39.215440 365956 start.go:901] validating driver "docker" against &{Name:old-k8s-version-986384 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-986384 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountSt
ring:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0422 18:01:39.215555 365956 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0422 18:01:39.216372 365956 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0422 18:01:39.286165 365956 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:37 OomKillDisable:true NGoroutines:52 SystemTime:2024-04-22 18:01:39.277213909 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215101440 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:26.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1]] Warnings:<nil>}}
I0422 18:01:39.286519 365956 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0422 18:01:39.286575 365956 cni.go:84] Creating CNI manager for ""
I0422 18:01:39.286594 365956 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
I0422 18:01:39.286631 365956 start.go:340] cluster config:
{Name:old-k8s-version-986384 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-986384 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountI
P: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0422 18:01:39.290477 365956 out.go:177] * Starting "old-k8s-version-986384" primary control-plane node in "old-k8s-version-986384" cluster
I0422 18:01:39.292112 365956 cache.go:121] Beginning downloading kic base image for docker with docker
I0422 18:01:39.294273 365956 out.go:177] * Pulling base image v0.0.43-1713736339-18706 ...
I0422 18:01:39.296271 365956 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
I0422 18:01:39.296348 365956 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e in local docker daemon
I0422 18:01:39.296359 365956 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18706-2371/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4
I0422 18:01:39.296502 365956 cache.go:56] Caching tarball of preloaded images
I0422 18:01:39.296610 365956 preload.go:173] Found /home/jenkins/minikube-integration/18706-2371/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
I0422 18:01:39.296628 365956 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
I0422 18:01:39.296737 365956 profile.go:143] Saving config to /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/old-k8s-version-986384/config.json ...
I0422 18:01:39.310344 365956 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e in local docker daemon, skipping pull
I0422 18:01:39.310369 365956 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e exists in daemon, skipping load
I0422 18:01:39.310388 365956 cache.go:194] Successfully downloaded all kic artifacts
I0422 18:01:39.310421 365956 start.go:360] acquireMachinesLock for old-k8s-version-986384: {Name:mk06e93d32869e0d45661c0f3956bcfa019e47d4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0422 18:01:39.310497 365956 start.go:364] duration metric: took 51.666µs to acquireMachinesLock for "old-k8s-version-986384"
I0422 18:01:39.310525 365956 start.go:96] Skipping create...Using existing machine configuration
I0422 18:01:39.310535 365956 fix.go:54] fixHost starting:
I0422 18:01:39.310792 365956 cli_runner.go:164] Run: docker container inspect old-k8s-version-986384 --format={{.State.Status}}
I0422 18:01:39.325871 365956 fix.go:112] recreateIfNeeded on old-k8s-version-986384: state=Stopped err=<nil>
W0422 18:01:39.325907 365956 fix.go:138] unexpected machine state, will restart: <nil>
I0422 18:01:39.328385 365956 out.go:177] * Restarting existing docker container for "old-k8s-version-986384" ...
I0422 18:01:39.330755 365956 cli_runner.go:164] Run: docker start old-k8s-version-986384
I0422 18:01:39.650278 365956 cli_runner.go:164] Run: docker container inspect old-k8s-version-986384 --format={{.State.Status}}
I0422 18:01:39.668129 365956 kic.go:430] container "old-k8s-version-986384" state is running.
I0422 18:01:39.668516 365956 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-986384
I0422 18:01:39.699420 365956 profile.go:143] Saving config to /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/old-k8s-version-986384/config.json ...
I0422 18:01:39.699920 365956 machine.go:94] provisionDockerMachine start ...
I0422 18:01:39.699990 365956 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-986384
I0422 18:01:39.728937 365956 main.go:141] libmachine: Using SSH client type: native
I0422 18:01:39.729680 365956 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 33134 <nil> <nil>}
I0422 18:01:39.729697 365956 main.go:141] libmachine: About to run SSH command:
hostname
I0422 18:01:39.730381 365956 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0422 18:01:42.872376 365956 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-986384
I0422 18:01:42.872402 365956 ubuntu.go:169] provisioning hostname "old-k8s-version-986384"
I0422 18:01:42.872467 365956 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-986384
I0422 18:01:42.890582 365956 main.go:141] libmachine: Using SSH client type: native
I0422 18:01:42.890867 365956 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 33134 <nil> <nil>}
I0422 18:01:42.890886 365956 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-986384 && echo "old-k8s-version-986384" | sudo tee /etc/hostname
I0422 18:01:43.034637 365956 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-986384
I0422 18:01:43.034734 365956 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-986384
I0422 18:01:43.051111 365956 main.go:141] libmachine: Using SSH client type: native
I0422 18:01:43.051359 365956 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 33134 <nil> <nil>}
I0422 18:01:43.051375 365956 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-986384' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-986384/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-986384' | sudo tee -a /etc/hosts;
fi
fi
I0422 18:01:43.177187 365956 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0422 18:01:43.177216 365956 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18706-2371/.minikube CaCertPath:/home/jenkins/minikube-integration/18706-2371/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18706-2371/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18706-2371/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18706-2371/.minikube}
I0422 18:01:43.177234 365956 ubuntu.go:177] setting up certificates
I0422 18:01:43.177244 365956 provision.go:84] configureAuth start
I0422 18:01:43.177303 365956 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-986384
I0422 18:01:43.203475 365956 provision.go:143] copyHostCerts
I0422 18:01:43.203547 365956 exec_runner.go:144] found /home/jenkins/minikube-integration/18706-2371/.minikube/ca.pem, removing ...
I0422 18:01:43.203555 365956 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18706-2371/.minikube/ca.pem
I0422 18:01:43.203635 365956 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18706-2371/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18706-2371/.minikube/ca.pem (1078 bytes)
I0422 18:01:43.203732 365956 exec_runner.go:144] found /home/jenkins/minikube-integration/18706-2371/.minikube/cert.pem, removing ...
I0422 18:01:43.203737 365956 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18706-2371/.minikube/cert.pem
I0422 18:01:43.203762 365956 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18706-2371/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18706-2371/.minikube/cert.pem (1123 bytes)
I0422 18:01:43.203812 365956 exec_runner.go:144] found /home/jenkins/minikube-integration/18706-2371/.minikube/key.pem, removing ...
I0422 18:01:43.203816 365956 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18706-2371/.minikube/key.pem
I0422 18:01:43.203839 365956 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18706-2371/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18706-2371/.minikube/key.pem (1675 bytes)
I0422 18:01:43.203884 365956 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18706-2371/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18706-2371/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18706-2371/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-986384 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-986384]
I0422 18:01:44.043536 365956 provision.go:177] copyRemoteCerts
I0422 18:01:44.043624 365956 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0422 18:01:44.043676 365956 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-986384
I0422 18:01:44.061005 365956 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33134 SSHKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/machines/old-k8s-version-986384/id_rsa Username:docker}
I0422 18:01:44.158683 365956 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0422 18:01:44.186244 365956 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0422 18:01:44.212243 365956 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0422 18:01:44.238471 365956 provision.go:87] duration metric: took 1.061213688s to configureAuth
I0422 18:01:44.238499 365956 ubuntu.go:193] setting minikube options for container-runtime
I0422 18:01:44.238702 365956 config.go:182] Loaded profile config "old-k8s-version-986384": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0
I0422 18:01:44.238765 365956 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-986384
I0422 18:01:44.262357 365956 main.go:141] libmachine: Using SSH client type: native
I0422 18:01:44.262617 365956 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 33134 <nil> <nil>}
I0422 18:01:44.262632 365956 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0422 18:01:44.389358 365956 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0422 18:01:44.389382 365956 ubuntu.go:71] root file system type: overlay
I0422 18:01:44.389499 365956 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
I0422 18:01:44.389609 365956 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-986384
I0422 18:01:44.405634 365956 main.go:141] libmachine: Using SSH client type: native
I0422 18:01:44.405894 365956 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 33134 <nil> <nil>}
I0422 18:01:44.405976 365956 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0422 18:01:44.542465 365956 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0422 18:01:44.542560 365956 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-986384
I0422 18:01:44.559302 365956 main.go:141] libmachine: Using SSH client type: native
I0422 18:01:44.559555 365956 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 33134 <nil> <nil>}
I0422 18:01:44.559583 365956 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0422 18:01:44.694484 365956 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0422 18:01:44.694507 365956 machine.go:97] duration metric: took 4.994572397s to provisionDockerMachine
I0422 18:01:44.694518 365956 start.go:293] postStartSetup for "old-k8s-version-986384" (driver="docker")
I0422 18:01:44.694530 365956 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0422 18:01:44.694606 365956 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0422 18:01:44.694650 365956 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-986384
I0422 18:01:44.711053 365956 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33134 SSHKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/machines/old-k8s-version-986384/id_rsa Username:docker}
I0422 18:01:44.810561 365956 ssh_runner.go:195] Run: cat /etc/os-release
I0422 18:01:44.813773 365956 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0422 18:01:44.813809 365956 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0422 18:01:44.813819 365956 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0422 18:01:44.813827 365956 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0422 18:01:44.813845 365956 filesync.go:126] Scanning /home/jenkins/minikube-integration/18706-2371/.minikube/addons for local assets ...
I0422 18:01:44.813910 365956 filesync.go:126] Scanning /home/jenkins/minikube-integration/18706-2371/.minikube/files for local assets ...
I0422 18:01:44.813999 365956 filesync.go:149] local asset: /home/jenkins/minikube-integration/18706-2371/.minikube/files/etc/ssl/certs/77282.pem -> 77282.pem in /etc/ssl/certs
I0422 18:01:44.814122 365956 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0422 18:01:44.823808 365956 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/files/etc/ssl/certs/77282.pem --> /etc/ssl/certs/77282.pem (1708 bytes)
I0422 18:01:44.848822 365956 start.go:296] duration metric: took 154.28891ms for postStartSetup
I0422 18:01:44.848906 365956 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0422 18:01:44.848955 365956 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-986384
I0422 18:01:44.864797 365956 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33134 SSHKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/machines/old-k8s-version-986384/id_rsa Username:docker}
I0422 18:01:44.957771 365956 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0422 18:01:44.962440 365956 fix.go:56] duration metric: took 5.651903998s for fixHost
I0422 18:01:44.962466 365956 start.go:83] releasing machines lock for "old-k8s-version-986384", held for 5.651954679s
I0422 18:01:44.962544 365956 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-986384
I0422 18:01:44.978340 365956 ssh_runner.go:195] Run: cat /version.json
I0422 18:01:44.978394 365956 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-986384
I0422 18:01:44.978651 365956 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0422 18:01:44.978714 365956 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-986384
I0422 18:01:44.993618 365956 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33134 SSHKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/machines/old-k8s-version-986384/id_rsa Username:docker}
I0422 18:01:44.998466 365956 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33134 SSHKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/machines/old-k8s-version-986384/id_rsa Username:docker}
I0422 18:01:45.270592 365956 ssh_runner.go:195] Run: systemctl --version
I0422 18:01:45.287904 365956 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0422 18:01:45.299846 365956 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0422 18:01:45.332289 365956 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0422 18:01:45.332492 365956 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
I0422 18:01:45.367976 365956 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
I0422 18:01:45.390876 365956 cni.go:308] configured [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0422 18:01:45.390959 365956 start.go:494] detecting cgroup driver to use...
I0422 18:01:45.391008 365956 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0422 18:01:45.391173 365956 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0422 18:01:45.418033 365956 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0422 18:01:45.429671 365956 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0422 18:01:45.444402 365956 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0422 18:01:45.444555 365956 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0422 18:01:45.459586 365956 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0422 18:01:45.472226 365956 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0422 18:01:45.485435 365956 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0422 18:01:45.496591 365956 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0422 18:01:45.507785 365956 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0422 18:01:45.519530 365956 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0422 18:01:45.529047 365956 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0422 18:01:45.538660 365956 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0422 18:01:45.631444 365956 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0422 18:01:45.743317 365956 start.go:494] detecting cgroup driver to use...
I0422 18:01:45.743427 365956 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0422 18:01:45.743505 365956 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0422 18:01:45.764224 365956 cruntime.go:279] skipping containerd shutdown because we are bound to it
I0422 18:01:45.764346 365956 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0422 18:01:45.786193 365956 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0422 18:01:45.812250 365956 ssh_runner.go:195] Run: which cri-dockerd
I0422 18:01:45.816133 365956 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0422 18:01:45.825426 365956 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
I0422 18:01:45.845763 365956 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0422 18:01:45.967986 365956 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0422 18:01:46.075277 365956 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I0422 18:01:46.075477 365956 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I0422 18:01:46.096266 365956 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0422 18:01:46.206944 365956 ssh_runner.go:195] Run: sudo systemctl restart docker
I0422 18:01:46.676238 365956 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0422 18:01:46.699732 365956 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0422 18:01:46.724329 365956 out.go:204] * Preparing Kubernetes v1.20.0 on Docker 26.0.2 ...
I0422 18:01:46.724525 365956 cli_runner.go:164] Run: docker network inspect old-k8s-version-986384 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0422 18:01:46.740301 365956 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0422 18:01:46.744443 365956 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0422 18:01:46.758844 365956 kubeadm.go:877] updating cluster {Name:old-k8s-version-986384 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-986384 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkin
s:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0422 18:01:46.758960 365956 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
I0422 18:01:46.759016 365956 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0422 18:01:46.779981 365956 docker.go:685] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
registry.k8s.io/kube-proxy:v1.20.0
k8s.gcr.io/kube-proxy:v1.20.0
k8s.gcr.io/kube-apiserver:v1.20.0
registry.k8s.io/kube-apiserver:v1.20.0
k8s.gcr.io/kube-controller-manager:v1.20.0
registry.k8s.io/kube-controller-manager:v1.20.0
registry.k8s.io/kube-scheduler:v1.20.0
k8s.gcr.io/kube-scheduler:v1.20.0
k8s.gcr.io/etcd:3.4.13-0
registry.k8s.io/etcd:3.4.13-0
k8s.gcr.io/coredns:1.7.0
registry.k8s.io/coredns:1.7.0
k8s.gcr.io/pause:3.2
registry.k8s.io/pause:3.2
gcr.io/k8s-minikube/busybox:1.28.4-glibc
-- /stdout --
I0422 18:01:46.780002 365956 docker.go:615] Images already preloaded, skipping extraction
I0422 18:01:46.780071 365956 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0422 18:01:46.799736 365956 docker.go:685] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-proxy:v1.20.0
registry.k8s.io/kube-proxy:v1.20.0
k8s.gcr.io/kube-controller-manager:v1.20.0
registry.k8s.io/kube-controller-manager:v1.20.0
k8s.gcr.io/kube-apiserver:v1.20.0
registry.k8s.io/kube-apiserver:v1.20.0
k8s.gcr.io/kube-scheduler:v1.20.0
registry.k8s.io/kube-scheduler:v1.20.0
k8s.gcr.io/etcd:3.4.13-0
registry.k8s.io/etcd:3.4.13-0
k8s.gcr.io/coredns:1.7.0
registry.k8s.io/coredns:1.7.0
k8s.gcr.io/pause:3.2
registry.k8s.io/pause:3.2
gcr.io/k8s-minikube/busybox:1.28.4-glibc
-- /stdout --
I0422 18:01:46.799758 365956 cache_images.go:84] Images are preloaded, skipping loading
I0422 18:01:46.799769 365956 kubeadm.go:928] updating node { 192.168.76.2 8443 v1.20.0 docker true true} ...
I0422 18:01:46.799873 365956 kubeadm.go:940] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-986384 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-986384 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0422 18:01:46.799933 365956 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0422 18:01:46.856725 365956 cni.go:84] Creating CNI manager for ""
I0422 18:01:46.856837 365956 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
I0422 18:01:46.856868 365956 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0422 18:01:46.856910 365956 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-986384 NodeName:old-k8s-version-986384 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticP
odPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0422 18:01:46.857052 365956 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-986384"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0422 18:01:46.857123 365956 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0422 18:01:46.867038 365956 binaries.go:44] Found k8s binaries, skipping transfer
I0422 18:01:46.867110 365956 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0422 18:01:46.876381 365956 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (348 bytes)
I0422 18:01:46.895376 365956 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0422 18:01:46.915854 365956 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2118 bytes)
I0422 18:01:46.934485 365956 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0422 18:01:46.938113 365956 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0422 18:01:46.948943 365956 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0422 18:01:47.037494 365956 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0422 18:01:47.053394 365956 certs.go:68] Setting up /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/old-k8s-version-986384 for IP: 192.168.76.2
I0422 18:01:47.053416 365956 certs.go:194] generating shared ca certs ...
I0422 18:01:47.053432 365956 certs.go:226] acquiring lock for ca certs: {Name:mkc0c6170c42b1b43b7f622fcbfe2e475bd8761f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0422 18:01:47.053613 365956 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18706-2371/.minikube/ca.key
I0422 18:01:47.053665 365956 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18706-2371/.minikube/proxy-client-ca.key
I0422 18:01:47.053676 365956 certs.go:256] generating profile certs ...
I0422 18:01:47.053781 365956 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/old-k8s-version-986384/client.key
I0422 18:01:47.053859 365956 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/old-k8s-version-986384/apiserver.key.17f72d1b
I0422 18:01:47.053910 365956 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/old-k8s-version-986384/proxy-client.key
I0422 18:01:47.054022 365956 certs.go:484] found cert: /home/jenkins/minikube-integration/18706-2371/.minikube/certs/7728.pem (1338 bytes)
W0422 18:01:47.054057 365956 certs.go:480] ignoring /home/jenkins/minikube-integration/18706-2371/.minikube/certs/7728_empty.pem, impossibly tiny 0 bytes
I0422 18:01:47.054068 365956 certs.go:484] found cert: /home/jenkins/minikube-integration/18706-2371/.minikube/certs/ca-key.pem (1675 bytes)
I0422 18:01:47.054100 365956 certs.go:484] found cert: /home/jenkins/minikube-integration/18706-2371/.minikube/certs/ca.pem (1078 bytes)
I0422 18:01:47.054131 365956 certs.go:484] found cert: /home/jenkins/minikube-integration/18706-2371/.minikube/certs/cert.pem (1123 bytes)
I0422 18:01:47.054159 365956 certs.go:484] found cert: /home/jenkins/minikube-integration/18706-2371/.minikube/certs/key.pem (1675 bytes)
I0422 18:01:47.054205 365956 certs.go:484] found cert: /home/jenkins/minikube-integration/18706-2371/.minikube/files/etc/ssl/certs/77282.pem (1708 bytes)
I0422 18:01:47.054831 365956 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0422 18:01:47.090065 365956 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0422 18:01:47.118206 365956 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0422 18:01:47.147005 365956 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0422 18:01:47.188069 365956 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/old-k8s-version-986384/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0422 18:01:47.220115 365956 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/old-k8s-version-986384/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0422 18:01:47.264571 365956 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/old-k8s-version-986384/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0422 18:01:47.306550 365956 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/old-k8s-version-986384/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0422 18:01:47.333769 365956 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0422 18:01:47.360909 365956 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/certs/7728.pem --> /usr/share/ca-certificates/7728.pem (1338 bytes)
I0422 18:01:47.387775 365956 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/files/etc/ssl/certs/77282.pem --> /usr/share/ca-certificates/77282.pem (1708 bytes)
I0422 18:01:47.414320 365956 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0422 18:01:47.432984 365956 ssh_runner.go:195] Run: openssl version
I0422 18:01:47.438697 365956 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7728.pem && ln -fs /usr/share/ca-certificates/7728.pem /etc/ssl/certs/7728.pem"
I0422 18:01:47.448687 365956 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7728.pem
I0422 18:01:47.452231 365956 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 22 17:02 /usr/share/ca-certificates/7728.pem
I0422 18:01:47.452336 365956 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7728.pem
I0422 18:01:47.459952 365956 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/7728.pem /etc/ssl/certs/51391683.0"
I0422 18:01:47.469323 365956 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/77282.pem && ln -fs /usr/share/ca-certificates/77282.pem /etc/ssl/certs/77282.pem"
I0422 18:01:47.478929 365956 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/77282.pem
I0422 18:01:47.482838 365956 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 22 17:02 /usr/share/ca-certificates/77282.pem
I0422 18:01:47.482905 365956 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/77282.pem
I0422 18:01:47.490030 365956 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/77282.pem /etc/ssl/certs/3ec20f2e.0"
I0422 18:01:47.500047 365956 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0422 18:01:47.510256 365956 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0422 18:01:47.513837 365956 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 22 16:57 /usr/share/ca-certificates/minikubeCA.pem
I0422 18:01:47.513906 365956 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0422 18:01:47.520856 365956 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0422 18:01:47.530108 365956 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0422 18:01:47.533629 365956 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0422 18:01:47.540500 365956 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0422 18:01:47.547454 365956 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0422 18:01:47.554685 365956 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0422 18:01:47.562317 365956 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0422 18:01:47.569735 365956 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0422 18:01:47.576888 365956 kubeadm.go:391] StartCluster: {Name:old-k8s-version-986384 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-986384 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/
minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0422 18:01:47.577065 365956 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0422 18:01:47.592742 365956 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0422 18:01:47.602860 365956 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0422 18:01:47.602934 365956 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0422 18:01:47.602952 365956 kubeadm.go:587] restartPrimaryControlPlane start ...
I0422 18:01:47.603035 365956 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0422 18:01:47.615442 365956 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0422 18:01:47.616437 365956 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-986384" does not appear in /home/jenkins/minikube-integration/18706-2371/kubeconfig
I0422 18:01:47.617066 365956 kubeconfig.go:62] /home/jenkins/minikube-integration/18706-2371/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-986384" cluster setting kubeconfig missing "old-k8s-version-986384" context setting]
I0422 18:01:47.617899 365956 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18706-2371/kubeconfig: {Name:mkd3bbb31387c9740f072dd59bcca857246cca69 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0422 18:01:47.620203 365956 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0422 18:01:47.632235 365956 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.76.2
I0422 18:01:47.632267 365956 kubeadm.go:591] duration metric: took 29.293324ms to restartPrimaryControlPlane
I0422 18:01:47.632277 365956 kubeadm.go:393] duration metric: took 55.398791ms to StartCluster
I0422 18:01:47.632294 365956 settings.go:142] acquiring lock: {Name:mk4d4aae5dac6b45b6276ad1e8e6929d4ff7540f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0422 18:01:47.632356 365956 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/18706-2371/kubeconfig
I0422 18:01:47.634051 365956 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18706-2371/kubeconfig: {Name:mkd3bbb31387c9740f072dd59bcca857246cca69 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0422 18:01:47.634274 365956 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0422 18:01:47.639060 365956 out.go:177] * Verifying Kubernetes components...
I0422 18:01:47.634878 365956 config.go:182] Loaded profile config "old-k8s-version-986384": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0
I0422 18:01:47.634887 365956 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0422 18:01:47.641306 365956 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-986384"
I0422 18:01:47.641345 365956 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-986384"
W0422 18:01:47.641356 365956 addons.go:243] addon storage-provisioner should already be in state true
I0422 18:01:47.641387 365956 host.go:66] Checking if "old-k8s-version-986384" exists ...
I0422 18:01:47.641449 365956 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0422 18:01:47.641579 365956 addons.go:69] Setting dashboard=true in profile "old-k8s-version-986384"
I0422 18:01:47.641654 365956 addons.go:234] Setting addon dashboard=true in "old-k8s-version-986384"
W0422 18:01:47.641678 365956 addons.go:243] addon dashboard should already be in state true
I0422 18:01:47.641751 365956 host.go:66] Checking if "old-k8s-version-986384" exists ...
I0422 18:01:47.641956 365956 cli_runner.go:164] Run: docker container inspect old-k8s-version-986384 --format={{.State.Status}}
I0422 18:01:47.642243 365956 cli_runner.go:164] Run: docker container inspect old-k8s-version-986384 --format={{.State.Status}}
I0422 18:01:47.642435 365956 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-986384"
I0422 18:01:47.642471 365956 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-986384"
I0422 18:01:47.642720 365956 cli_runner.go:164] Run: docker container inspect old-k8s-version-986384 --format={{.State.Status}}
I0422 18:01:47.642996 365956 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-986384"
I0422 18:01:47.643024 365956 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-986384"
W0422 18:01:47.643031 365956 addons.go:243] addon metrics-server should already be in state true
I0422 18:01:47.643058 365956 host.go:66] Checking if "old-k8s-version-986384" exists ...
I0422 18:01:47.643449 365956 cli_runner.go:164] Run: docker container inspect old-k8s-version-986384 --format={{.State.Status}}
I0422 18:01:47.697815 365956 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0422 18:01:47.699622 365956 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-986384"
I0422 18:01:47.703045 365956 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0422 18:01:47.701113 365956 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
W0422 18:01:47.701146 365956 addons.go:243] addon default-storageclass should already be in state true
I0422 18:01:47.705126 365956 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0422 18:01:47.709732 365956 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0422 18:01:47.709749 365956 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0422 18:01:47.709810 365956 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-986384
I0422 18:01:47.707718 365956 host.go:66] Checking if "old-k8s-version-986384" exists ...
I0422 18:01:47.710484 365956 cli_runner.go:164] Run: docker container inspect old-k8s-version-986384 --format={{.State.Status}}
I0422 18:01:47.707730 365956 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0422 18:01:47.707739 365956 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0422 18:01:47.720094 365956 addons.go:426] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0422 18:01:47.720117 365956 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0422 18:01:47.720167 365956 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-986384
I0422 18:01:47.720097 365956 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-986384
I0422 18:01:47.744259 365956 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33134 SSHKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/machines/old-k8s-version-986384/id_rsa Username:docker}
I0422 18:01:47.762322 365956 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0422 18:01:47.762343 365956 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0422 18:01:47.762408 365956 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-986384
I0422 18:01:47.776864 365956 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33134 SSHKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/machines/old-k8s-version-986384/id_rsa Username:docker}
I0422 18:01:47.792159 365956 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33134 SSHKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/machines/old-k8s-version-986384/id_rsa Username:docker}
I0422 18:01:47.804448 365956 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33134 SSHKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/machines/old-k8s-version-986384/id_rsa Username:docker}
I0422 18:01:47.836560 365956 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0422 18:01:47.881488 365956 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-986384" to be "Ready" ...
I0422 18:01:47.926923 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0422 18:01:47.937327 365956 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0422 18:01:47.937391 365956 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0422 18:01:47.968289 365956 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0422 18:01:47.968353 365956 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0422 18:01:47.983152 365956 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0422 18:01:47.983218 365956 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0422 18:01:47.990499 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0422 18:01:48.014848 365956 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0422 18:01:48.014916 365956 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0422 18:01:48.064045 365956 addons.go:426] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0422 18:01:48.064129 365956 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0422 18:01:48.076407 365956 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0422 18:01:48.076480 365956 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
W0422 18:01:48.111513 365956 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:48.111634 365956 retry.go:31] will retry after 221.919065ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:48.136287 365956 addons.go:426] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0422 18:01:48.136352 365956 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
W0422 18:01:48.143992 365956 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:48.144071 365956 retry.go:31] will retry after 244.5935ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:48.144404 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0422 18:01:48.167825 365956 addons.go:426] installing /etc/kubernetes/addons/dashboard-role.yaml
I0422 18:01:48.167908 365956 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0422 18:01:48.191163 365956 addons.go:426] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0422 18:01:48.191242 365956 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0422 18:01:48.214939 365956 addons.go:426] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0422 18:01:48.215016 365956 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0422 18:01:48.236565 365956 addons.go:426] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0422 18:01:48.236641 365956 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
W0422 18:01:48.247625 365956 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:48.247709 365956 retry.go:31] will retry after 134.990489ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:48.259655 365956 addons.go:426] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0422 18:01:48.259682 365956 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0422 18:01:48.278553 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0422 18:01:48.334073 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0422 18:01:48.360420 365956 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:48.360459 365956 retry.go:31] will retry after 168.012049ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:48.382839 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0422 18:01:48.389494 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0422 18:01:48.446006 365956 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:48.446042 365956 retry.go:31] will retry after 508.114621ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0422 18:01:48.512221 365956 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:48.512295 365956 retry.go:31] will retry after 310.441914ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0422 18:01:48.512369 365956 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:48.512401 365956 retry.go:31] will retry after 559.992289ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:48.528633 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0422 18:01:48.606376 365956 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:48.606409 365956 retry.go:31] will retry after 313.514426ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:48.823761 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0422 18:01:48.908867 365956 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:48.908908 365956 retry.go:31] will retry after 659.346255ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:48.921028 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0422 18:01:48.954448 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0422 18:01:49.000421 365956 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:49.000452 365956 retry.go:31] will retry after 611.362627ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0422 18:01:49.044630 365956 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:49.044672 365956 retry.go:31] will retry after 705.992523ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:49.072989 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0422 18:01:49.156048 365956 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:49.156081 365956 retry.go:31] will retry after 694.563877ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:49.569308 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0422 18:01:49.612879 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0422 18:01:49.658278 365956 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:49.658352 365956 retry.go:31] will retry after 1.24959819s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0422 18:01:49.711444 365956 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:49.711477 365956 retry.go:31] will retry after 514.601206ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:49.751596 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0422 18:01:49.836823 365956 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:49.836857 365956 retry.go:31] will retry after 986.952798ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:49.851185 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0422 18:01:49.882841 365956 node_ready.go:53] error getting node "old-k8s-version-986384": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-986384": dial tcp 192.168.76.2:8443: connect: connection refused
W0422 18:01:49.941396 365956 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:49.941441 365956 retry.go:31] will retry after 1.105077598s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:50.226897 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0422 18:01:50.304704 365956 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:50.304736 365956 retry.go:31] will retry after 1.687127306s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:50.824820 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0422 18:01:50.903571 365956 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:50.903651 365956 retry.go:31] will retry after 1.031459557s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:50.908796 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0422 18:01:51.047198 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0422 18:01:51.078384 365956 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:51.078429 365956 retry.go:31] will retry after 975.553108ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0422 18:01:51.210845 365956 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:51.210919 365956 retry.go:31] will retry after 993.966385ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0422 18:01:51.936282 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0422 18:01:51.992744 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0422 18:01:52.055031 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0422 18:01:52.205659 365956 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0422 18:01:59.939212 365956 node_ready.go:49] node "old-k8s-version-986384" has status "Ready":"True"
I0422 18:01:59.939237 365956 node_ready.go:38] duration metric: took 12.057642675s for node "old-k8s-version-986384" to be "Ready" ...
I0422 18:01:59.939248 365956 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0422 18:02:00.170166 365956 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-6dgwt" in "kube-system" namespace to be "Ready" ...
I0422 18:02:00.375642 365956 pod_ready.go:92] pod "coredns-74ff55c5b-6dgwt" in "kube-system" namespace has status "Ready":"True"
I0422 18:02:00.375677 365956 pod_ready.go:81] duration metric: took 205.463958ms for pod "coredns-74ff55c5b-6dgwt" in "kube-system" namespace to be "Ready" ...
I0422 18:02:00.375702 365956 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-986384" in "kube-system" namespace to be "Ready" ...
I0422 18:02:01.374865 365956 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (9.43849539s)
I0422 18:02:01.542490 365956 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (9.549695822s)
I0422 18:02:01.544275 365956 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-986384 addons enable metrics-server
I0422 18:02:01.542717 365956 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (9.487649979s)
I0422 18:02:01.542735 365956 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (9.337046036s)
I0422 18:02:01.546103 365956 addons.go:470] Verifying addon metrics-server=true in "old-k8s-version-986384"
I0422 18:02:01.557719 365956 out.go:177] * Enabled addons: storage-provisioner, dashboard, metrics-server, default-storageclass
I0422 18:02:01.559492 365956 addons.go:505] duration metric: took 13.924593581s for enable addons: enabled=[storage-provisioner dashboard metrics-server default-storageclass]
I0422 18:02:02.384099 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:04.884272 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:07.383756 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:09.883051 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:11.883123 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:13.883498 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:16.383374 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:18.383961 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:20.384120 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:22.389481 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:24.392033 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:26.883806 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:28.883892 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:31.383282 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:33.383630 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:35.884119 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:38.383770 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:40.882941 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:42.884099 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:44.884363 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:47.383411 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:49.383713 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:51.883996 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:54.383160 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:56.383305 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:02:58.383498 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:00.406400 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:02.883841 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:04.884185 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:07.384076 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:09.883869 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:12.391144 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:14.883244 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:17.383697 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:19.884198 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:22.383202 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:24.883968 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:27.383941 365956 pod_ready.go:102] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:28.883955 365956 pod_ready.go:92] pod "etcd-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"True"
I0422 18:03:28.883979 365956 pod_ready.go:81] duration metric: took 1m28.508268719s for pod "etcd-old-k8s-version-986384" in "kube-system" namespace to be "Ready" ...
I0422 18:03:28.883991 365956 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-986384" in "kube-system" namespace to be "Ready" ...
I0422 18:03:28.889922 365956 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"True"
I0422 18:03:28.889946 365956 pod_ready.go:81] duration metric: took 5.947145ms for pod "kube-apiserver-old-k8s-version-986384" in "kube-system" namespace to be "Ready" ...
I0422 18:03:28.889958 365956 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-986384" in "kube-system" namespace to be "Ready" ...
I0422 18:03:28.895542 365956 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"True"
I0422 18:03:28.895567 365956 pod_ready.go:81] duration metric: took 5.600333ms for pod "kube-controller-manager-old-k8s-version-986384" in "kube-system" namespace to be "Ready" ...
I0422 18:03:28.895580 365956 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-cpcrp" in "kube-system" namespace to be "Ready" ...
I0422 18:03:28.900984 365956 pod_ready.go:92] pod "kube-proxy-cpcrp" in "kube-system" namespace has status "Ready":"True"
I0422 18:03:28.901012 365956 pod_ready.go:81] duration metric: took 5.423493ms for pod "kube-proxy-cpcrp" in "kube-system" namespace to be "Ready" ...
I0422 18:03:28.901024 365956 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-986384" in "kube-system" namespace to be "Ready" ...
I0422 18:03:28.906184 365956 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-986384" in "kube-system" namespace has status "Ready":"True"
I0422 18:03:28.906210 365956 pod_ready.go:81] duration metric: took 5.178035ms for pod "kube-scheduler-old-k8s-version-986384" in "kube-system" namespace to be "Ready" ...
I0422 18:03:28.906222 365956 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace to be "Ready" ...
I0422 18:03:30.912175 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:32.913272 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:35.413089 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:37.912834 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:40.413555 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:42.912960 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:45.413087 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:47.413864 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:49.912863 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:52.411940 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:54.412402 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:56.413208 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:03:58.913247 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:01.412533 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:03.421959 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:05.913712 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:08.412663 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:10.413368 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:12.413552 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:14.923544 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:17.412391 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:19.412606 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:21.912999 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:23.913159 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:26.411530 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:28.412742 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:30.412936 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:32.413076 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:34.912526 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:36.913095 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:39.412987 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:41.912708 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:43.912929 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:45.913610 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:48.412710 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:50.912383 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:52.914226 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:55.412312 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:57.412510 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:04:59.912746 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:01.913319 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:04.412969 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:06.912962 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:08.915891 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:11.471638 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:13.913248 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:16.413354 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:18.912373 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:21.412601 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:23.412943 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:25.913156 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:28.412895 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:30.413508 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:32.912105 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:34.913242 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:36.929207 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:39.412971 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:41.925644 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:44.414207 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:46.913461 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:49.415596 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:51.915479 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:54.413473 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:56.413528 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:05:58.421088 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:00.915869 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:03.413896 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:05.915793 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:08.412199 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:10.413320 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:12.912884 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:14.913565 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:16.914170 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:19.412938 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:21.912137 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:23.912833 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:25.912957 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:27.913044 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:30.412898 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:32.414169 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:34.911990 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:36.912348 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:39.413336 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:41.912307 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:44.413279 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:46.912140 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:49.412665 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:51.914046 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:54.412693 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:56.912275 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:58.914019 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:01.412728 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:03.911888 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:05.913589 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:07.923781 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:10.411742 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:12.415123 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:14.415686 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:16.923201 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:19.413145 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:21.913081 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:24.412193 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:26.413214 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:28.922687 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:28.922717 365956 pod_ready.go:81] duration metric: took 4m0.0164876s for pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace to be "Ready" ...
E0422 18:07:28.922728 365956 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0422 18:07:28.922736 365956 pod_ready.go:38] duration metric: took 5m28.983477844s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0422 18:07:28.922790 365956 api_server.go:52] waiting for apiserver process to appear ...
I0422 18:07:28.922897 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0422 18:07:28.955854 365956 logs.go:276] 2 containers: [cfd818ddce4e 36734b404817]
I0422 18:07:28.955975 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0422 18:07:28.979086 365956 logs.go:276] 2 containers: [5899397ea4a9 f029b0e7c02d]
I0422 18:07:28.979186 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0422 18:07:28.997173 365956 logs.go:276] 2 containers: [27648c4ab762 f9d8bddf7197]
I0422 18:07:28.997325 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0422 18:07:29.033417 365956 logs.go:276] 2 containers: [8d4da1dcae53 4ef6e29c4a78]
I0422 18:07:29.033558 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0422 18:07:29.076926 365956 logs.go:276] 2 containers: [99181fe4786b 2670916c7c26]
I0422 18:07:29.077015 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0422 18:07:29.096098 365956 logs.go:276] 2 containers: [980fcb0f5f0b d0fea9e4ec1f]
I0422 18:07:29.096268 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0422 18:07:29.115469 365956 logs.go:276] 0 containers: []
W0422 18:07:29.115495 365956 logs.go:278] No container was found matching "kindnet"
I0422 18:07:29.115565 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0422 18:07:29.135054 365956 logs.go:276] 1 containers: [38455e350073]
I0422 18:07:29.135166 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0422 18:07:29.157549 365956 logs.go:276] 2 containers: [2e587f1e7363 9dca99e0f1e4]
I0422 18:07:29.157650 365956 logs.go:123] Gathering logs for container status ...
I0422 18:07:29.157705 365956 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0422 18:07:29.256493 365956 logs.go:123] Gathering logs for dmesg ...
I0422 18:07:29.256681 365956 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0422 18:07:29.279579 365956 logs.go:123] Gathering logs for kube-apiserver [36734b404817] ...
I0422 18:07:29.279617 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36734b404817"
I0422 18:07:29.441285 365956 logs.go:123] Gathering logs for kube-scheduler [4ef6e29c4a78] ...
I0422 18:07:29.441326 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4ef6e29c4a78"
I0422 18:07:29.486255 365956 logs.go:123] Gathering logs for kube-proxy [2670916c7c26] ...
I0422 18:07:29.486291 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2670916c7c26"
I0422 18:07:29.517182 365956 logs.go:123] Gathering logs for kube-controller-manager [980fcb0f5f0b] ...
I0422 18:07:29.517212 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 980fcb0f5f0b"
I0422 18:07:29.587467 365956 logs.go:123] Gathering logs for Docker ...
I0422 18:07:29.587506 365956 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0422 18:07:29.633184 365956 logs.go:123] Gathering logs for kube-apiserver [cfd818ddce4e] ...
I0422 18:07:29.633223 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 cfd818ddce4e"
I0422 18:07:29.708734 365956 logs.go:123] Gathering logs for etcd [f029b0e7c02d] ...
I0422 18:07:29.708877 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f029b0e7c02d"
I0422 18:07:29.751034 365956 logs.go:123] Gathering logs for coredns [27648c4ab762] ...
I0422 18:07:29.751077 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 27648c4ab762"
I0422 18:07:29.796111 365956 logs.go:123] Gathering logs for kube-proxy [99181fe4786b] ...
I0422 18:07:29.796299 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 99181fe4786b"
I0422 18:07:29.830508 365956 logs.go:123] Gathering logs for kubelet ...
I0422 18:07:29.830540 365956 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0422 18:07:29.888134 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832037 1196 reflector.go:138] object-"kube-system"/"storage-provisioner-token-g68k5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-g68k5" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:29.888394 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832152 1196 reflector.go:138] object-"kube-system"/"kube-proxy-token-f585x": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-f585x" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:29.888628 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832232 1196 reflector.go:138] object-"default"/"default-token-b4l4p": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-b4l4p" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:29.888876 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832306 1196 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:29.889095 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832383 1196 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:29.889307 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832559 1196 reflector.go:138] object-"kube-system"/"coredns-token-2dv2q": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-2dv2q" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:29.898081 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:03 old-k8s-version-986384 kubelet[1196]: E0422 18:02:03.226868 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0422 18:07:29.898812 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:03 old-k8s-version-986384 kubelet[1196]: E0422 18:02:03.888305 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.901567 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:15 old-k8s-version-986384 kubelet[1196]: E0422 18:02:15.641552 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0422 18:07:29.911177 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:24 old-k8s-version-986384 kubelet[1196]: E0422 18:02:24.265785 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0422 18:07:29.911576 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:24 old-k8s-version-986384 kubelet[1196]: E0422 18:02:24.368306 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.911763 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:30 old-k8s-version-986384 kubelet[1196]: E0422 18:02:30.628159 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.912531 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:32 old-k8s-version-986384 kubelet[1196]: E0422 18:02:32.453214 1196 pod_workers.go:191] Error syncing pod df339435-cb7d-470a-8aec-c5eb3f389a93 ("storage-provisioner_kube-system(df339435-cb7d-470a-8aec-c5eb3f389a93)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(df339435-cb7d-470a-8aec-c5eb3f389a93)"
W0422 18:07:29.915088 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:39 old-k8s-version-986384 kubelet[1196]: E0422 18:02:39.049200 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0422 18:07:29.918558 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:43 old-k8s-version-986384 kubelet[1196]: E0422 18:02:43.646522 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0422 18:07:29.919251 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:52 old-k8s-version-986384 kubelet[1196]: E0422 18:02:52.618806 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.919438 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:58 old-k8s-version-986384 kubelet[1196]: E0422 18:02:58.622275 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.922358 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:05 old-k8s-version-986384 kubelet[1196]: E0422 18:03:05.091231 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0422 18:07:29.922613 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:10 old-k8s-version-986384 kubelet[1196]: E0422 18:03:10.630961 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.922958 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:16 old-k8s-version-986384 kubelet[1196]: E0422 18:03:16.618514 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.923201 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:23 old-k8s-version-986384 kubelet[1196]: E0422 18:03:23.618416 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.923405 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:30 old-k8s-version-986384 kubelet[1196]: E0422 18:03:30.632521 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.925888 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:34 old-k8s-version-986384 kubelet[1196]: E0422 18:03:34.649485 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0422 18:07:29.926096 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:43 old-k8s-version-986384 kubelet[1196]: E0422 18:03:43.618651 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.926287 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:46 old-k8s-version-986384 kubelet[1196]: E0422 18:03:46.619360 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.928592 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:59 old-k8s-version-986384 kubelet[1196]: E0422 18:03:59.083435 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0422 18:07:29.936494 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:59 old-k8s-version-986384 kubelet[1196]: E0422 18:03:59.618394 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.936812 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:12 old-k8s-version-986384 kubelet[1196]: E0422 18:04:12.618866 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.937069 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:13 old-k8s-version-986384 kubelet[1196]: E0422 18:04:13.618430 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.937262 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:23 old-k8s-version-986384 kubelet[1196]: E0422 18:04:23.618440 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.937642 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:24 old-k8s-version-986384 kubelet[1196]: E0422 18:04:24.643322 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.937831 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:38 old-k8s-version-986384 kubelet[1196]: E0422 18:04:38.629329 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.938079 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:38 old-k8s-version-986384 kubelet[1196]: E0422 18:04:38.634742 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.938402 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:49 old-k8s-version-986384 kubelet[1196]: E0422 18:04:49.618463 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.938592 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:53 old-k8s-version-986384 kubelet[1196]: E0422 18:04:53.618422 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.938788 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:00 old-k8s-version-986384 kubelet[1196]: E0422 18:05:00.619147 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.940980 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:05 old-k8s-version-986384 kubelet[1196]: E0422 18:05:05.638308 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0422 18:07:29.941308 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:11 old-k8s-version-986384 kubelet[1196]: E0422 18:05:11.618472 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.941516 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:16 old-k8s-version-986384 kubelet[1196]: E0422 18:05:16.627331 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.944352 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:23 old-k8s-version-986384 kubelet[1196]: E0422 18:05:23.061150 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0422 18:07:29.944593 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:28 old-k8s-version-986384 kubelet[1196]: E0422 18:05:28.618921 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.945064 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:34 old-k8s-version-986384 kubelet[1196]: E0422 18:05:34.621754 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.945265 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:39 old-k8s-version-986384 kubelet[1196]: E0422 18:05:39.618114 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.945464 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:45 old-k8s-version-986384 kubelet[1196]: E0422 18:05:45.663272 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.945650 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:51 old-k8s-version-986384 kubelet[1196]: E0422 18:05:51.618807 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.945847 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:58 old-k8s-version-986384 kubelet[1196]: E0422 18:05:58.648913 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.946032 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:04 old-k8s-version-986384 kubelet[1196]: E0422 18:06:04.618373 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.946230 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:11 old-k8s-version-986384 kubelet[1196]: E0422 18:06:11.618095 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.946414 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:15 old-k8s-version-986384 kubelet[1196]: E0422 18:06:15.618294 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.946610 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:25 old-k8s-version-986384 kubelet[1196]: E0422 18:06:25.619230 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.946797 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:30 old-k8s-version-986384 kubelet[1196]: E0422 18:06:30.618689 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.946994 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:39 old-k8s-version-986384 kubelet[1196]: E0422 18:06:39.618588 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.947177 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:43 old-k8s-version-986384 kubelet[1196]: E0422 18:06:43.618416 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.947371 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:54 old-k8s-version-986384 kubelet[1196]: E0422 18:06:54.627082 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.947554 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:55 old-k8s-version-986384 kubelet[1196]: E0422 18:06:55.618270 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.947736 365956 logs.go:138] Found kubelet problem: Apr 22 18:07:06 old-k8s-version-986384 kubelet[1196]: E0422 18:07:06.619950 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.947930 365956 logs.go:138] Found kubelet problem: Apr 22 18:07:07 old-k8s-version-986384 kubelet[1196]: E0422 18:07:07.618622 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.948113 365956 logs.go:138] Found kubelet problem: Apr 22 18:07:18 old-k8s-version-986384 kubelet[1196]: E0422 18:07:18.622590 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.948309 365956 logs.go:138] Found kubelet problem: Apr 22 18:07:18 old-k8s-version-986384 kubelet[1196]: E0422 18:07:18.645475 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.948496 365956 logs.go:138] Found kubelet problem: Apr 22 18:07:29 old-k8s-version-986384 kubelet[1196]: E0422 18:07:29.619046 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0422 18:07:29.948506 365956 logs.go:123] Gathering logs for kubernetes-dashboard [38455e350073] ...
I0422 18:07:29.948519 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38455e350073"
I0422 18:07:29.972630 365956 logs.go:123] Gathering logs for storage-provisioner [2e587f1e7363] ...
I0422 18:07:29.972659 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2e587f1e7363"
I0422 18:07:29.993589 365956 logs.go:123] Gathering logs for storage-provisioner [9dca99e0f1e4] ...
I0422 18:07:29.993618 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9dca99e0f1e4"
I0422 18:07:30.030083 365956 logs.go:123] Gathering logs for describe nodes ...
I0422 18:07:30.030117 365956 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0422 18:07:30.441479 365956 logs.go:123] Gathering logs for etcd [5899397ea4a9] ...
I0422 18:07:30.441542 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5899397ea4a9"
I0422 18:07:30.498099 365956 logs.go:123] Gathering logs for coredns [f9d8bddf7197] ...
I0422 18:07:30.498181 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f9d8bddf7197"
I0422 18:07:30.531927 365956 logs.go:123] Gathering logs for kube-scheduler [8d4da1dcae53] ...
I0422 18:07:30.531997 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8d4da1dcae53"
I0422 18:07:30.579200 365956 logs.go:123] Gathering logs for kube-controller-manager [d0fea9e4ec1f] ...
I0422 18:07:30.579279 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d0fea9e4ec1f"
I0422 18:07:30.701639 365956 out.go:304] Setting ErrFile to fd 2...
I0422 18:07:30.701707 365956 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0422 18:07:30.701771 365956 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0422 18:07:30.701816 365956 out.go:239] Apr 22 18:07:06 old-k8s-version-986384 kubelet[1196]: E0422 18:07:06.619950 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 22 18:07:06 old-k8s-version-986384 kubelet[1196]: E0422 18:07:06.619950 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:30.701850 365956 out.go:239] Apr 22 18:07:07 old-k8s-version-986384 kubelet[1196]: E0422 18:07:07.618622 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Apr 22 18:07:07 old-k8s-version-986384 kubelet[1196]: E0422 18:07:07.618622 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:30.701896 365956 out.go:239] Apr 22 18:07:18 old-k8s-version-986384 kubelet[1196]: E0422 18:07:18.622590 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 22 18:07:18 old-k8s-version-986384 kubelet[1196]: E0422 18:07:18.622590 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:30.701940 365956 out.go:239] Apr 22 18:07:18 old-k8s-version-986384 kubelet[1196]: E0422 18:07:18.645475 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Apr 22 18:07:18 old-k8s-version-986384 kubelet[1196]: E0422 18:07:18.645475 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:30.701975 365956 out.go:239] Apr 22 18:07:29 old-k8s-version-986384 kubelet[1196]: E0422 18:07:29.619046 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 22 18:07:29 old-k8s-version-986384 kubelet[1196]: E0422 18:07:29.619046 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0422 18:07:30.702015 365956 out.go:304] Setting ErrFile to fd 2...
I0422 18:07:30.702037 365956 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0422 18:07:40.703400 365956 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0422 18:07:40.716516 365956 api_server.go:72] duration metric: took 5m53.082208744s to wait for apiserver process to appear ...
I0422 18:07:40.716544 365956 api_server.go:88] waiting for apiserver healthz status ...
I0422 18:07:40.716659 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0422 18:07:40.742123 365956 logs.go:276] 2 containers: [cfd818ddce4e 36734b404817]
I0422 18:07:40.742218 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0422 18:07:40.763131 365956 logs.go:276] 2 containers: [5899397ea4a9 f029b0e7c02d]
I0422 18:07:40.763221 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0422 18:07:40.779304 365956 logs.go:276] 2 containers: [27648c4ab762 f9d8bddf7197]
I0422 18:07:40.779383 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0422 18:07:40.799440 365956 logs.go:276] 2 containers: [8d4da1dcae53 4ef6e29c4a78]
I0422 18:07:40.799522 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0422 18:07:40.815299 365956 logs.go:276] 2 containers: [99181fe4786b 2670916c7c26]
I0422 18:07:40.815385 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0422 18:07:40.831521 365956 logs.go:276] 2 containers: [980fcb0f5f0b d0fea9e4ec1f]
I0422 18:07:40.831603 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0422 18:07:40.850909 365956 logs.go:276] 0 containers: []
W0422 18:07:40.850987 365956 logs.go:278] No container was found matching "kindnet"
I0422 18:07:40.851073 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0422 18:07:40.867546 365956 logs.go:276] 2 containers: [2e587f1e7363 9dca99e0f1e4]
I0422 18:07:40.867663 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0422 18:07:40.888163 365956 logs.go:276] 1 containers: [38455e350073]
I0422 18:07:40.888241 365956 logs.go:123] Gathering logs for kubelet ...
I0422 18:07:40.888267 365956 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0422 18:07:40.949225 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832037 1196 reflector.go:138] object-"kube-system"/"storage-provisioner-token-g68k5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-g68k5" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:40.949459 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832152 1196 reflector.go:138] object-"kube-system"/"kube-proxy-token-f585x": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-f585x" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:40.949670 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832232 1196 reflector.go:138] object-"default"/"default-token-b4l4p": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-b4l4p" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:40.949875 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832306 1196 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:40.950077 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832383 1196 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:40.950286 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832559 1196 reflector.go:138] object-"kube-system"/"coredns-token-2dv2q": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-2dv2q" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:40.958658 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:03 old-k8s-version-986384 kubelet[1196]: E0422 18:02:03.226868 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0422 18:07:40.959350 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:03 old-k8s-version-986384 kubelet[1196]: E0422 18:02:03.888305 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.961733 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:15 old-k8s-version-986384 kubelet[1196]: E0422 18:02:15.641552 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0422 18:07:40.966390 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:24 old-k8s-version-986384 kubelet[1196]: E0422 18:02:24.265785 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0422 18:07:40.966763 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:24 old-k8s-version-986384 kubelet[1196]: E0422 18:02:24.368306 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.966950 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:30 old-k8s-version-986384 kubelet[1196]: E0422 18:02:30.628159 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.967715 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:32 old-k8s-version-986384 kubelet[1196]: E0422 18:02:32.453214 1196 pod_workers.go:191] Error syncing pod df339435-cb7d-470a-8aec-c5eb3f389a93 ("storage-provisioner_kube-system(df339435-cb7d-470a-8aec-c5eb3f389a93)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(df339435-cb7d-470a-8aec-c5eb3f389a93)"
W0422 18:07:40.970011 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:39 old-k8s-version-986384 kubelet[1196]: E0422 18:02:39.049200 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0422 18:07:40.972390 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:43 old-k8s-version-986384 kubelet[1196]: E0422 18:02:43.646522 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0422 18:07:40.972984 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:52 old-k8s-version-986384 kubelet[1196]: E0422 18:02:52.618806 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.973171 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:58 old-k8s-version-986384 kubelet[1196]: E0422 18:02:58.622275 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.975367 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:05 old-k8s-version-986384 kubelet[1196]: E0422 18:03:05.091231 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0422 18:07:40.975564 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:10 old-k8s-version-986384 kubelet[1196]: E0422 18:03:10.630961 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.975759 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:16 old-k8s-version-986384 kubelet[1196]: E0422 18:03:16.618514 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.975944 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:23 old-k8s-version-986384 kubelet[1196]: E0422 18:03:23.618416 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.976140 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:30 old-k8s-version-986384 kubelet[1196]: E0422 18:03:30.632521 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.978202 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:34 old-k8s-version-986384 kubelet[1196]: E0422 18:03:34.649485 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0422 18:07:40.978403 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:43 old-k8s-version-986384 kubelet[1196]: E0422 18:03:43.618651 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.978587 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:46 old-k8s-version-986384 kubelet[1196]: E0422 18:03:46.619360 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.980790 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:59 old-k8s-version-986384 kubelet[1196]: E0422 18:03:59.083435 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0422 18:07:40.980977 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:59 old-k8s-version-986384 kubelet[1196]: E0422 18:03:59.618394 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.981160 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:12 old-k8s-version-986384 kubelet[1196]: E0422 18:04:12.618866 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.981355 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:13 old-k8s-version-986384 kubelet[1196]: E0422 18:04:13.618430 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.981537 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:23 old-k8s-version-986384 kubelet[1196]: E0422 18:04:23.618440 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.981732 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:24 old-k8s-version-986384 kubelet[1196]: E0422 18:04:24.643322 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.981914 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:38 old-k8s-version-986384 kubelet[1196]: E0422 18:04:38.629329 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.982108 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:38 old-k8s-version-986384 kubelet[1196]: E0422 18:04:38.634742 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.982305 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:49 old-k8s-version-986384 kubelet[1196]: E0422 18:04:49.618463 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.982487 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:53 old-k8s-version-986384 kubelet[1196]: E0422 18:04:53.618422 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.982683 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:00 old-k8s-version-986384 kubelet[1196]: E0422 18:05:00.619147 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.984722 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:05 old-k8s-version-986384 kubelet[1196]: E0422 18:05:05.638308 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0422 18:07:40.984923 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:11 old-k8s-version-986384 kubelet[1196]: E0422 18:05:11.618472 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.985106 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:16 old-k8s-version-986384 kubelet[1196]: E0422 18:05:16.627331 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.987305 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:23 old-k8s-version-986384 kubelet[1196]: E0422 18:05:23.061150 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0422 18:07:40.987489 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:28 old-k8s-version-986384 kubelet[1196]: E0422 18:05:28.618921 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.987685 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:34 old-k8s-version-986384 kubelet[1196]: E0422 18:05:34.621754 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.987869 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:39 old-k8s-version-986384 kubelet[1196]: E0422 18:05:39.618114 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.988066 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:45 old-k8s-version-986384 kubelet[1196]: E0422 18:05:45.663272 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.988248 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:51 old-k8s-version-986384 kubelet[1196]: E0422 18:05:51.618807 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.988446 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:58 old-k8s-version-986384 kubelet[1196]: E0422 18:05:58.648913 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.988650 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:04 old-k8s-version-986384 kubelet[1196]: E0422 18:06:04.618373 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.988855 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:11 old-k8s-version-986384 kubelet[1196]: E0422 18:06:11.618095 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.989041 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:15 old-k8s-version-986384 kubelet[1196]: E0422 18:06:15.618294 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.989235 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:25 old-k8s-version-986384 kubelet[1196]: E0422 18:06:25.619230 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.989420 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:30 old-k8s-version-986384 kubelet[1196]: E0422 18:06:30.618689 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.989615 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:39 old-k8s-version-986384 kubelet[1196]: E0422 18:06:39.618588 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.989797 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:43 old-k8s-version-986384 kubelet[1196]: E0422 18:06:43.618416 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.989992 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:54 old-k8s-version-986384 kubelet[1196]: E0422 18:06:54.627082 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.990175 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:55 old-k8s-version-986384 kubelet[1196]: E0422 18:06:55.618270 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.990360 365956 logs.go:138] Found kubelet problem: Apr 22 18:07:06 old-k8s-version-986384 kubelet[1196]: E0422 18:07:06.619950 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.990554 365956 logs.go:138] Found kubelet problem: Apr 22 18:07:07 old-k8s-version-986384 kubelet[1196]: E0422 18:07:07.618622 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.990740 365956 logs.go:138] Found kubelet problem: Apr 22 18:07:18 old-k8s-version-986384 kubelet[1196]: E0422 18:07:18.622590 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.990936 365956 logs.go:138] Found kubelet problem: Apr 22 18:07:18 old-k8s-version-986384 kubelet[1196]: E0422 18:07:18.645475 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.991121 365956 logs.go:138] Found kubelet problem: Apr 22 18:07:29 old-k8s-version-986384 kubelet[1196]: E0422 18:07:29.619046 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.991317 365956 logs.go:138] Found kubelet problem: Apr 22 18:07:33 old-k8s-version-986384 kubelet[1196]: E0422 18:07:33.618306 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
I0422 18:07:40.991327 365956 logs.go:123] Gathering logs for etcd [f029b0e7c02d] ...
I0422 18:07:40.991341 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f029b0e7c02d"
I0422 18:07:41.018437 365956 logs.go:123] Gathering logs for kube-scheduler [8d4da1dcae53] ...
I0422 18:07:41.018468 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8d4da1dcae53"
I0422 18:07:41.057870 365956 logs.go:123] Gathering logs for kube-scheduler [4ef6e29c4a78] ...
I0422 18:07:41.057901 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4ef6e29c4a78"
I0422 18:07:41.085317 365956 logs.go:123] Gathering logs for kube-controller-manager [980fcb0f5f0b] ...
I0422 18:07:41.085388 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 980fcb0f5f0b"
I0422 18:07:41.132811 365956 logs.go:123] Gathering logs for storage-provisioner [2e587f1e7363] ...
I0422 18:07:41.132846 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2e587f1e7363"
I0422 18:07:41.168635 365956 logs.go:123] Gathering logs for dmesg ...
I0422 18:07:41.168664 365956 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0422 18:07:41.188491 365956 logs.go:123] Gathering logs for etcd [5899397ea4a9] ...
I0422 18:07:41.188519 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5899397ea4a9"
I0422 18:07:41.211325 365956 logs.go:123] Gathering logs for coredns [27648c4ab762] ...
I0422 18:07:41.211352 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 27648c4ab762"
I0422 18:07:41.232027 365956 logs.go:123] Gathering logs for kube-controller-manager [d0fea9e4ec1f] ...
I0422 18:07:41.232062 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d0fea9e4ec1f"
I0422 18:07:41.293576 365956 logs.go:123] Gathering logs for container status ...
I0422 18:07:41.293611 365956 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0422 18:07:41.343832 365956 logs.go:123] Gathering logs for kubernetes-dashboard [38455e350073] ...
I0422 18:07:41.343859 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38455e350073"
I0422 18:07:41.368134 365956 logs.go:123] Gathering logs for Docker ...
I0422 18:07:41.368170 365956 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0422 18:07:41.402656 365956 logs.go:123] Gathering logs for describe nodes ...
I0422 18:07:41.402691 365956 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0422 18:07:41.574728 365956 logs.go:123] Gathering logs for kube-apiserver [cfd818ddce4e] ...
I0422 18:07:41.574762 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 cfd818ddce4e"
I0422 18:07:41.620507 365956 logs.go:123] Gathering logs for kube-apiserver [36734b404817] ...
I0422 18:07:41.620545 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36734b404817"
I0422 18:07:41.711172 365956 logs.go:123] Gathering logs for coredns [f9d8bddf7197] ...
I0422 18:07:41.711209 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f9d8bddf7197"
I0422 18:07:41.735067 365956 logs.go:123] Gathering logs for kube-proxy [99181fe4786b] ...
I0422 18:07:41.735100 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 99181fe4786b"
I0422 18:07:41.757564 365956 logs.go:123] Gathering logs for kube-proxy [2670916c7c26] ...
I0422 18:07:41.757590 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2670916c7c26"
I0422 18:07:41.780898 365956 logs.go:123] Gathering logs for storage-provisioner [9dca99e0f1e4] ...
I0422 18:07:41.780926 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9dca99e0f1e4"
I0422 18:07:41.803638 365956 out.go:304] Setting ErrFile to fd 2...
I0422 18:07:41.803662 365956 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0422 18:07:41.803703 365956 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0422 18:07:41.803717 365956 out.go:239] Apr 22 18:07:07 old-k8s-version-986384 kubelet[1196]: E0422 18:07:07.618622 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Apr 22 18:07:07 old-k8s-version-986384 kubelet[1196]: E0422 18:07:07.618622 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:41.803726 365956 out.go:239] Apr 22 18:07:18 old-k8s-version-986384 kubelet[1196]: E0422 18:07:18.622590 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 22 18:07:18 old-k8s-version-986384 kubelet[1196]: E0422 18:07:18.622590 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:41.803738 365956 out.go:239] Apr 22 18:07:18 old-k8s-version-986384 kubelet[1196]: E0422 18:07:18.645475 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Apr 22 18:07:18 old-k8s-version-986384 kubelet[1196]: E0422 18:07:18.645475 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:41.803745 365956 out.go:239] Apr 22 18:07:29 old-k8s-version-986384 kubelet[1196]: E0422 18:07:29.619046 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 22 18:07:29 old-k8s-version-986384 kubelet[1196]: E0422 18:07:29.619046 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:41.803752 365956 out.go:239] Apr 22 18:07:33 old-k8s-version-986384 kubelet[1196]: E0422 18:07:33.618306 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Apr 22 18:07:33 old-k8s-version-986384 kubelet[1196]: E0422 18:07:33.618306 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
I0422 18:07:41.803765 365956 out.go:304] Setting ErrFile to fd 2...
I0422 18:07:41.803770 365956 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0422 18:07:51.804813 365956 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0422 18:07:51.817041 365956 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0422 18:07:51.819583 365956 out.go:177]
W0422 18:07:51.821795 365956 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0422 18:07:51.821832 365956 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0422 18:07:51.821850 365956 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0422 18:07:51.821855 365956 out.go:239] *
*
W0422 18:07:51.822809 365956 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0422 18:07:51.826094 365956 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-986384 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=docker --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-986384
helpers_test.go:235: (dbg) docker inspect old-k8s-version-986384:
-- stdout --
[
{
"Id": "2b3baeee162dcca0c2b59e0d746e4ebbbecf6a0a183af319ac6f72cb05d869ea",
"Created": "2024-04-22T17:58:40.517486316Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 366155,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-04-22T18:01:39.640415726Z",
"FinishedAt": "2024-04-22T18:01:38.561841571Z"
},
"Image": "sha256:c9315e0f61546d7b9630cf89252fa7f614fc966830e816cca5333df5c944376f",
"ResolvConfPath": "/var/lib/docker/containers/2b3baeee162dcca0c2b59e0d746e4ebbbecf6a0a183af319ac6f72cb05d869ea/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/2b3baeee162dcca0c2b59e0d746e4ebbbecf6a0a183af319ac6f72cb05d869ea/hostname",
"HostsPath": "/var/lib/docker/containers/2b3baeee162dcca0c2b59e0d746e4ebbbecf6a0a183af319ac6f72cb05d869ea/hosts",
"LogPath": "/var/lib/docker/containers/2b3baeee162dcca0c2b59e0d746e4ebbbecf6a0a183af319ac6f72cb05d869ea/2b3baeee162dcca0c2b59e0d746e4ebbbecf6a0a183af319ac6f72cb05d869ea-json.log",
"Name": "/old-k8s-version-986384",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-986384:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-986384",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/49ac286702e3a8183222e6ce1458a85ed902e496cfb485ae8806eb0558fd30c5-init/diff:/var/lib/docker/overlay2/b1699f4b68a9298b206924fbb5011a78112fb741c2187f99822d61619a4228cf/diff",
"MergedDir": "/var/lib/docker/overlay2/49ac286702e3a8183222e6ce1458a85ed902e496cfb485ae8806eb0558fd30c5/merged",
"UpperDir": "/var/lib/docker/overlay2/49ac286702e3a8183222e6ce1458a85ed902e496cfb485ae8806eb0558fd30c5/diff",
"WorkDir": "/var/lib/docker/overlay2/49ac286702e3a8183222e6ce1458a85ed902e496cfb485ae8806eb0558fd30c5/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-986384",
"Source": "/var/lib/docker/volumes/old-k8s-version-986384/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-986384",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-986384",
"name.minikube.sigs.k8s.io": "old-k8s-version-986384",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "10ecd55f00a14b021ac702e19b9f504522169e5702e6d9cb8d8136a7777cc315",
"SandboxKey": "/var/run/docker/netns/10ecd55f00a1",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33134"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33133"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33130"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33132"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33131"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-986384": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:4c:02",
"NetworkID": "cf59603fc3c652db8c3cd6e532939511c0fe485962acf2ce9c014504167d3c85",
"EndpointID": "33a3e1a10b9b1651bf758de8b6c4e7bc65da559f1002543de64bec1727ad09e6",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DriverOpts": null,
"DNSNames": [
"old-k8s-version-986384",
"2b3baeee162d"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-986384 -n old-k8s-version-986384
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-986384 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-986384 logs -n 25: (1.384568141s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| ssh | -p kubenet-060426 sudo | kubenet-060426 | jenkins | v1.33.0 | 22 Apr 24 17:59 UTC | |
| | systemctl status crio --all | | | | | |
| | --full --no-pager | | | | | |
| ssh | -p kubenet-060426 sudo | kubenet-060426 | jenkins | v1.33.0 | 22 Apr 24 17:59 UTC | 22 Apr 24 17:59 UTC |
| | systemctl cat crio --no-pager | | | | | |
| ssh | -p kubenet-060426 sudo find | kubenet-060426 | jenkins | v1.33.0 | 22 Apr 24 17:59 UTC | 22 Apr 24 17:59 UTC |
| | /etc/crio -type f -exec sh -c | | | | | |
| | 'echo {}; cat {}' \; | | | | | |
| ssh | -p kubenet-060426 sudo crio | kubenet-060426 | jenkins | v1.33.0 | 22 Apr 24 17:59 UTC | 22 Apr 24 17:59 UTC |
| | config | | | | | |
| delete | -p kubenet-060426 | kubenet-060426 | jenkins | v1.33.0 | 22 Apr 24 17:59 UTC | 22 Apr 24 17:59 UTC |
| start | -p embed-certs-472320 | embed-certs-472320 | jenkins | v1.33.0 | 22 Apr 24 17:59 UTC | 22 Apr 24 18:00 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --kubernetes-version=v1.30.0 | | | | | |
| addons | enable metrics-server -p embed-certs-472320 | embed-certs-472320 | jenkins | v1.33.0 | 22 Apr 24 18:00 UTC | 22 Apr 24 18:00 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p embed-certs-472320 | embed-certs-472320 | jenkins | v1.33.0 | 22 Apr 24 18:00 UTC | 22 Apr 24 18:00 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p embed-certs-472320 | embed-certs-472320 | jenkins | v1.33.0 | 22 Apr 24 18:00 UTC | 22 Apr 24 18:00 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p embed-certs-472320 | embed-certs-472320 | jenkins | v1.33.0 | 22 Apr 24 18:00 UTC | 22 Apr 24 18:05 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --kubernetes-version=v1.30.0 | | | | | |
| addons | enable metrics-server -p old-k8s-version-986384 | old-k8s-version-986384 | jenkins | v1.33.0 | 22 Apr 24 18:01 UTC | 22 Apr 24 18:01 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-986384 | old-k8s-version-986384 | jenkins | v1.33.0 | 22 Apr 24 18:01 UTC | 22 Apr 24 18:01 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-986384 | old-k8s-version-986384 | jenkins | v1.33.0 | 22 Apr 24 18:01 UTC | 22 Apr 24 18:01 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-986384 | old-k8s-version-986384 | jenkins | v1.33.0 | 22 Apr 24 18:01 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| image | embed-certs-472320 image list | embed-certs-472320 | jenkins | v1.33.0 | 22 Apr 24 18:05 UTC | 22 Apr 24 18:05 UTC |
| | --format=json | | | | | |
| pause | -p embed-certs-472320 | embed-certs-472320 | jenkins | v1.33.0 | 22 Apr 24 18:05 UTC | 22 Apr 24 18:05 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p embed-certs-472320 | embed-certs-472320 | jenkins | v1.33.0 | 22 Apr 24 18:05 UTC | 22 Apr 24 18:05 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p embed-certs-472320 | embed-certs-472320 | jenkins | v1.33.0 | 22 Apr 24 18:05 UTC | 22 Apr 24 18:05 UTC |
| delete | -p embed-certs-472320 | embed-certs-472320 | jenkins | v1.33.0 | 22 Apr 24 18:05 UTC | 22 Apr 24 18:05 UTC |
| delete | -p | disable-driver-mounts-242268 | jenkins | v1.33.0 | 22 Apr 24 18:05 UTC | 22 Apr 24 18:05 UTC |
| | disable-driver-mounts-242268 | | | | | |
| start | -p no-preload-256480 | no-preload-256480 | jenkins | v1.33.0 | 22 Apr 24 18:05 UTC | 22 Apr 24 18:06 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --kubernetes-version=v1.30.0 | | | | | |
| addons | enable metrics-server -p no-preload-256480 | no-preload-256480 | jenkins | v1.33.0 | 22 Apr 24 18:06 UTC | 22 Apr 24 18:06 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-256480 | no-preload-256480 | jenkins | v1.33.0 | 22 Apr 24 18:06 UTC | 22 Apr 24 18:06 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-256480 | no-preload-256480 | jenkins | v1.33.0 | 22 Apr 24 18:06 UTC | 22 Apr 24 18:06 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-256480 | no-preload-256480 | jenkins | v1.33.0 | 22 Apr 24 18:06 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --kubernetes-version=v1.30.0 | | | | | |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/04/22 18:06:59
Running on machine: ip-172-31-30-239
Binary: Built with gc go1.22.1 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0422 18:06:59.025840 378993 out.go:291] Setting OutFile to fd 1 ...
I0422 18:06:59.025985 378993 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0422 18:06:59.025995 378993 out.go:304] Setting ErrFile to fd 2...
I0422 18:06:59.026001 378993 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0422 18:06:59.026271 378993 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18706-2371/.minikube/bin
I0422 18:06:59.026654 378993 out.go:298] Setting JSON to false
I0422 18:06:59.027744 378993 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":6566,"bootTime":1713802653,"procs":247,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
I0422 18:06:59.027819 378993 start.go:139] virtualization:
I0422 18:06:59.031020 378993 out.go:177] * [no-preload-256480] minikube v1.33.0 on Ubuntu 20.04 (arm64)
I0422 18:06:59.035497 378993 notify.go:220] Checking for updates...
I0422 18:06:59.036197 378993 out.go:177] - MINIKUBE_LOCATION=18706
I0422 18:06:59.039392 378993 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0422 18:06:59.041743 378993 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18706-2371/kubeconfig
I0422 18:06:59.044304 378993 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18706-2371/.minikube
I0422 18:06:59.046638 378993 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0422 18:06:59.049079 378993 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0422 18:06:54.412693 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:56.912275 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:58.914019 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:06:59.051932 378993 config.go:182] Loaded profile config "no-preload-256480": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.30.0
I0422 18:06:59.052461 378993 driver.go:392] Setting default libvirt URI to qemu:///system
I0422 18:06:59.072461 378993 docker.go:122] docker version: linux-26.0.2:Docker Engine - Community
I0422 18:06:59.072581 378993 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0422 18:06:59.148042 378993 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:52 SystemTime:2024-04-22 18:06:59.13658691 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215101440 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:26.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1]] Warnings:<nil>}}
I0422 18:06:59.148161 378993 docker.go:295] overlay module found
I0422 18:06:59.150517 378993 out.go:177] * Using the docker driver based on existing profile
I0422 18:06:59.152827 378993 start.go:297] selected driver: docker
I0422 18:06:59.152847 378993 start.go:901] validating driver "docker" against &{Name:no-preload-256480 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:no-preload-256480 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0422 18:06:59.152944 378993 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0422 18:06:59.153574 378993 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0422 18:06:59.205430 378993 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:52 SystemTime:2024-04-22 18:06:59.19651651 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215101440 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:26.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1]] Warnings:<nil>}}
I0422 18:06:59.205787 378993 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0422 18:06:59.205845 378993 cni.go:84] Creating CNI manager for ""
I0422 18:06:59.205867 378993 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0422 18:06:59.205915 378993 start.go:340] cluster config:
{Name:no-preload-256480 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:no-preload-256480 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: Mou
ntMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0422 18:06:59.208678 378993 out.go:177] * Starting "no-preload-256480" primary control-plane node in "no-preload-256480" cluster
I0422 18:06:59.210982 378993 cache.go:121] Beginning downloading kic base image for docker with docker
I0422 18:06:59.213468 378993 out.go:177] * Pulling base image v0.0.43-1713736339-18706 ...
I0422 18:06:59.215819 378993 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime docker
I0422 18:06:59.215907 378993 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e in local docker daemon
I0422 18:06:59.215966 378993 profile.go:143] Saving config to /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/no-preload-256480/config.json ...
I0422 18:06:59.216244 378993 cache.go:107] acquiring lock: {Name:mk982e0834e730075b8cf71a515bf2178e2fc860 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0422 18:06:59.216326 378993 cache.go:115] /home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
I0422 18:06:59.216338 378993 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 99.854µs
I0422 18:06:59.216356 378993 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
I0422 18:06:59.216367 378993 cache.go:107] acquiring lock: {Name:mk2d7233727885311987186362ee61a9c8d933ac Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0422 18:06:59.216403 378993 cache.go:115] /home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.30.0 exists
I0422 18:06:59.216413 378993 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.30.0" -> "/home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.30.0" took 47.146µs
I0422 18:06:59.216419 378993 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.30.0 -> /home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.30.0 succeeded
I0422 18:06:59.216429 378993 cache.go:107] acquiring lock: {Name:mk4572706ca61dccee5fcc2b91db0197146b10c2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0422 18:06:59.216460 378993 cache.go:115] /home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.30.0 exists
I0422 18:06:59.216470 378993 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.30.0" -> "/home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.30.0" took 42.099µs
I0422 18:06:59.216477 378993 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.30.0 -> /home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.30.0 succeeded
I0422 18:06:59.216486 378993 cache.go:107] acquiring lock: {Name:mkb78c5efaf91d7ae547bf9edac56ac31cdd6e1b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0422 18:06:59.216525 378993 cache.go:115] /home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.30.0 exists
I0422 18:06:59.216536 378993 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.30.0" -> "/home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.30.0" took 51.74µs
I0422 18:06:59.216543 378993 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.30.0 -> /home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.30.0 succeeded
I0422 18:06:59.216557 378993 cache.go:107] acquiring lock: {Name:mk6d7e1aeb5fe86ca9342d550af611161dd25e6a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0422 18:06:59.216590 378993 cache.go:115] /home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.30.0 exists
I0422 18:06:59.216599 378993 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.30.0" -> "/home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.30.0" took 43.084µs
I0422 18:06:59.216611 378993 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.30.0 -> /home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.30.0 succeeded
I0422 18:06:59.216634 378993 cache.go:107] acquiring lock: {Name:mk11c90aaee40e4efdbf2b0b94f0909d1e296eb8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0422 18:06:59.216664 378993 cache.go:115] /home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9 exists
I0422 18:06:59.216674 378993 cache.go:96] cache image "registry.k8s.io/pause:3.9" -> "/home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9" took 41.886µs
I0422 18:06:59.216681 378993 cache.go:80] save to tar file registry.k8s.io/pause:3.9 -> /home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9 succeeded
I0422 18:06:59.216690 378993 cache.go:107] acquiring lock: {Name:mkd99ac6b013b25833ffc94579a4eda7ccb9aa66 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0422 18:06:59.216718 378993 cache.go:115] /home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.12-0 exists
I0422 18:06:59.216728 378993 cache.go:96] cache image "registry.k8s.io/etcd:3.5.12-0" -> "/home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.12-0" took 39.392µs
I0422 18:06:59.216734 378993 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.12-0 -> /home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.12-0 succeeded
I0422 18:06:59.216746 378993 cache.go:107] acquiring lock: {Name:mk91a8a98fb15bb7356fa05a6738507d9bb85300 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0422 18:06:59.216927 378993 cache.go:115] /home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 exists
I0422 18:06:59.216942 378993 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1" took 199.674µs
I0422 18:06:59.216950 378993 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /home/jenkins/minikube-integration/18706-2371/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
I0422 18:06:59.216957 378993 cache.go:87] Successfully saved all images to host disk.
I0422 18:06:59.237778 378993 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e in local docker daemon, skipping pull
I0422 18:06:59.237804 378993 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e exists in daemon, skipping load
I0422 18:06:59.237824 378993 cache.go:194] Successfully downloaded all kic artifacts
I0422 18:06:59.237851 378993 start.go:360] acquireMachinesLock for no-preload-256480: {Name:mkf4592d83fa520ffb8c066a7abab0272185ded0 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0422 18:06:59.237917 378993 start.go:364] duration metric: took 43.355µs to acquireMachinesLock for "no-preload-256480"
I0422 18:06:59.237941 378993 start.go:96] Skipping create...Using existing machine configuration
I0422 18:06:59.237955 378993 fix.go:54] fixHost starting:
I0422 18:06:59.238235 378993 cli_runner.go:164] Run: docker container inspect no-preload-256480 --format={{.State.Status}}
I0422 18:06:59.253281 378993 fix.go:112] recreateIfNeeded on no-preload-256480: state=Stopped err=<nil>
W0422 18:06:59.253311 378993 fix.go:138] unexpected machine state, will restart: <nil>
I0422 18:06:59.256002 378993 out.go:177] * Restarting existing docker container for "no-preload-256480" ...
I0422 18:06:59.258293 378993 cli_runner.go:164] Run: docker start no-preload-256480
I0422 18:06:59.568923 378993 cli_runner.go:164] Run: docker container inspect no-preload-256480 --format={{.State.Status}}
I0422 18:06:59.589611 378993 kic.go:430] container "no-preload-256480" state is running.
I0422 18:06:59.589984 378993 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-256480
I0422 18:06:59.609998 378993 profile.go:143] Saving config to /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/no-preload-256480/config.json ...
I0422 18:06:59.610228 378993 machine.go:94] provisionDockerMachine start ...
I0422 18:06:59.610292 378993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-256480
I0422 18:06:59.629263 378993 main.go:141] libmachine: Using SSH client type: native
I0422 18:06:59.629532 378993 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 33144 <nil> <nil>}
I0422 18:06:59.629546 378993 main.go:141] libmachine: About to run SSH command:
hostname
I0422 18:06:59.630172 378993 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:46928->127.0.0.1:33144: read: connection reset by peer
I0422 18:07:02.760455 378993 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-256480
I0422 18:07:02.760482 378993 ubuntu.go:169] provisioning hostname "no-preload-256480"
I0422 18:07:02.760562 378993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-256480
I0422 18:07:02.777291 378993 main.go:141] libmachine: Using SSH client type: native
I0422 18:07:02.777556 378993 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 33144 <nil> <nil>}
I0422 18:07:02.777576 378993 main.go:141] libmachine: About to run SSH command:
sudo hostname no-preload-256480 && echo "no-preload-256480" | sudo tee /etc/hostname
I0422 18:07:02.917775 378993 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-256480
I0422 18:07:02.917856 378993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-256480
I0422 18:07:02.936031 378993 main.go:141] libmachine: Using SSH client type: native
I0422 18:07:02.936274 378993 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 33144 <nil> <nil>}
I0422 18:07:02.936296 378993 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-256480' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-256480/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-256480' | sudo tee -a /etc/hosts;
fi
fi
I0422 18:07:03.078136 378993 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0422 18:07:03.078165 378993 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18706-2371/.minikube CaCertPath:/home/jenkins/minikube-integration/18706-2371/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18706-2371/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18706-2371/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18706-2371/.minikube}
I0422 18:07:03.078249 378993 ubuntu.go:177] setting up certificates
I0422 18:07:03.078267 378993 provision.go:84] configureAuth start
I0422 18:07:03.078365 378993 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-256480
I0422 18:07:03.095183 378993 provision.go:143] copyHostCerts
I0422 18:07:03.095279 378993 exec_runner.go:144] found /home/jenkins/minikube-integration/18706-2371/.minikube/key.pem, removing ...
I0422 18:07:03.095294 378993 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18706-2371/.minikube/key.pem
I0422 18:07:03.095384 378993 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18706-2371/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18706-2371/.minikube/key.pem (1675 bytes)
I0422 18:07:03.095642 378993 exec_runner.go:144] found /home/jenkins/minikube-integration/18706-2371/.minikube/ca.pem, removing ...
I0422 18:07:03.095658 378993 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18706-2371/.minikube/ca.pem
I0422 18:07:03.095705 378993 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18706-2371/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18706-2371/.minikube/ca.pem (1078 bytes)
I0422 18:07:03.095791 378993 exec_runner.go:144] found /home/jenkins/minikube-integration/18706-2371/.minikube/cert.pem, removing ...
I0422 18:07:03.095797 378993 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18706-2371/.minikube/cert.pem
I0422 18:07:03.095825 378993 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18706-2371/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18706-2371/.minikube/cert.pem (1123 bytes)
I0422 18:07:03.095878 378993 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18706-2371/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18706-2371/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18706-2371/.minikube/certs/ca-key.pem org=jenkins.no-preload-256480 san=[127.0.0.1 192.168.85.2 localhost minikube no-preload-256480]
I0422 18:07:03.601262 378993 provision.go:177] copyRemoteCerts
I0422 18:07:03.601339 378993 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0422 18:07:03.601394 378993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-256480
I0422 18:07:03.618494 378993 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33144 SSHKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/machines/no-preload-256480/id_rsa Username:docker}
I0422 18:07:03.709813 378993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0422 18:07:03.734343 378993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0422 18:07:03.760142 378993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0422 18:07:03.784798 378993 provision.go:87] duration metric: took 706.484995ms to configureAuth
I0422 18:07:03.784832 378993 ubuntu.go:193] setting minikube options for container-runtime
I0422 18:07:03.785041 378993 config.go:182] Loaded profile config "no-preload-256480": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.30.0
I0422 18:07:03.785123 378993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-256480
I0422 18:07:03.801147 378993 main.go:141] libmachine: Using SSH client type: native
I0422 18:07:03.801400 378993 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 33144 <nil> <nil>}
I0422 18:07:03.801416 378993 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0422 18:07:03.925442 378993 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0422 18:07:03.925478 378993 ubuntu.go:71] root file system type: overlay
I0422 18:07:03.925575 378993 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
I0422 18:07:03.925646 378993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-256480
I0422 18:07:03.940754 378993 main.go:141] libmachine: Using SSH client type: native
I0422 18:07:03.941078 378993 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 33144 <nil> <nil>}
I0422 18:07:03.941165 378993 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0422 18:07:01.412728 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:03.911888 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:04.089983 378993 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0422 18:07:04.090106 378993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-256480
I0422 18:07:04.108437 378993 main.go:141] libmachine: Using SSH client type: native
I0422 18:07:04.108862 378993 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 33144 <nil> <nil>}
I0422 18:07:04.108891 378993 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0422 18:07:04.247191 378993 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0422 18:07:04.247214 378993 machine.go:97] duration metric: took 4.636972358s to provisionDockerMachine
I0422 18:07:04.247227 378993 start.go:293] postStartSetup for "no-preload-256480" (driver="docker")
I0422 18:07:04.247238 378993 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0422 18:07:04.247326 378993 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0422 18:07:04.247371 378993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-256480
I0422 18:07:04.263624 378993 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33144 SSHKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/machines/no-preload-256480/id_rsa Username:docker}
I0422 18:07:04.354144 378993 ssh_runner.go:195] Run: cat /etc/os-release
I0422 18:07:04.357349 378993 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0422 18:07:04.357383 378993 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0422 18:07:04.357397 378993 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0422 18:07:04.357404 378993 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0422 18:07:04.357414 378993 filesync.go:126] Scanning /home/jenkins/minikube-integration/18706-2371/.minikube/addons for local assets ...
I0422 18:07:04.357467 378993 filesync.go:126] Scanning /home/jenkins/minikube-integration/18706-2371/.minikube/files for local assets ...
I0422 18:07:04.357545 378993 filesync.go:149] local asset: /home/jenkins/minikube-integration/18706-2371/.minikube/files/etc/ssl/certs/77282.pem -> 77282.pem in /etc/ssl/certs
I0422 18:07:04.357669 378993 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0422 18:07:04.366022 378993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/files/etc/ssl/certs/77282.pem --> /etc/ssl/certs/77282.pem (1708 bytes)
I0422 18:07:04.391147 378993 start.go:296] duration metric: took 143.904685ms for postStartSetup
I0422 18:07:04.391302 378993 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0422 18:07:04.391359 378993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-256480
I0422 18:07:04.411210 378993 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33144 SSHKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/machines/no-preload-256480/id_rsa Username:docker}
I0422 18:07:04.497710 378993 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0422 18:07:04.502197 378993 fix.go:56] duration metric: took 5.264241004s for fixHost
I0422 18:07:04.502221 378993 start.go:83] releasing machines lock for "no-preload-256480", held for 5.26429198s
I0422 18:07:04.502311 378993 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-256480
I0422 18:07:04.519288 378993 ssh_runner.go:195] Run: cat /version.json
I0422 18:07:04.519352 378993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-256480
I0422 18:07:04.519751 378993 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0422 18:07:04.519804 378993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-256480
I0422 18:07:04.538275 378993 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33144 SSHKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/machines/no-preload-256480/id_rsa Username:docker}
I0422 18:07:04.551678 378993 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33144 SSHKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/machines/no-preload-256480/id_rsa Username:docker}
I0422 18:07:04.752786 378993 ssh_runner.go:195] Run: systemctl --version
I0422 18:07:04.758731 378993 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0422 18:07:04.763594 378993 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0422 18:07:04.784484 378993 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0422 18:07:04.784629 378993 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0422 18:07:04.794285 378993 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0422 18:07:04.794316 378993 start.go:494] detecting cgroup driver to use...
I0422 18:07:04.794346 378993 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0422 18:07:04.794461 378993 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0422 18:07:04.811577 378993 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0422 18:07:04.822221 378993 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0422 18:07:04.833741 378993 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0422 18:07:04.833853 378993 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0422 18:07:04.844125 378993 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0422 18:07:04.854505 378993 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0422 18:07:04.864654 378993 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0422 18:07:04.875098 378993 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0422 18:07:04.884149 378993 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0422 18:07:04.894469 378993 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0422 18:07:04.904456 378993 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0422 18:07:04.916076 378993 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0422 18:07:04.925619 378993 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0422 18:07:04.934553 378993 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0422 18:07:05.044391 378993 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0422 18:07:05.158138 378993 start.go:494] detecting cgroup driver to use...
I0422 18:07:05.158242 378993 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0422 18:07:05.158328 378993 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0422 18:07:05.176105 378993 cruntime.go:279] skipping containerd shutdown because we are bound to it
I0422 18:07:05.176264 378993 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0422 18:07:05.190268 378993 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0422 18:07:05.208962 378993 ssh_runner.go:195] Run: which cri-dockerd
I0422 18:07:05.212941 378993 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0422 18:07:05.222384 378993 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
I0422 18:07:05.242403 378993 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0422 18:07:05.363395 378993 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0422 18:07:05.507430 378993 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I0422 18:07:05.507594 378993 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I0422 18:07:05.531150 378993 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0422 18:07:05.631547 378993 ssh_runner.go:195] Run: sudo systemctl restart docker
I0422 18:07:06.209949 378993 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket
I0422 18:07:06.222643 378993 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket
I0422 18:07:06.237007 378993 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I0422 18:07:06.249382 378993 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I0422 18:07:06.348703 378993 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0422 18:07:06.445956 378993 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0422 18:07:06.547249 378993 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I0422 18:07:06.562483 378993 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I0422 18:07:06.574905 378993 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0422 18:07:06.692959 378993 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service
I0422 18:07:06.787493 378993 start.go:541] Will wait 60s for socket path /var/run/cri-dockerd.sock
I0422 18:07:06.787640 378993 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
I0422 18:07:06.792627 378993 start.go:562] Will wait 60s for crictl version
I0422 18:07:06.792895 378993 ssh_runner.go:195] Run: which crictl
I0422 18:07:06.799008 378993 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0422 18:07:06.848649 378993 start.go:578] Version: 0.1.0
RuntimeName: docker
RuntimeVersion: 26.0.2
RuntimeApiVersion: v1
I0422 18:07:06.848830 378993 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0422 18:07:06.873517 378993 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0422 18:07:06.900033 378993 out.go:204] * Preparing Kubernetes v1.30.0 on Docker 26.0.2 ...
I0422 18:07:06.900133 378993 cli_runner.go:164] Run: docker network inspect no-preload-256480 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0422 18:07:06.915095 378993 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0422 18:07:06.918701 378993 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0422 18:07:06.929703 378993 kubeadm.go:877] updating cluster {Name:no-preload-256480 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:no-preload-256480 Namespace:default APIServerHAVIP: APIServerName:minikubeCA API
ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/min
ikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0422 18:07:06.929827 378993 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime docker
I0422 18:07:06.929872 378993 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0422 18:07:06.947603 378993 docker.go:685] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.30.0
registry.k8s.io/kube-scheduler:v1.30.0
registry.k8s.io/kube-proxy:v1.30.0
registry.k8s.io/kube-controller-manager:v1.30.0
registry.k8s.io/etcd:3.5.12-0
registry.k8s.io/coredns/coredns:v1.11.1
registry.k8s.io/pause:3.9
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
-- /stdout --
I0422 18:07:06.947626 378993 cache_images.go:84] Images are preloaded, skipping loading
I0422 18:07:06.947639 378993 kubeadm.go:928] updating node { 192.168.85.2 8443 v1.30.0 docker true true} ...
I0422 18:07:06.947742 378993 kubeadm.go:940] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.30.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=no-preload-256480 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.30.0 ClusterName:no-preload-256480 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0422 18:07:06.947808 378993 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0422 18:07:06.996382 378993 cni.go:84] Creating CNI manager for ""
I0422 18:07:06.996410 378993 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0422 18:07:06.996424 378993 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0422 18:07:06.996443 378993 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.30.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-256480 NodeName:no-preload-256480 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/e
tc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0422 18:07:06.996584 378993 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/cri-dockerd.sock
name: "no-preload-256480"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.30.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0422 18:07:06.996648 378993 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0
I0422 18:07:07.009449 378993 binaries.go:44] Found k8s binaries, skipping transfer
I0422 18:07:07.009523 378993 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0422 18:07:07.019402 378993 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (316 bytes)
I0422 18:07:07.039350 378993 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0422 18:07:07.058866 378993 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2159 bytes)
I0422 18:07:07.078460 378993 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0422 18:07:07.082256 378993 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0422 18:07:07.093242 378993 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0422 18:07:07.189690 378993 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0422 18:07:07.206606 378993 certs.go:68] Setting up /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/no-preload-256480 for IP: 192.168.85.2
I0422 18:07:07.206627 378993 certs.go:194] generating shared ca certs ...
I0422 18:07:07.206644 378993 certs.go:226] acquiring lock for ca certs: {Name:mkc0c6170c42b1b43b7f622fcbfe2e475bd8761f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0422 18:07:07.206789 378993 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18706-2371/.minikube/ca.key
I0422 18:07:07.206840 378993 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18706-2371/.minikube/proxy-client-ca.key
I0422 18:07:07.206850 378993 certs.go:256] generating profile certs ...
I0422 18:07:07.206938 378993 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/no-preload-256480/client.key
I0422 18:07:07.207014 378993 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/no-preload-256480/apiserver.key.08922ffc
I0422 18:07:07.207058 378993 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/no-preload-256480/proxy-client.key
I0422 18:07:07.207179 378993 certs.go:484] found cert: /home/jenkins/minikube-integration/18706-2371/.minikube/certs/7728.pem (1338 bytes)
W0422 18:07:07.207216 378993 certs.go:480] ignoring /home/jenkins/minikube-integration/18706-2371/.minikube/certs/7728_empty.pem, impossibly tiny 0 bytes
I0422 18:07:07.207234 378993 certs.go:484] found cert: /home/jenkins/minikube-integration/18706-2371/.minikube/certs/ca-key.pem (1675 bytes)
I0422 18:07:07.207264 378993 certs.go:484] found cert: /home/jenkins/minikube-integration/18706-2371/.minikube/certs/ca.pem (1078 bytes)
I0422 18:07:07.207290 378993 certs.go:484] found cert: /home/jenkins/minikube-integration/18706-2371/.minikube/certs/cert.pem (1123 bytes)
I0422 18:07:07.207318 378993 certs.go:484] found cert: /home/jenkins/minikube-integration/18706-2371/.minikube/certs/key.pem (1675 bytes)
I0422 18:07:07.207363 378993 certs.go:484] found cert: /home/jenkins/minikube-integration/18706-2371/.minikube/files/etc/ssl/certs/77282.pem (1708 bytes)
I0422 18:07:07.207986 378993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0422 18:07:07.240895 378993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0422 18:07:07.268377 378993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0422 18:07:07.314673 378993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0422 18:07:07.346310 378993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/no-preload-256480/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0422 18:07:07.379956 378993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/no-preload-256480/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0422 18:07:07.421360 378993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/no-preload-256480/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0422 18:07:07.452127 378993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/profiles/no-preload-256480/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0422 18:07:07.481712 378993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/files/etc/ssl/certs/77282.pem --> /usr/share/ca-certificates/77282.pem (1708 bytes)
I0422 18:07:07.513352 378993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0422 18:07:07.543708 378993 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-2371/.minikube/certs/7728.pem --> /usr/share/ca-certificates/7728.pem (1338 bytes)
I0422 18:07:07.581860 378993 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0422 18:07:07.606585 378993 ssh_runner.go:195] Run: openssl version
I0422 18:07:07.612317 378993 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7728.pem && ln -fs /usr/share/ca-certificates/7728.pem /etc/ssl/certs/7728.pem"
I0422 18:07:07.623773 378993 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7728.pem
I0422 18:07:07.627489 378993 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 22 17:02 /usr/share/ca-certificates/7728.pem
I0422 18:07:07.627560 378993 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7728.pem
I0422 18:07:07.634500 378993 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/7728.pem /etc/ssl/certs/51391683.0"
I0422 18:07:07.644680 378993 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/77282.pem && ln -fs /usr/share/ca-certificates/77282.pem /etc/ssl/certs/77282.pem"
I0422 18:07:07.655158 378993 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/77282.pem
I0422 18:07:07.658847 378993 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 22 17:02 /usr/share/ca-certificates/77282.pem
I0422 18:07:07.658904 378993 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/77282.pem
I0422 18:07:07.667556 378993 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/77282.pem /etc/ssl/certs/3ec20f2e.0"
I0422 18:07:07.676905 378993 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0422 18:07:07.686488 378993 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0422 18:07:07.690107 378993 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 22 16:57 /usr/share/ca-certificates/minikubeCA.pem
I0422 18:07:07.690227 378993 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0422 18:07:07.697614 378993 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0422 18:07:07.708744 378993 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0422 18:07:07.712302 378993 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0422 18:07:07.719148 378993 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0422 18:07:07.726314 378993 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0422 18:07:07.733183 378993 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0422 18:07:07.740204 378993 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0422 18:07:07.747175 378993 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0422 18:07:07.754200 378993 kubeadm.go:391] StartCluster: {Name:no-preload-256480 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:no-preload-256480 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/miniku
be-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0422 18:07:07.754362 378993 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0422 18:07:07.771815 378993 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0422 18:07:07.781400 378993 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0422 18:07:07.781430 378993 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0422 18:07:07.781436 378993 kubeadm.go:587] restartPrimaryControlPlane start ...
I0422 18:07:07.781489 378993 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0422 18:07:07.791036 378993 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0422 18:07:07.791690 378993 kubeconfig.go:47] verify endpoint returned: get endpoint: "no-preload-256480" does not appear in /home/jenkins/minikube-integration/18706-2371/kubeconfig
I0422 18:07:07.791999 378993 kubeconfig.go:62] /home/jenkins/minikube-integration/18706-2371/kubeconfig needs updating (will repair): [kubeconfig missing "no-preload-256480" cluster setting kubeconfig missing "no-preload-256480" context setting]
I0422 18:07:07.792536 378993 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18706-2371/kubeconfig: {Name:mkd3bbb31387c9740f072dd59bcca857246cca69 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0422 18:07:07.794016 378993 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0422 18:07:07.802881 378993 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.85.2
I0422 18:07:07.802964 378993 kubeadm.go:591] duration metric: took 21.522669ms to restartPrimaryControlPlane
I0422 18:07:07.802981 378993 kubeadm.go:393] duration metric: took 48.798009ms to StartCluster
I0422 18:07:07.802998 378993 settings.go:142] acquiring lock: {Name:mk4d4aae5dac6b45b6276ad1e8e6929d4ff7540f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0422 18:07:07.803062 378993 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/18706-2371/kubeconfig
I0422 18:07:07.803977 378993 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18706-2371/kubeconfig: {Name:mkd3bbb31387c9740f072dd59bcca857246cca69 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0422 18:07:07.804199 378993 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0422 18:07:07.808369 378993 out.go:177] * Verifying Kubernetes components...
I0422 18:07:07.804575 378993 config.go:182] Loaded profile config "no-preload-256480": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.30.0
I0422 18:07:07.804600 378993 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0422 18:07:07.810581 378993 addons.go:69] Setting storage-provisioner=true in profile "no-preload-256480"
I0422 18:07:07.810610 378993 addons.go:234] Setting addon storage-provisioner=true in "no-preload-256480"
W0422 18:07:07.810618 378993 addons.go:243] addon storage-provisioner should already be in state true
I0422 18:07:07.810645 378993 host.go:66] Checking if "no-preload-256480" exists ...
I0422 18:07:07.810646 378993 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0422 18:07:07.810762 378993 addons.go:69] Setting dashboard=true in profile "no-preload-256480"
I0422 18:07:07.810786 378993 addons.go:234] Setting addon dashboard=true in "no-preload-256480"
W0422 18:07:07.810793 378993 addons.go:243] addon dashboard should already be in state true
I0422 18:07:07.810819 378993 host.go:66] Checking if "no-preload-256480" exists ...
I0422 18:07:07.811077 378993 cli_runner.go:164] Run: docker container inspect no-preload-256480 --format={{.State.Status}}
I0422 18:07:07.811207 378993 cli_runner.go:164] Run: docker container inspect no-preload-256480 --format={{.State.Status}}
I0422 18:07:07.811581 378993 addons.go:69] Setting default-storageclass=true in profile "no-preload-256480"
I0422 18:07:07.811613 378993 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-256480"
I0422 18:07:07.811869 378993 cli_runner.go:164] Run: docker container inspect no-preload-256480 --format={{.State.Status}}
I0422 18:07:07.812137 378993 addons.go:69] Setting metrics-server=true in profile "no-preload-256480"
I0422 18:07:07.812165 378993 addons.go:234] Setting addon metrics-server=true in "no-preload-256480"
W0422 18:07:07.812172 378993 addons.go:243] addon metrics-server should already be in state true
I0422 18:07:07.812196 378993 host.go:66] Checking if "no-preload-256480" exists ...
I0422 18:07:07.812570 378993 cli_runner.go:164] Run: docker container inspect no-preload-256480 --format={{.State.Status}}
I0422 18:07:07.856328 378993 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0422 18:07:07.859511 378993 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0422 18:07:07.859533 378993 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0422 18:07:07.865720 378993 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0422 18:07:07.860321 378993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-256480
I0422 18:07:07.868291 378993 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0422 18:07:07.868306 378993 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0422 18:07:07.868372 378993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-256480
I0422 18:07:07.876884 378993 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0422 18:07:07.880883 378993 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0422 18:07:07.884871 378993 addons.go:426] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0422 18:07:07.884895 378993 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0422 18:07:07.884963 378993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-256480
I0422 18:07:07.885314 378993 addons.go:234] Setting addon default-storageclass=true in "no-preload-256480"
W0422 18:07:07.885335 378993 addons.go:243] addon default-storageclass should already be in state true
I0422 18:07:07.885370 378993 host.go:66] Checking if "no-preload-256480" exists ...
I0422 18:07:07.885757 378993 cli_runner.go:164] Run: docker container inspect no-preload-256480 --format={{.State.Status}}
I0422 18:07:07.932384 378993 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33144 SSHKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/machines/no-preload-256480/id_rsa Username:docker}
I0422 18:07:07.938414 378993 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33144 SSHKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/machines/no-preload-256480/id_rsa Username:docker}
I0422 18:07:07.948019 378993 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0422 18:07:07.948041 378993 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0422 18:07:07.948102 378993 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-256480
I0422 18:07:07.956875 378993 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33144 SSHKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/machines/no-preload-256480/id_rsa Username:docker}
I0422 18:07:07.980935 378993 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33144 SSHKeyPath:/home/jenkins/minikube-integration/18706-2371/.minikube/machines/no-preload-256480/id_rsa Username:docker}
I0422 18:07:08.045336 378993 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0422 18:07:08.146279 378993 node_ready.go:35] waiting up to 6m0s for node "no-preload-256480" to be "Ready" ...
I0422 18:07:08.183520 378993 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0422 18:07:08.183587 378993 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0422 18:07:08.256648 378993 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0422 18:07:08.283373 378993 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0422 18:07:08.311638 378993 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0422 18:07:08.311702 378993 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0422 18:07:08.359002 378993 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0422 18:07:08.359033 378993 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0422 18:07:08.447564 378993 addons.go:426] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0422 18:07:08.447591 378993 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
W0422 18:07:08.514407 378993 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0422 18:07:08.514450 378993 retry.go:31] will retry after 139.659086ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0422 18:07:08.519784 378993 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0422 18:07:08.519810 378993 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0422 18:07:08.655160 378993 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0422 18:07:08.693019 378993 addons.go:426] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0422 18:07:08.693083 378993 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0422 18:07:08.789452 378993 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0422 18:07:08.789527 378993 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0422 18:07:05.913589 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:07.923781 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:09.078349 378993 addons.go:426] installing /etc/kubernetes/addons/dashboard-role.yaml
I0422 18:07:09.078378 378993 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0422 18:07:09.097149 378993 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0422 18:07:09.252080 378993 addons.go:426] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0422 18:07:09.252168 378993 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0422 18:07:09.382205 378993 addons.go:426] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0422 18:07:09.382232 378993 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0422 18:07:09.416713 378993 addons.go:426] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0422 18:07:09.416812 378993 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0422 18:07:09.468461 378993 addons.go:426] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0422 18:07:09.468533 378993 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0422 18:07:09.505459 378993 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0422 18:07:12.975005 378993 node_ready.go:49] node "no-preload-256480" has status "Ready":"True"
I0422 18:07:12.975029 378993 node_ready.go:38] duration metric: took 4.828707244s for node "no-preload-256480" to be "Ready" ...
I0422 18:07:12.975040 378993 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0422 18:07:13.053150 378993 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-r6nxm" in "kube-system" namespace to be "Ready" ...
I0422 18:07:13.093462 378993 pod_ready.go:92] pod "coredns-7db6d8ff4d-r6nxm" in "kube-system" namespace has status "Ready":"True"
I0422 18:07:13.093537 378993 pod_ready.go:81] duration metric: took 40.300992ms for pod "coredns-7db6d8ff4d-r6nxm" in "kube-system" namespace to be "Ready" ...
I0422 18:07:13.093578 378993 pod_ready.go:78] waiting up to 6m0s for pod "etcd-no-preload-256480" in "kube-system" namespace to be "Ready" ...
I0422 18:07:13.099364 378993 pod_ready.go:92] pod "etcd-no-preload-256480" in "kube-system" namespace has status "Ready":"True"
I0422 18:07:13.099443 378993 pod_ready.go:81] duration metric: took 5.831036ms for pod "etcd-no-preload-256480" in "kube-system" namespace to be "Ready" ...
I0422 18:07:13.099470 378993 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-no-preload-256480" in "kube-system" namespace to be "Ready" ...
I0422 18:07:13.108941 378993 pod_ready.go:92] pod "kube-apiserver-no-preload-256480" in "kube-system" namespace has status "Ready":"True"
I0422 18:07:13.109005 378993 pod_ready.go:81] duration metric: took 9.4926ms for pod "kube-apiserver-no-preload-256480" in "kube-system" namespace to be "Ready" ...
I0422 18:07:13.109034 378993 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-no-preload-256480" in "kube-system" namespace to be "Ready" ...
I0422 18:07:13.129099 378993 pod_ready.go:92] pod "kube-controller-manager-no-preload-256480" in "kube-system" namespace has status "Ready":"True"
I0422 18:07:13.129171 378993 pod_ready.go:81] duration metric: took 20.11686ms for pod "kube-controller-manager-no-preload-256480" in "kube-system" namespace to be "Ready" ...
I0422 18:07:13.129196 378993 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-mjb47" in "kube-system" namespace to be "Ready" ...
I0422 18:07:13.178338 378993 pod_ready.go:92] pod "kube-proxy-mjb47" in "kube-system" namespace has status "Ready":"True"
I0422 18:07:13.178369 378993 pod_ready.go:81] duration metric: took 49.151165ms for pod "kube-proxy-mjb47" in "kube-system" namespace to be "Ready" ...
I0422 18:07:13.178381 378993 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-no-preload-256480" in "kube-system" namespace to be "Ready" ...
I0422 18:07:13.581822 378993 pod_ready.go:92] pod "kube-scheduler-no-preload-256480" in "kube-system" namespace has status "Ready":"True"
I0422 18:07:13.581854 378993 pod_ready.go:81] duration metric: took 403.464218ms for pod "kube-scheduler-no-preload-256480" in "kube-system" namespace to be "Ready" ...
I0422 18:07:13.581867 378993 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-569cc877fc-xsb7m" in "kube-system" namespace to be "Ready" ...
I0422 18:07:10.411742 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:12.415123 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:15.588901 378993 pod_ready.go:102] pod "metrics-server-569cc877fc-xsb7m" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:15.632423 378993 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.349011124s)
I0422 18:07:15.632482 378993 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (6.977242803s)
I0422 18:07:15.887247 378993 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (6.790041428s)
I0422 18:07:15.887283 378993 addons.go:470] Verifying addon metrics-server=true in "no-preload-256480"
I0422 18:07:15.887387 378993 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (6.381850954s)
I0422 18:07:15.889532 378993 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p no-preload-256480 addons enable metrics-server
I0422 18:07:15.891850 378993 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
I0422 18:07:15.893951 378993 addons.go:505] duration metric: took 8.089348306s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server dashboard]
I0422 18:07:18.088014 378993 pod_ready.go:102] pod "metrics-server-569cc877fc-xsb7m" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:14.415686 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:16.923201 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:20.587890 378993 pod_ready.go:102] pod "metrics-server-569cc877fc-xsb7m" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:22.593010 378993 pod_ready.go:102] pod "metrics-server-569cc877fc-xsb7m" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:19.413145 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:21.913081 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:25.088259 378993 pod_ready.go:102] pod "metrics-server-569cc877fc-xsb7m" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:27.610504 378993 pod_ready.go:102] pod "metrics-server-569cc877fc-xsb7m" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:24.412193 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:26.413214 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:28.922687 365956 pod_ready.go:102] pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:28.922717 365956 pod_ready.go:81] duration metric: took 4m0.0164876s for pod "metrics-server-9975d5f86-ts7pq" in "kube-system" namespace to be "Ready" ...
E0422 18:07:28.922728 365956 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0422 18:07:28.922736 365956 pod_ready.go:38] duration metric: took 5m28.983477844s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0422 18:07:28.922790 365956 api_server.go:52] waiting for apiserver process to appear ...
I0422 18:07:28.922897 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0422 18:07:28.955854 365956 logs.go:276] 2 containers: [cfd818ddce4e 36734b404817]
I0422 18:07:28.955975 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0422 18:07:28.979086 365956 logs.go:276] 2 containers: [5899397ea4a9 f029b0e7c02d]
I0422 18:07:28.979186 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0422 18:07:28.997173 365956 logs.go:276] 2 containers: [27648c4ab762 f9d8bddf7197]
I0422 18:07:28.997325 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0422 18:07:29.033417 365956 logs.go:276] 2 containers: [8d4da1dcae53 4ef6e29c4a78]
I0422 18:07:29.033558 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0422 18:07:29.076926 365956 logs.go:276] 2 containers: [99181fe4786b 2670916c7c26]
I0422 18:07:29.077015 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0422 18:07:29.096098 365956 logs.go:276] 2 containers: [980fcb0f5f0b d0fea9e4ec1f]
I0422 18:07:29.096268 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0422 18:07:30.092265 378993 pod_ready.go:102] pod "metrics-server-569cc877fc-xsb7m" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:32.588159 378993 pod_ready.go:102] pod "metrics-server-569cc877fc-xsb7m" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:29.115469 365956 logs.go:276] 0 containers: []
W0422 18:07:29.115495 365956 logs.go:278] No container was found matching "kindnet"
I0422 18:07:29.115565 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0422 18:07:29.135054 365956 logs.go:276] 1 containers: [38455e350073]
I0422 18:07:29.135166 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0422 18:07:29.157549 365956 logs.go:276] 2 containers: [2e587f1e7363 9dca99e0f1e4]
I0422 18:07:29.157650 365956 logs.go:123] Gathering logs for container status ...
I0422 18:07:29.157705 365956 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0422 18:07:29.256493 365956 logs.go:123] Gathering logs for dmesg ...
I0422 18:07:29.256681 365956 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0422 18:07:29.279579 365956 logs.go:123] Gathering logs for kube-apiserver [36734b404817] ...
I0422 18:07:29.279617 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36734b404817"
I0422 18:07:29.441285 365956 logs.go:123] Gathering logs for kube-scheduler [4ef6e29c4a78] ...
I0422 18:07:29.441326 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4ef6e29c4a78"
I0422 18:07:29.486255 365956 logs.go:123] Gathering logs for kube-proxy [2670916c7c26] ...
I0422 18:07:29.486291 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2670916c7c26"
I0422 18:07:29.517182 365956 logs.go:123] Gathering logs for kube-controller-manager [980fcb0f5f0b] ...
I0422 18:07:29.517212 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 980fcb0f5f0b"
I0422 18:07:29.587467 365956 logs.go:123] Gathering logs for Docker ...
I0422 18:07:29.587506 365956 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0422 18:07:29.633184 365956 logs.go:123] Gathering logs for kube-apiserver [cfd818ddce4e] ...
I0422 18:07:29.633223 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 cfd818ddce4e"
I0422 18:07:29.708734 365956 logs.go:123] Gathering logs for etcd [f029b0e7c02d] ...
I0422 18:07:29.708877 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f029b0e7c02d"
I0422 18:07:29.751034 365956 logs.go:123] Gathering logs for coredns [27648c4ab762] ...
I0422 18:07:29.751077 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 27648c4ab762"
I0422 18:07:29.796111 365956 logs.go:123] Gathering logs for kube-proxy [99181fe4786b] ...
I0422 18:07:29.796299 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 99181fe4786b"
I0422 18:07:29.830508 365956 logs.go:123] Gathering logs for kubelet ...
I0422 18:07:29.830540 365956 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0422 18:07:29.888134 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832037 1196 reflector.go:138] object-"kube-system"/"storage-provisioner-token-g68k5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-g68k5" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:29.888394 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832152 1196 reflector.go:138] object-"kube-system"/"kube-proxy-token-f585x": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-f585x" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:29.888628 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832232 1196 reflector.go:138] object-"default"/"default-token-b4l4p": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-b4l4p" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:29.888876 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832306 1196 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:29.889095 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832383 1196 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:29.889307 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832559 1196 reflector.go:138] object-"kube-system"/"coredns-token-2dv2q": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-2dv2q" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:29.898081 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:03 old-k8s-version-986384 kubelet[1196]: E0422 18:02:03.226868 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0422 18:07:29.898812 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:03 old-k8s-version-986384 kubelet[1196]: E0422 18:02:03.888305 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.901567 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:15 old-k8s-version-986384 kubelet[1196]: E0422 18:02:15.641552 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0422 18:07:29.911177 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:24 old-k8s-version-986384 kubelet[1196]: E0422 18:02:24.265785 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0422 18:07:29.911576 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:24 old-k8s-version-986384 kubelet[1196]: E0422 18:02:24.368306 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.911763 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:30 old-k8s-version-986384 kubelet[1196]: E0422 18:02:30.628159 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.912531 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:32 old-k8s-version-986384 kubelet[1196]: E0422 18:02:32.453214 1196 pod_workers.go:191] Error syncing pod df339435-cb7d-470a-8aec-c5eb3f389a93 ("storage-provisioner_kube-system(df339435-cb7d-470a-8aec-c5eb3f389a93)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(df339435-cb7d-470a-8aec-c5eb3f389a93)"
W0422 18:07:29.915088 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:39 old-k8s-version-986384 kubelet[1196]: E0422 18:02:39.049200 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0422 18:07:29.918558 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:43 old-k8s-version-986384 kubelet[1196]: E0422 18:02:43.646522 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0422 18:07:29.919251 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:52 old-k8s-version-986384 kubelet[1196]: E0422 18:02:52.618806 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.919438 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:58 old-k8s-version-986384 kubelet[1196]: E0422 18:02:58.622275 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.922358 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:05 old-k8s-version-986384 kubelet[1196]: E0422 18:03:05.091231 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0422 18:07:29.922613 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:10 old-k8s-version-986384 kubelet[1196]: E0422 18:03:10.630961 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.922958 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:16 old-k8s-version-986384 kubelet[1196]: E0422 18:03:16.618514 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.923201 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:23 old-k8s-version-986384 kubelet[1196]: E0422 18:03:23.618416 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.923405 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:30 old-k8s-version-986384 kubelet[1196]: E0422 18:03:30.632521 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.925888 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:34 old-k8s-version-986384 kubelet[1196]: E0422 18:03:34.649485 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0422 18:07:29.926096 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:43 old-k8s-version-986384 kubelet[1196]: E0422 18:03:43.618651 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.926287 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:46 old-k8s-version-986384 kubelet[1196]: E0422 18:03:46.619360 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.928592 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:59 old-k8s-version-986384 kubelet[1196]: E0422 18:03:59.083435 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0422 18:07:29.936494 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:59 old-k8s-version-986384 kubelet[1196]: E0422 18:03:59.618394 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.936812 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:12 old-k8s-version-986384 kubelet[1196]: E0422 18:04:12.618866 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.937069 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:13 old-k8s-version-986384 kubelet[1196]: E0422 18:04:13.618430 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.937262 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:23 old-k8s-version-986384 kubelet[1196]: E0422 18:04:23.618440 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.937642 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:24 old-k8s-version-986384 kubelet[1196]: E0422 18:04:24.643322 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.937831 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:38 old-k8s-version-986384 kubelet[1196]: E0422 18:04:38.629329 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.938079 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:38 old-k8s-version-986384 kubelet[1196]: E0422 18:04:38.634742 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.938402 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:49 old-k8s-version-986384 kubelet[1196]: E0422 18:04:49.618463 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.938592 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:53 old-k8s-version-986384 kubelet[1196]: E0422 18:04:53.618422 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.938788 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:00 old-k8s-version-986384 kubelet[1196]: E0422 18:05:00.619147 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.940980 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:05 old-k8s-version-986384 kubelet[1196]: E0422 18:05:05.638308 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0422 18:07:29.941308 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:11 old-k8s-version-986384 kubelet[1196]: E0422 18:05:11.618472 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.941516 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:16 old-k8s-version-986384 kubelet[1196]: E0422 18:05:16.627331 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.944352 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:23 old-k8s-version-986384 kubelet[1196]: E0422 18:05:23.061150 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0422 18:07:29.944593 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:28 old-k8s-version-986384 kubelet[1196]: E0422 18:05:28.618921 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.945064 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:34 old-k8s-version-986384 kubelet[1196]: E0422 18:05:34.621754 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.945265 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:39 old-k8s-version-986384 kubelet[1196]: E0422 18:05:39.618114 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.945464 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:45 old-k8s-version-986384 kubelet[1196]: E0422 18:05:45.663272 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.945650 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:51 old-k8s-version-986384 kubelet[1196]: E0422 18:05:51.618807 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.945847 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:58 old-k8s-version-986384 kubelet[1196]: E0422 18:05:58.648913 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.946032 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:04 old-k8s-version-986384 kubelet[1196]: E0422 18:06:04.618373 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.946230 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:11 old-k8s-version-986384 kubelet[1196]: E0422 18:06:11.618095 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.946414 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:15 old-k8s-version-986384 kubelet[1196]: E0422 18:06:15.618294 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.946610 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:25 old-k8s-version-986384 kubelet[1196]: E0422 18:06:25.619230 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.946797 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:30 old-k8s-version-986384 kubelet[1196]: E0422 18:06:30.618689 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.946994 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:39 old-k8s-version-986384 kubelet[1196]: E0422 18:06:39.618588 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.947177 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:43 old-k8s-version-986384 kubelet[1196]: E0422 18:06:43.618416 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.947371 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:54 old-k8s-version-986384 kubelet[1196]: E0422 18:06:54.627082 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.947554 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:55 old-k8s-version-986384 kubelet[1196]: E0422 18:06:55.618270 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.947736 365956 logs.go:138] Found kubelet problem: Apr 22 18:07:06 old-k8s-version-986384 kubelet[1196]: E0422 18:07:06.619950 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.947930 365956 logs.go:138] Found kubelet problem: Apr 22 18:07:07 old-k8s-version-986384 kubelet[1196]: E0422 18:07:07.618622 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.948113 365956 logs.go:138] Found kubelet problem: Apr 22 18:07:18 old-k8s-version-986384 kubelet[1196]: E0422 18:07:18.622590 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.948309 365956 logs.go:138] Found kubelet problem: Apr 22 18:07:18 old-k8s-version-986384 kubelet[1196]: E0422 18:07:18.645475 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:29.948496 365956 logs.go:138] Found kubelet problem: Apr 22 18:07:29 old-k8s-version-986384 kubelet[1196]: E0422 18:07:29.619046 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0422 18:07:29.948506 365956 logs.go:123] Gathering logs for kubernetes-dashboard [38455e350073] ...
I0422 18:07:29.948519 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38455e350073"
I0422 18:07:29.972630 365956 logs.go:123] Gathering logs for storage-provisioner [2e587f1e7363] ...
I0422 18:07:29.972659 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2e587f1e7363"
I0422 18:07:29.993589 365956 logs.go:123] Gathering logs for storage-provisioner [9dca99e0f1e4] ...
I0422 18:07:29.993618 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9dca99e0f1e4"
I0422 18:07:30.030083 365956 logs.go:123] Gathering logs for describe nodes ...
I0422 18:07:30.030117 365956 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0422 18:07:30.441479 365956 logs.go:123] Gathering logs for etcd [5899397ea4a9] ...
I0422 18:07:30.441542 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5899397ea4a9"
I0422 18:07:30.498099 365956 logs.go:123] Gathering logs for coredns [f9d8bddf7197] ...
I0422 18:07:30.498181 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f9d8bddf7197"
I0422 18:07:30.531927 365956 logs.go:123] Gathering logs for kube-scheduler [8d4da1dcae53] ...
I0422 18:07:30.531997 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8d4da1dcae53"
I0422 18:07:30.579200 365956 logs.go:123] Gathering logs for kube-controller-manager [d0fea9e4ec1f] ...
I0422 18:07:30.579279 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d0fea9e4ec1f"
I0422 18:07:30.701639 365956 out.go:304] Setting ErrFile to fd 2...
I0422 18:07:30.701707 365956 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0422 18:07:30.701771 365956 out.go:239] X Problems detected in kubelet:
W0422 18:07:30.701816 365956 out.go:239] Apr 22 18:07:06 old-k8s-version-986384 kubelet[1196]: E0422 18:07:06.619950 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:30.701850 365956 out.go:239] Apr 22 18:07:07 old-k8s-version-986384 kubelet[1196]: E0422 18:07:07.618622 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:30.701896 365956 out.go:239] Apr 22 18:07:18 old-k8s-version-986384 kubelet[1196]: E0422 18:07:18.622590 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:30.701940 365956 out.go:239] Apr 22 18:07:18 old-k8s-version-986384 kubelet[1196]: E0422 18:07:18.645475 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:30.701975 365956 out.go:239] Apr 22 18:07:29 old-k8s-version-986384 kubelet[1196]: E0422 18:07:29.619046 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0422 18:07:30.702015 365956 out.go:304] Setting ErrFile to fd 2...
I0422 18:07:30.702037 365956 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0422 18:07:34.591743 378993 pod_ready.go:102] pod "metrics-server-569cc877fc-xsb7m" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:37.088502 378993 pod_ready.go:102] pod "metrics-server-569cc877fc-xsb7m" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:39.587820 378993 pod_ready.go:102] pod "metrics-server-569cc877fc-xsb7m" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:41.588603 378993 pod_ready.go:102] pod "metrics-server-569cc877fc-xsb7m" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:40.703400 365956 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0422 18:07:40.716516 365956 api_server.go:72] duration metric: took 5m53.082208744s to wait for apiserver process to appear ...
I0422 18:07:40.716544 365956 api_server.go:88] waiting for apiserver healthz status ...
I0422 18:07:40.716659 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0422 18:07:40.742123 365956 logs.go:276] 2 containers: [cfd818ddce4e 36734b404817]
I0422 18:07:40.742218 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0422 18:07:40.763131 365956 logs.go:276] 2 containers: [5899397ea4a9 f029b0e7c02d]
I0422 18:07:40.763221 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0422 18:07:40.779304 365956 logs.go:276] 2 containers: [27648c4ab762 f9d8bddf7197]
I0422 18:07:40.779383 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0422 18:07:40.799440 365956 logs.go:276] 2 containers: [8d4da1dcae53 4ef6e29c4a78]
I0422 18:07:40.799522 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0422 18:07:40.815299 365956 logs.go:276] 2 containers: [99181fe4786b 2670916c7c26]
I0422 18:07:40.815385 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0422 18:07:40.831521 365956 logs.go:276] 2 containers: [980fcb0f5f0b d0fea9e4ec1f]
I0422 18:07:40.831603 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0422 18:07:40.850909 365956 logs.go:276] 0 containers: []
W0422 18:07:40.850987 365956 logs.go:278] No container was found matching "kindnet"
I0422 18:07:40.851073 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0422 18:07:40.867546 365956 logs.go:276] 2 containers: [2e587f1e7363 9dca99e0f1e4]
I0422 18:07:40.867663 365956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0422 18:07:40.888163 365956 logs.go:276] 1 containers: [38455e350073]
I0422 18:07:40.888241 365956 logs.go:123] Gathering logs for kubelet ...
I0422 18:07:40.888267 365956 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0422 18:07:40.949225 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832037 1196 reflector.go:138] object-"kube-system"/"storage-provisioner-token-g68k5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-g68k5" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:40.949459 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832152 1196 reflector.go:138] object-"kube-system"/"kube-proxy-token-f585x": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-f585x" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:40.949670 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832232 1196 reflector.go:138] object-"default"/"default-token-b4l4p": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-b4l4p" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:40.949875 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832306 1196 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:40.950077 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832383 1196 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:40.950286 365956 logs.go:138] Found kubelet problem: Apr 22 18:01:59 old-k8s-version-986384 kubelet[1196]: E0422 18:01:59.832559 1196 reflector.go:138] object-"kube-system"/"coredns-token-2dv2q": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-2dv2q" is forbidden: User "system:node:old-k8s-version-986384" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-986384' and this object
W0422 18:07:40.958658 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:03 old-k8s-version-986384 kubelet[1196]: E0422 18:02:03.226868 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0422 18:07:40.959350 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:03 old-k8s-version-986384 kubelet[1196]: E0422 18:02:03.888305 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.961733 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:15 old-k8s-version-986384 kubelet[1196]: E0422 18:02:15.641552 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0422 18:07:40.966390 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:24 old-k8s-version-986384 kubelet[1196]: E0422 18:02:24.265785 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0422 18:07:40.966763 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:24 old-k8s-version-986384 kubelet[1196]: E0422 18:02:24.368306 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.966950 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:30 old-k8s-version-986384 kubelet[1196]: E0422 18:02:30.628159 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.967715 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:32 old-k8s-version-986384 kubelet[1196]: E0422 18:02:32.453214 1196 pod_workers.go:191] Error syncing pod df339435-cb7d-470a-8aec-c5eb3f389a93 ("storage-provisioner_kube-system(df339435-cb7d-470a-8aec-c5eb3f389a93)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(df339435-cb7d-470a-8aec-c5eb3f389a93)"
W0422 18:07:40.970011 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:39 old-k8s-version-986384 kubelet[1196]: E0422 18:02:39.049200 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0422 18:07:40.972390 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:43 old-k8s-version-986384 kubelet[1196]: E0422 18:02:43.646522 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0422 18:07:40.972984 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:52 old-k8s-version-986384 kubelet[1196]: E0422 18:02:52.618806 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.973171 365956 logs.go:138] Found kubelet problem: Apr 22 18:02:58 old-k8s-version-986384 kubelet[1196]: E0422 18:02:58.622275 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.975367 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:05 old-k8s-version-986384 kubelet[1196]: E0422 18:03:05.091231 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0422 18:07:40.975564 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:10 old-k8s-version-986384 kubelet[1196]: E0422 18:03:10.630961 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.975759 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:16 old-k8s-version-986384 kubelet[1196]: E0422 18:03:16.618514 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.975944 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:23 old-k8s-version-986384 kubelet[1196]: E0422 18:03:23.618416 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.976140 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:30 old-k8s-version-986384 kubelet[1196]: E0422 18:03:30.632521 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.978202 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:34 old-k8s-version-986384 kubelet[1196]: E0422 18:03:34.649485 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0422 18:07:40.978403 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:43 old-k8s-version-986384 kubelet[1196]: E0422 18:03:43.618651 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.978587 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:46 old-k8s-version-986384 kubelet[1196]: E0422 18:03:46.619360 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.980790 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:59 old-k8s-version-986384 kubelet[1196]: E0422 18:03:59.083435 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0422 18:07:40.980977 365956 logs.go:138] Found kubelet problem: Apr 22 18:03:59 old-k8s-version-986384 kubelet[1196]: E0422 18:03:59.618394 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.981160 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:12 old-k8s-version-986384 kubelet[1196]: E0422 18:04:12.618866 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.981355 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:13 old-k8s-version-986384 kubelet[1196]: E0422 18:04:13.618430 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.981537 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:23 old-k8s-version-986384 kubelet[1196]: E0422 18:04:23.618440 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.981732 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:24 old-k8s-version-986384 kubelet[1196]: E0422 18:04:24.643322 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.981914 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:38 old-k8s-version-986384 kubelet[1196]: E0422 18:04:38.629329 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.982108 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:38 old-k8s-version-986384 kubelet[1196]: E0422 18:04:38.634742 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.982305 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:49 old-k8s-version-986384 kubelet[1196]: E0422 18:04:49.618463 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.982487 365956 logs.go:138] Found kubelet problem: Apr 22 18:04:53 old-k8s-version-986384 kubelet[1196]: E0422 18:04:53.618422 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.982683 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:00 old-k8s-version-986384 kubelet[1196]: E0422 18:05:00.619147 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.984722 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:05 old-k8s-version-986384 kubelet[1196]: E0422 18:05:05.638308 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0422 18:07:40.984923 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:11 old-k8s-version-986384 kubelet[1196]: E0422 18:05:11.618472 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.985106 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:16 old-k8s-version-986384 kubelet[1196]: E0422 18:05:16.627331 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.987305 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:23 old-k8s-version-986384 kubelet[1196]: E0422 18:05:23.061150 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0422 18:07:40.987489 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:28 old-k8s-version-986384 kubelet[1196]: E0422 18:05:28.618921 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.987685 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:34 old-k8s-version-986384 kubelet[1196]: E0422 18:05:34.621754 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.987869 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:39 old-k8s-version-986384 kubelet[1196]: E0422 18:05:39.618114 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.988066 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:45 old-k8s-version-986384 kubelet[1196]: E0422 18:05:45.663272 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.988248 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:51 old-k8s-version-986384 kubelet[1196]: E0422 18:05:51.618807 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.988446 365956 logs.go:138] Found kubelet problem: Apr 22 18:05:58 old-k8s-version-986384 kubelet[1196]: E0422 18:05:58.648913 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.988650 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:04 old-k8s-version-986384 kubelet[1196]: E0422 18:06:04.618373 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.988855 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:11 old-k8s-version-986384 kubelet[1196]: E0422 18:06:11.618095 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.989041 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:15 old-k8s-version-986384 kubelet[1196]: E0422 18:06:15.618294 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.989235 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:25 old-k8s-version-986384 kubelet[1196]: E0422 18:06:25.619230 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.989420 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:30 old-k8s-version-986384 kubelet[1196]: E0422 18:06:30.618689 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.989615 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:39 old-k8s-version-986384 kubelet[1196]: E0422 18:06:39.618588 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.989797 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:43 old-k8s-version-986384 kubelet[1196]: E0422 18:06:43.618416 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.989992 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:54 old-k8s-version-986384 kubelet[1196]: E0422 18:06:54.627082 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.990175 365956 logs.go:138] Found kubelet problem: Apr 22 18:06:55 old-k8s-version-986384 kubelet[1196]: E0422 18:06:55.618270 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.990360 365956 logs.go:138] Found kubelet problem: Apr 22 18:07:06 old-k8s-version-986384 kubelet[1196]: E0422 18:07:06.619950 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.990554 365956 logs.go:138] Found kubelet problem: Apr 22 18:07:07 old-k8s-version-986384 kubelet[1196]: E0422 18:07:07.618622 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.990740 365956 logs.go:138] Found kubelet problem: Apr 22 18:07:18 old-k8s-version-986384 kubelet[1196]: E0422 18:07:18.622590 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.990936 365956 logs.go:138] Found kubelet problem: Apr 22 18:07:18 old-k8s-version-986384 kubelet[1196]: E0422 18:07:18.645475 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.991121 365956 logs.go:138] Found kubelet problem: Apr 22 18:07:29 old-k8s-version-986384 kubelet[1196]: E0422 18:07:29.619046 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:40.991317 365956 logs.go:138] Found kubelet problem: Apr 22 18:07:33 old-k8s-version-986384 kubelet[1196]: E0422 18:07:33.618306 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
I0422 18:07:40.991327 365956 logs.go:123] Gathering logs for etcd [f029b0e7c02d] ...
I0422 18:07:40.991341 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f029b0e7c02d"
I0422 18:07:41.018437 365956 logs.go:123] Gathering logs for kube-scheduler [8d4da1dcae53] ...
I0422 18:07:41.018468 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8d4da1dcae53"
I0422 18:07:41.057870 365956 logs.go:123] Gathering logs for kube-scheduler [4ef6e29c4a78] ...
I0422 18:07:41.057901 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4ef6e29c4a78"
I0422 18:07:41.085317 365956 logs.go:123] Gathering logs for kube-controller-manager [980fcb0f5f0b] ...
I0422 18:07:41.085388 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 980fcb0f5f0b"
I0422 18:07:41.132811 365956 logs.go:123] Gathering logs for storage-provisioner [2e587f1e7363] ...
I0422 18:07:41.132846 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2e587f1e7363"
I0422 18:07:41.168635 365956 logs.go:123] Gathering logs for dmesg ...
I0422 18:07:41.168664 365956 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0422 18:07:41.188491 365956 logs.go:123] Gathering logs for etcd [5899397ea4a9] ...
I0422 18:07:41.188519 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5899397ea4a9"
I0422 18:07:41.211325 365956 logs.go:123] Gathering logs for coredns [27648c4ab762] ...
I0422 18:07:41.211352 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 27648c4ab762"
I0422 18:07:41.232027 365956 logs.go:123] Gathering logs for kube-controller-manager [d0fea9e4ec1f] ...
I0422 18:07:41.232062 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d0fea9e4ec1f"
I0422 18:07:41.293576 365956 logs.go:123] Gathering logs for container status ...
I0422 18:07:41.293611 365956 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0422 18:07:41.343832 365956 logs.go:123] Gathering logs for kubernetes-dashboard [38455e350073] ...
I0422 18:07:41.343859 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38455e350073"
I0422 18:07:41.368134 365956 logs.go:123] Gathering logs for Docker ...
I0422 18:07:41.368170 365956 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0422 18:07:41.402656 365956 logs.go:123] Gathering logs for describe nodes ...
I0422 18:07:41.402691 365956 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0422 18:07:41.574728 365956 logs.go:123] Gathering logs for kube-apiserver [cfd818ddce4e] ...
I0422 18:07:41.574762 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 cfd818ddce4e"
I0422 18:07:41.620507 365956 logs.go:123] Gathering logs for kube-apiserver [36734b404817] ...
I0422 18:07:41.620545 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 36734b404817"
I0422 18:07:41.711172 365956 logs.go:123] Gathering logs for coredns [f9d8bddf7197] ...
I0422 18:07:41.711209 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f9d8bddf7197"
I0422 18:07:41.735067 365956 logs.go:123] Gathering logs for kube-proxy [99181fe4786b] ...
I0422 18:07:41.735100 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 99181fe4786b"
I0422 18:07:41.757564 365956 logs.go:123] Gathering logs for kube-proxy [2670916c7c26] ...
I0422 18:07:41.757590 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2670916c7c26"
I0422 18:07:41.780898 365956 logs.go:123] Gathering logs for storage-provisioner [9dca99e0f1e4] ...
I0422 18:07:41.780926 365956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9dca99e0f1e4"
I0422 18:07:41.803638 365956 out.go:304] Setting ErrFile to fd 2...
I0422 18:07:41.803662 365956 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0422 18:07:41.803703 365956 out.go:239] X Problems detected in kubelet:
W0422 18:07:41.803717 365956 out.go:239] Apr 22 18:07:07 old-k8s-version-986384 kubelet[1196]: E0422 18:07:07.618622 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:41.803726 365956 out.go:239] Apr 22 18:07:18 old-k8s-version-986384 kubelet[1196]: E0422 18:07:18.622590 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:41.803738 365956 out.go:239] Apr 22 18:07:18 old-k8s-version-986384 kubelet[1196]: E0422 18:07:18.645475 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0422 18:07:41.803745 365956 out.go:239] Apr 22 18:07:29 old-k8s-version-986384 kubelet[1196]: E0422 18:07:29.619046 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0422 18:07:41.803752 365956 out.go:239] Apr 22 18:07:33 old-k8s-version-986384 kubelet[1196]: E0422 18:07:33.618306 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
I0422 18:07:41.803765 365956 out.go:304] Setting ErrFile to fd 2...
I0422 18:07:41.803770 365956 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0422 18:07:44.088928 378993 pod_ready.go:102] pod "metrics-server-569cc877fc-xsb7m" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:46.093003 378993 pod_ready.go:102] pod "metrics-server-569cc877fc-xsb7m" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:48.587921 378993 pod_ready.go:102] pod "metrics-server-569cc877fc-xsb7m" in "kube-system" namespace has status "Ready":"False"
I0422 18:07:51.804813 365956 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0422 18:07:51.817041 365956 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0422 18:07:51.819583 365956 out.go:177]
W0422 18:07:51.821795 365956 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0422 18:07:51.821832 365956 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0422 18:07:51.821850 365956 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0422 18:07:51.821855 365956 out.go:239] *
W0422 18:07:51.822809 365956 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0422 18:07:51.826094 365956 out.go:177]
==> Docker <==
Apr 22 18:07:29 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:29 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:29 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:29 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:29 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:29 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:29 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:29 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:29 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:29 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:30 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:30 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:30 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:30 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:30 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:30 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:30 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:30 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:30 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:30 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:41 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:41 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:41 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:41 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:41 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:41 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:41 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:41 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:41 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:41 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:41 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:41 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:41 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:41 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:41 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:41 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:41 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:41 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:41 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:41 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:41 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:41 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:41 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:41 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:41 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:41 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:41 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:41 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Apr 22 18:07:41 old-k8s-version-986384 dockerd[966]: 2024/04/22 18:07:41 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
2e587f1e73637 ba04bb24b9575 5 minutes ago Running storage-provisioner 2 4a61d20b8f47f storage-provisioner
38455e3500735 kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93 5 minutes ago Running kubernetes-dashboard 0 f017189416d4a kubernetes-dashboard-cd95d586-sl4t5
99181fe4786bb 25a5233254979 5 minutes ago Running kube-proxy 1 cef1139b31c12 kube-proxy-cpcrp
7282eebd499e5 1611cd07b61d5 5 minutes ago Running busybox 1 f98c8fb92d737 busybox
27648c4ab762d db91994f4ee8f 5 minutes ago Running coredns 1 506a05b99bb39 coredns-74ff55c5b-6dgwt
9dca99e0f1e4b ba04bb24b9575 5 minutes ago Exited storage-provisioner 1 4a61d20b8f47f storage-provisioner
5899397ea4a9c 05b738aa1bc63 6 minutes ago Running etcd 1 32e7599a43927 etcd-old-k8s-version-986384
8d4da1dcae530 e7605f88f17d6 6 minutes ago Running kube-scheduler 1 b200495b71d09 kube-scheduler-old-k8s-version-986384
980fcb0f5f0ba 1df8a2b116bd1 6 minutes ago Running kube-controller-manager 1 8ba5024eaae36 kube-controller-manager-old-k8s-version-986384
cfd818ddce4e8 2c08bbbc02d3a 6 minutes ago Running kube-apiserver 1 f4e927da32198 kube-apiserver-old-k8s-version-986384
4776515699c91 gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e 6 minutes ago Exited busybox 0 33d9be7ba4c66 busybox
f9d8bddf71973 db91994f4ee8f 8 minutes ago Exited coredns 0 ebda59e8275f6 coredns-74ff55c5b-6dgwt
2670916c7c265 25a5233254979 8 minutes ago Exited kube-proxy 0 2d83c57178e8d kube-proxy-cpcrp
36734b4048172 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 da8265715a13c kube-apiserver-old-k8s-version-986384
f029b0e7c02d4 05b738aa1bc63 8 minutes ago Exited etcd 0 ce13eb091d198 etcd-old-k8s-version-986384
4ef6e29c4a78d e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 e7a9572189dcb kube-scheduler-old-k8s-version-986384
d0fea9e4ec1fa 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 2547de5a84b53 kube-controller-manager-old-k8s-version-986384
==> coredns [27648c4ab762] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:41020 - 41349 "HINFO IN 3701406051455781997.1799737944259204741. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.03139093s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I0422 18:02:32.558855 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-04-22 18:02:02.558104642 +0000 UTC m=+0.026675373) (total time: 30.000645606s):
Trace[2019727887]: [30.000645606s] [30.000645606s] END
E0422 18:02:32.558890 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0422 18:02:32.560374 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-04-22 18:02:02.559499996 +0000 UTC m=+0.028070777) (total time: 30.000849046s):
Trace[939984059]: [30.000849046s] [30.000849046s] END
E0422 18:02:32.560391 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0422 18:02:32.560571 1 trace.go:116] Trace[1474941318]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-04-22 18:02:02.560312411 +0000 UTC m=+0.028883133) (total time: 30.00024639s):
Trace[1474941318]: [30.00024639s] [30.00024639s] END
E0422 18:02:32.560585 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> coredns [f9d8bddf7197] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] Reloading
[INFO] plugin/health: Going into lameduck mode for 5s
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
[INFO] Reloading complete
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
E0422 18:01:28.262016 1 reflector.go:382] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to watch *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?allowWatchBookmarks=true&resourceVersion=199&timeout=9m4s&timeoutSeconds=544&watch=true": dial tcp 10.96.0.1:443: connect: connection refused
E0422 18:01:28.262317 1 reflector.go:382] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to watch *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?allowWatchBookmarks=true&resourceVersion=593&timeout=6m4s&timeoutSeconds=364&watch=true": dial tcp 10.96.0.1:443: connect: connection refused
E0422 18:01:28.262478 1 reflector.go:382] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to watch *v1.Service: Get "https://10.96.0.1:443/api/v1/services?allowWatchBookmarks=true&resourceVersion=591&timeout=6m54s&timeoutSeconds=414&watch=true": dial tcp 10.96.0.1:443: connect: connection refused
==> describe nodes <==
Name: old-k8s-version-986384
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-986384
kubernetes.io/os=linux
minikube.k8s.io/commit=066f6aefcc83a135104448c0f8191604ce1e099a
minikube.k8s.io/name=old-k8s-version-986384
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_04_22T17_59_22_0700
minikube.k8s.io/version=v1.33.0
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 22 Apr 2024 17:59:18 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-986384
AcquireTime: <unset>
RenewTime: Mon, 22 Apr 2024 18:07:53 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 22 Apr 2024 18:02:50 +0000 Mon, 22 Apr 2024 17:59:09 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 22 Apr 2024 18:02:50 +0000 Mon, 22 Apr 2024 17:59:09 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 22 Apr 2024 18:02:50 +0000 Mon, 22 Apr 2024 17:59:09 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 22 Apr 2024 18:02:50 +0000 Mon, 22 Apr 2024 17:59:36 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-986384
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022560Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022560Ki
pods: 110
System Info:
Machine ID: 4609a78f857440d5b58d5c23f259c275
System UUID: 309ee2d7-eff4-47c6-861b-329dfa90d712
Boot ID: 10a06b61-013b-4e8e-82bb-900d7f84a0de
Kernel Version: 5.15.0-1058-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: docker://26.0.2
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m37s
kube-system coredns-74ff55c5b-6dgwt 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m17s
kube-system etcd-old-k8s-version-986384 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m26s
kube-system kube-apiserver-old-k8s-version-986384 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m26s
kube-system kube-controller-manager-old-k8s-version-986384 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m26s
kube-system kube-proxy-cpcrp 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m17s
kube-system kube-scheduler-old-k8s-version-986384 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m26s
kube-system metrics-server-9975d5f86-ts7pq 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m25s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m14s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-mf7fs 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m36s
kubernetes-dashboard kubernetes-dashboard-cd95d586-sl4t5 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m36s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (42%!)(MISSING) 0 (0%!)(MISSING)
memory 370Mi (4%!)(MISSING) 170Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m47s (x6 over 8m47s) kubelet Node old-k8s-version-986384 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m47s (x7 over 8m47s) kubelet Node old-k8s-version-986384 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m47s (x6 over 8m47s) kubelet Node old-k8s-version-986384 status is now: NodeHasSufficientPID
Normal Starting 8m27s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m27s kubelet Node old-k8s-version-986384 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m27s kubelet Node old-k8s-version-986384 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m27s kubelet Node old-k8s-version-986384 status is now: NodeHasSufficientPID
Normal NodeNotReady 8m27s kubelet Node old-k8s-version-986384 status is now: NodeNotReady
Normal NodeAllocatableEnforced 8m27s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m17s kubelet Node old-k8s-version-986384 status is now: NodeReady
Normal Starting 8m14s kube-proxy Starting kube-proxy.
Normal Starting 6m3s kubelet Starting kubelet.
Normal NodeAllocatableEnforced 6m3s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 6m2s (x8 over 6m3s) kubelet Node old-k8s-version-986384 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m2s (x8 over 6m3s) kubelet Node old-k8s-version-986384 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m2s (x7 over 6m3s) kubelet Node old-k8s-version-986384 status is now: NodeHasSufficientPID
Normal Starting 5m50s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.001012] FS-Cache: N-cookie d=000000005ffb80a3{9p.inode} n=000000001cc2a9cb
[ +0.001138] FS-Cache: N-key=[8] '856ced0000000000'
[ +0.016545] FS-Cache: Duplicate cookie detected
[ +0.000757] FS-Cache: O-cookie c=00000006 [p=00000003 fl=226 nc=0 na=1]
[ +0.001063] FS-Cache: O-cookie d=000000005ffb80a3{9p.inode} n=00000000f248b3ab
[ +0.001115] FS-Cache: O-key=[8] '856ced0000000000'
[ +0.000801] FS-Cache: N-cookie c=0000000d [p=00000003 fl=2 nc=0 na=1]
[ +0.001025] FS-Cache: N-cookie d=000000005ffb80a3{9p.inode} n=0000000098a3ba1c
[ +0.001125] FS-Cache: N-key=[8] '856ced0000000000'
[ +3.054302] FS-Cache: Duplicate cookie detected
[ +0.000736] FS-Cache: O-cookie c=00000004 [p=00000003 fl=226 nc=0 na=1]
[ +0.001119] FS-Cache: O-cookie d=000000005ffb80a3{9p.inode} n=0000000083092e75
[ +0.001142] FS-Cache: O-key=[8] '846ced0000000000'
[ +0.000805] FS-Cache: N-cookie c=0000000f [p=00000003 fl=2 nc=0 na=1]
[ +0.000995] FS-Cache: N-cookie d=000000005ffb80a3{9p.inode} n=000000008c5ba4fb
[ +0.001203] FS-Cache: N-key=[8] '846ced0000000000'
[ +0.358279] FS-Cache: Duplicate cookie detected
[ +0.000759] FS-Cache: O-cookie c=00000009 [p=00000003 fl=226 nc=0 na=1]
[ +0.001050] FS-Cache: O-cookie d=000000005ffb80a3{9p.inode} n=000000006e167a51
[ +0.001140] FS-Cache: O-key=[8] '8e6ced0000000000'
[ +0.000779] FS-Cache: N-cookie c=00000010 [p=00000003 fl=2 nc=0 na=1]
[ +0.000976] FS-Cache: N-cookie d=000000005ffb80a3{9p.inode} n=00000000c933bfc4
[ +0.001079] FS-Cache: N-key=[8] '8e6ced0000000000'
[Apr22 17:45] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
[Apr22 17:56] hrtimer: interrupt took 38491516 ns
==> etcd [5899397ea4a9] <==
2024-04-22 18:03:50.533035 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:04:00.542047 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:04:10.532489 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:04:20.532522 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:04:30.532624 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:04:40.532569 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:04:50.532549 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:05:00.532602 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:05:10.532662 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:05:20.532669 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:05:30.532896 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:05:40.534211 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:05:50.532641 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:06:00.532989 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:06:10.533313 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:06:20.532527 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:06:30.532554 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:06:40.532531 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:06:50.532592 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:07:00.533129 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:07:10.532523 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:07:20.532839 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:07:30.533054 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:07:40.532822 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:07:50.532764 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [f029b0e7c02d] <==
raft2024/04/22 17:59:07 INFO: raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2
2024-04-22 17:59:07.961061 I | etcdserver: setting up the initial cluster version to 3.4
2024-04-22 17:59:07.961838 N | etcdserver/membership: set the initial cluster version to 3.4
2024-04-22 17:59:07.962009 I | etcdserver/api: enabled capabilities for version 3.4
2024-04-22 17:59:07.962306 I | etcdserver: published {Name:old-k8s-version-986384 ClientURLs:[https://192.168.76.2:2379]} to cluster 6f20f2c4b2fb5f8a
2024-04-22 17:59:07.962393 I | embed: ready to serve client requests
2024-04-22 17:59:07.966956 I | embed: serving client requests on 127.0.0.1:2379
2024-04-22 17:59:07.967246 I | embed: ready to serve client requests
2024-04-22 17:59:07.970692 I | embed: serving client requests on 192.168.76.2:2379
2024-04-22 17:59:18.905225 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 17:59:22.156511 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 17:59:35.691132 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 17:59:39.096111 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 17:59:49.095369 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 17:59:59.095425 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:00:09.095437 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:00:19.095433 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:00:29.095345 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:00:39.095423 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:00:49.095219 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:00:59.095390 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:01:09.095440 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:01:19.095259 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-22 18:01:28.180306 N | pkg/osutil: received terminated signal, shutting down...
2024-04-22 18:01:28.200950 I | etcdserver: skipped leadership transfer for single voting member cluster
==> kernel <==
18:07:53 up 1:50, 0 users, load average: 3.24, 3.10, 3.51
Linux old-k8s-version-986384 5.15.0-1058-aws #64~20.04.1-Ubuntu SMP Tue Apr 9 11:11:55 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kube-apiserver [36734b404817] <==
W0422 18:01:37.680089 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:37.685199 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:37.693166 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:37.718386 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:37.731440 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:37.735623 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:37.748150 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:37.765075 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:37.781787 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:37.825804 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:37.828836 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:37.860827 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:37.877336 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:37.878380 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:37.887355 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:37.908290 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:37.962107 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:37.970613 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:38.017939 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:38.051761 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:38.129355 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:38.162104 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:38.229383 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:38.248579 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0422 18:01:38.279742 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
==> kube-apiserver [cfd818ddce4e] <==
I0422 18:04:28.640002 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0422 18:04:28.640012 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0422 18:05:02.590883 1 handler_proxy.go:102] no RequestInfo found in the context
E0422 18:05:02.591007 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0422 18:05:02.591021 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0422 18:05:13.237840 1 client.go:360] parsed scheme: "passthrough"
I0422 18:05:13.237884 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0422 18:05:13.237893 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 18:05:50.773633 1 client.go:360] parsed scheme: "passthrough"
I0422 18:05:50.773681 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0422 18:05:50.773690 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 18:06:23.426710 1 client.go:360] parsed scheme: "passthrough"
I0422 18:06:23.426757 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0422 18:06:23.426766 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0422 18:07:00.881672 1 handler_proxy.go:102] no RequestInfo found in the context
E0422 18:07:00.881751 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0422 18:07:00.881760 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0422 18:07:02.658548 1 client.go:360] parsed scheme: "passthrough"
I0422 18:07:02.658606 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0422 18:07:02.658615 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 18:07:45.528366 1 client.go:360] parsed scheme: "passthrough"
I0422 18:07:45.528415 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0422 18:07:45.528425 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [980fcb0f5f0b] <==
W0422 18:03:23.020021 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0422 18:03:49.546387 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0422 18:03:54.670494 1 request.go:655] Throttling request took 1.043958283s, request: GET:https://192.168.76.2:8443/apis/authorization.k8s.io/v1?timeout=32s
W0422 18:03:55.522173 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0422 18:04:20.049151 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0422 18:04:27.172708 1 request.go:655] Throttling request took 1.048058546s, request: GET:https://192.168.76.2:8443/apis/storage.k8s.io/v1beta1?timeout=32s
W0422 18:04:28.025268 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0422 18:04:50.550909 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0422 18:04:59.675810 1 request.go:655] Throttling request took 1.048558518s, request: GET:https://192.168.76.2:8443/apis/authorization.k8s.io/v1?timeout=32s
W0422 18:05:00.527466 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0422 18:05:21.052877 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0422 18:05:32.178046 1 request.go:655] Throttling request took 1.048255986s, request: GET:https://192.168.76.2:8443/apis/authorization.k8s.io/v1beta1?timeout=32s
W0422 18:05:33.031295 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0422 18:05:51.554847 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0422 18:06:04.686975 1 request.go:655] Throttling request took 1.048155545s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
W0422 18:06:05.538712 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0422 18:06:22.056707 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0422 18:06:37.189047 1 request.go:655] Throttling request took 1.048339994s, request: GET:https://192.168.76.2:8443/apis/policy/v1beta1?timeout=32s
W0422 18:06:38.042215 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0422 18:06:52.559506 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0422 18:07:09.693014 1 request.go:655] Throttling request took 1.048161991s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0422 18:07:10.544622 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0422 18:07:23.061360 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0422 18:07:42.195266 1 request.go:655] Throttling request took 1.048366033s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0422 18:07:43.049658 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-controller-manager [d0fea9e4ec1f] <==
I0422 17:59:36.682482 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-lbrj7"
I0422 17:59:36.682630 1 shared_informer.go:247] Caches are synced for service account
I0422 17:59:36.715766 1 shared_informer.go:247] Caches are synced for resource quota
I0422 17:59:36.721635 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-6dgwt"
I0422 17:59:36.732859 1 shared_informer.go:247] Caches are synced for namespace
I0422 17:59:36.741411 1 event.go:291] "Event occurred" object="kube-system/kube-apiserver-old-k8s-version-986384" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0422 17:59:36.770746 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0422 17:59:37.073097 1 shared_informer.go:247] Caches are synced for garbage collector
I0422 17:59:37.107605 1 shared_informer.go:247] Caches are synced for garbage collector
I0422 17:59:37.107627 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0422 17:59:39.624186 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0422 17:59:39.645162 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-lbrj7"
I0422 17:59:41.775250 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b-6dgwt" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod kube-system/coredns-74ff55c5b-6dgwt"
I0422 17:59:41.775345 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b-lbrj7" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod kube-system/coredns-74ff55c5b-lbrj7"
I0422 17:59:41.775364 1 event.go:291] "Event occurred" object="kube-system/storage-provisioner" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod kube-system/storage-provisioner"
I0422 17:59:41.775706 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I0422 18:01:27.087676 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
I0422 18:01:28.205314 1 event.go:291] "Event occurred" object="kube-system/metrics-server-9975d5f86" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: metrics-server-9975d5f86-ts7pq"
E0422 18:01:28.265401 1 replica_set.go:532] sync "kube-system/metrics-server-9975d5f86" failed with Get "https://192.168.76.2:8443/apis/apps/v1/namespaces/kube-system/replicasets/metrics-server-9975d5f86": dial tcp 192.168.76.2:8443: connect: connection refused
E0422 18:01:28.265914 1 replica_set.go:532] sync "kube-system/metrics-server-9975d5f86" failed with Get "https://192.168.76.2:8443/apis/apps/v1/namespaces/kube-system/replicasets/metrics-server-9975d5f86": dial tcp 192.168.76.2:8443: connect: connection refused
E0422 18:01:28.266364 1 event.go:273] Unable to write event: '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"metrics-server-9975d5f86.17c8ac1a8a56b2ad", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"metrics-server-9975d5f86", UID:"131d4dfc-3b80-4f0d-b3a5-754fe7eef31e", APIVersion:"apps/v1", ResourceVersion:"574", FieldPath:""}, Reason:"SuccessfulCreate", Message:"Created pod: metrics-server-9975d5f86-ts7pq", Source:v1.EventSource{Component:"replicaset-controller", Host:
""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc181c75e0c3102ad, ext:140830105453, loc:(*time.Location)(0x632eb80)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc181c75e0c3102ad, ext:140830105453, loc:(*time.Location)(0x632eb80)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'Post "https://192.168.76.2:8443/api/v1/namespaces/kube-system/events": unexpected EOF'(may retry after sleeping)
W0422 18:01:28.266568 1 endpointslice_controller.go:284] Error syncing endpoint slices for service "kube-system/metrics-server", retrying. Error: failed to update metrics-server-z7bb5 EndpointSlice for Service kube-system/metrics-server: Put "https://192.168.76.2:8443/apis/discovery.k8s.io/v1beta1/namespaces/kube-system/endpointslices/metrics-server-z7bb5": unexpected EOF
I0422 18:01:28.266774 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Service" apiVersion="v1" type="Warning" reason="FailedToUpdateEndpointSlices" message="Error updating Endpoint Slices for Service kube-system/metrics-server: failed to update metrics-server-z7bb5 EndpointSlice for Service kube-system/metrics-server: Put \"https://192.168.76.2:8443/apis/discovery.k8s.io/v1beta1/namespaces/kube-system/endpointslices/metrics-server-z7bb5\": unexpected EOF"
E0422 18:01:28.266815 1 event.go:273] Unable to write event: '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"metrics-server.17c8ac1a8e0911c3", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Service", Namespace:"kube-system", Name:"metrics-server", UID:"01cdb85f-6d05-49a0-80ed-9804962c6e38", APIVersion:"v1", ResourceVersion:"591", FieldPath:""}, Reason:"FailedToUpdateEndpointSlices", Message:"Error updating Endpoint Slices for Service kube-system/metrics-server: failed to update metrics-server-z7bb5 EndpointSlice f
or Service kube-system/metrics-server: Put \"https://192.168.76.2:8443/apis/discovery.k8s.io/v1beta1/namespaces/kube-system/endpointslices/metrics-server-z7bb5\": unexpected EOF", Source:v1.EventSource{Component:"endpoint-slice-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc181c75e0fe361c3, ext:140892126860, loc:(*time.Location)(0x632eb80)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc181c75e0fe361c3, ext:140892126860, loc:(*time.Location)(0x632eb80)}}, Count:1, Type:"Warning", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'Post "https://192.168.76.2:8443/api/v1/namespaces/kube-system/events": dial tcp 192.168.76.2:8443: connect: connection refused'(may retry after sleeping)
E0422 18:01:28.271274 1 replica_set.go:532] sync "kube-system/metrics-server-9975d5f86" failed with Get "https://192.168.76.2:8443/apis/apps/v1/namespaces/kube-system/replicasets/metrics-server-9975d5f86": dial tcp 192.168.76.2:8443: connect: connection refused
==> kube-proxy [2670916c7c26] <==
I0422 17:59:38.862752 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0422 17:59:38.865038 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0422 17:59:39.114815 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0422 17:59:39.114910 1 server_others.go:185] Using iptables Proxier.
I0422 17:59:39.115145 1 server.go:650] Version: v1.20.0
I0422 17:59:39.116118 1 config.go:315] Starting service config controller
I0422 17:59:39.116128 1 shared_informer.go:240] Waiting for caches to sync for service config
I0422 17:59:39.116163 1 config.go:224] Starting endpoint slice config controller
I0422 17:59:39.116183 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0422 17:59:39.216255 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0422 17:59:39.216339 1 shared_informer.go:247] Caches are synced for service config
==> kube-proxy [99181fe4786b] <==
I0422 18:02:03.962985 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0422 18:02:03.963077 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0422 18:02:03.982859 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0422 18:02:03.983130 1 server_others.go:185] Using iptables Proxier.
I0422 18:02:03.983580 1 server.go:650] Version: v1.20.0
I0422 18:02:03.984906 1 config.go:315] Starting service config controller
I0422 18:02:03.985405 1 shared_informer.go:240] Waiting for caches to sync for service config
I0422 18:02:03.985442 1 config.go:224] Starting endpoint slice config controller
I0422 18:02:03.985448 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0422 18:02:04.085536 1 shared_informer.go:247] Caches are synced for service config
I0422 18:02:04.086947 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-scheduler [4ef6e29c4a78] <==
I0422 17:59:18.026445 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0422 17:59:18.027039 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0422 17:59:18.027062 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0422 17:59:18.052890 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0422 17:59:18.053598 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0422 17:59:18.053867 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0422 17:59:18.057966 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0422 17:59:18.061253 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0422 17:59:18.073032 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0422 17:59:18.073145 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0422 17:59:18.073243 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0422 17:59:18.073501 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0422 17:59:18.073568 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0422 17:59:18.073653 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0422 17:59:18.073736 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0422 17:59:18.078193 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0422 17:59:18.928197 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0422 17:59:18.954183 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0422 17:59:18.955689 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0422 17:59:18.979673 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0422 17:59:18.979988 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0422 17:59:19.077173 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0422 17:59:19.183261 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0422 17:59:19.207727 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
I0422 17:59:21.727129 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [8d4da1dcae53] <==
I0422 18:01:55.563396 1 serving.go:331] Generated self-signed cert in-memory
W0422 18:01:59.666880 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0422 18:01:59.666915 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0422 18:01:59.666925 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0422 18:01:59.666932 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0422 18:01:59.915777 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0422 18:01:59.930167 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0422 18:01:59.930195 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0422 18:01:59.930635 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0422 18:02:00.021408 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0422 18:02:00.021523 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0422 18:02:00.021620 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0422 18:02:00.021685 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0422 18:02:00.021749 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0422 18:02:00.021812 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0422 18:02:00.021878 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0422 18:02:00.021940 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0422 18:02:00.022002 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0422 18:02:00.022064 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0422 18:02:00.022124 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0422 18:02:00.033146 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
I0422 18:02:01.033559 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Apr 22 18:05:23 old-k8s-version-986384 kubelet[1196]: E0422 18:05:23.061117 1196 kuberuntime_manager.go:829] container &Container{Name:dashboard-metrics-scraper,Image:registry.k8s.io/echoserver:1.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:,HostPort:0,ContainerPort:8000,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-volume,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:kubernetes-dashboard-token-chrvr,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/,Port:{0 8000 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:30,TimeoutSeconds:30,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:nil,Lifecycle:nil,Terminatio
nMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1001,RunAsNonRoot:nil,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:*false,RunAsGroup:*2001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844): ErrImagePull: rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/
Apr 22 18:05:23 old-k8s-version-986384 kubelet[1196]: E0422 18:05:23.061150 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
Apr 22 18:05:28 old-k8s-version-986384 kubelet[1196]: E0422 18:05:28.618921 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 22 18:05:34 old-k8s-version-986384 kubelet[1196]: E0422 18:05:34.621754 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Apr 22 18:05:39 old-k8s-version-986384 kubelet[1196]: E0422 18:05:39.618114 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 22 18:05:45 old-k8s-version-986384 kubelet[1196]: E0422 18:05:45.663272 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Apr 22 18:05:51 old-k8s-version-986384 kubelet[1196]: E0422 18:05:51.618807 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 22 18:05:58 old-k8s-version-986384 kubelet[1196]: E0422 18:05:58.648913 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Apr 22 18:06:04 old-k8s-version-986384 kubelet[1196]: E0422 18:06:04.618373 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 22 18:06:11 old-k8s-version-986384 kubelet[1196]: E0422 18:06:11.618095 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Apr 22 18:06:15 old-k8s-version-986384 kubelet[1196]: E0422 18:06:15.618294 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 22 18:06:25 old-k8s-version-986384 kubelet[1196]: E0422 18:06:25.619230 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Apr 22 18:06:30 old-k8s-version-986384 kubelet[1196]: E0422 18:06:30.618689 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 22 18:06:39 old-k8s-version-986384 kubelet[1196]: E0422 18:06:39.618588 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Apr 22 18:06:43 old-k8s-version-986384 kubelet[1196]: E0422 18:06:43.618416 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 22 18:06:54 old-k8s-version-986384 kubelet[1196]: E0422 18:06:54.627082 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Apr 22 18:06:55 old-k8s-version-986384 kubelet[1196]: E0422 18:06:55.618270 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 22 18:07:06 old-k8s-version-986384 kubelet[1196]: E0422 18:07:06.619950 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 22 18:07:07 old-k8s-version-986384 kubelet[1196]: E0422 18:07:07.618622 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Apr 22 18:07:18 old-k8s-version-986384 kubelet[1196]: E0422 18:07:18.622590 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 22 18:07:18 old-k8s-version-986384 kubelet[1196]: E0422 18:07:18.645475 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Apr 22 18:07:29 old-k8s-version-986384 kubelet[1196]: E0422 18:07:29.619046 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 22 18:07:33 old-k8s-version-986384 kubelet[1196]: E0422 18:07:33.618306 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Apr 22 18:07:44 old-k8s-version-986384 kubelet[1196]: E0422 18:07:44.618324 1196 pod_workers.go:191] Error syncing pod 4faf1d5a-cd2f-4a05-b4f4-a985559dd072 ("metrics-server-9975d5f86-ts7pq_kube-system(4faf1d5a-cd2f-4a05-b4f4-a985559dd072)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 22 18:07:46 old-k8s-version-986384 kubelet[1196]: E0422 18:07:46.618691 1196 pod_workers.go:191] Error syncing pod e523bdd8-d720-4b25-957f-a4eb6c91e844 ("dashboard-metrics-scraper-8d5bb5db8-mf7fs_kubernetes-dashboard(e523bdd8-d720-4b25-957f-a4eb6c91e844)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
==> kubernetes-dashboard [38455e350073] <==
2024/04/22 18:02:24 Using namespace: kubernetes-dashboard
2024/04/22 18:02:24 Using in-cluster config to connect to apiserver
2024/04/22 18:02:24 Using secret token for csrf signing
2024/04/22 18:02:24 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/04/22 18:02:24 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/04/22 18:02:24 Successful initial request to the apiserver, version: v1.20.0
2024/04/22 18:02:24 Generating JWE encryption key
2024/04/22 18:02:24 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/04/22 18:02:24 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/04/22 18:02:24 Initializing JWE encryption key from synchronized object
2024/04/22 18:02:24 Creating in-cluster Sidecar client
2024/04/22 18:02:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/22 18:02:24 Serving insecurely on HTTP port: 9090
2024/04/22 18:02:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/22 18:03:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/22 18:03:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/22 18:04:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/22 18:04:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/22 18:05:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/22 18:05:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/22 18:06:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/22 18:06:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/22 18:07:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/22 18:02:24 Starting overwatch
==> storage-provisioner [2e587f1e7363] <==
I0422 18:02:44.764888 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0422 18:02:44.797121 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0422 18:02:44.797579 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0422 18:03:02.261277 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0422 18:03:02.261737 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-986384_b443db82-0015-4a43-8f89-191541cb9af0!
I0422 18:03:02.261506 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"107cbe39-141d-47fa-8a62-83794bdd28e6", APIVersion:"v1", ResourceVersion:"822", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-986384_b443db82-0015-4a43-8f89-191541cb9af0 became leader
I0422 18:03:02.362337 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-986384_b443db82-0015-4a43-8f89-191541cb9af0!
==> storage-provisioner [9dca99e0f1e4] <==
I0422 18:02:02.110504 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0422 18:02:32.118934 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-986384 -n old-k8s-version-986384
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-986384 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-ts7pq dashboard-metrics-scraper-8d5bb5db8-mf7fs
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-986384 describe pod metrics-server-9975d5f86-ts7pq dashboard-metrics-scraper-8d5bb5db8-mf7fs
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-986384 describe pod metrics-server-9975d5f86-ts7pq dashboard-metrics-scraper-8d5bb5db8-mf7fs: exit status 1 (82.380471ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-ts7pq" not found
Error from server (NotFound): pods "dashboard-metrics-scraper-8d5bb5db8-mf7fs" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-986384 describe pod metrics-server-9975d5f86-ts7pq dashboard-metrics-scraper-8d5bb5db8-mf7fs: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (375.34s)