=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-577369 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=docker --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-577369 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=docker --kubernetes-version=v1.20.0: exit status 102 (6m13.503137527s)
-- stdout --
* [old-k8s-version-577369] minikube v1.33.1 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=19106
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19106-2452/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19106-2452/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.30.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.2
* Using the docker driver based on existing profile
* Starting "old-k8s-version-577369" primary control-plane node in "old-k8s-version-577369" cluster
* Pulling base image v0.0.44-1718753665-19106 ...
* Restarting existing docker container for "old-k8s-version-577369" ...
* Preparing Kubernetes v1.20.0 on Docker 26.1.4 ...
* Verifying Kubernetes components...
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-577369 addons enable metrics-server
* Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
-- /stdout --
** stderr **
I0620 18:05:02.043164 362254 out.go:291] Setting OutFile to fd 1 ...
I0620 18:05:02.043404 362254 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0620 18:05:02.043432 362254 out.go:304] Setting ErrFile to fd 2...
I0620 18:05:02.043452 362254 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0620 18:05:02.043757 362254 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19106-2452/.minikube/bin
I0620 18:05:02.044225 362254 out.go:298] Setting JSON to false
I0620 18:05:02.045498 362254 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":6453,"bootTime":1718900249,"procs":237,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1063-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
I0620 18:05:02.045601 362254 start.go:139] virtualization:
I0620 18:05:02.048847 362254 out.go:177] * [old-k8s-version-577369] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0620 18:05:02.051940 362254 out.go:177] - MINIKUBE_LOCATION=19106
I0620 18:05:02.051976 362254 notify.go:220] Checking for updates...
I0620 18:05:02.056489 362254 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0620 18:05:02.059194 362254 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19106-2452/kubeconfig
I0620 18:05:02.061643 362254 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19106-2452/.minikube
I0620 18:05:02.063799 362254 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0620 18:05:02.065839 362254 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0620 18:05:02.068821 362254 config.go:182] Loaded profile config "old-k8s-version-577369": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0
I0620 18:05:02.073736 362254 out.go:177] * Kubernetes 1.30.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.2
I0620 18:05:02.075963 362254 driver.go:392] Setting default libvirt URI to qemu:///system
I0620 18:05:02.099277 362254 docker.go:122] docker version: linux-26.1.4:Docker Engine - Community
I0620 18:05:02.099396 362254 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0620 18:05:02.194016 362254 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:52 SystemTime:2024-06-20 18:05:02.183740751 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1063-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:26.1.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:d2d58213f83a351ca8f528a95fbd145f5654e957 Expected:d2d58213f83a351ca8f528a95fbd145f5654e957} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.1]] Warnings:<nil>}}
I0620 18:05:02.194188 362254 docker.go:295] overlay module found
I0620 18:05:02.196622 362254 out.go:177] * Using the docker driver based on existing profile
I0620 18:05:02.198542 362254 start.go:297] selected driver: docker
I0620 18:05:02.198568 362254 start.go:901] validating driver "docker" against &{Name:old-k8s-version-577369 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718753665-19106@sha256:735aacbd61d487240dc39ba6e4d70dd6ae1ad6181ca2ba092d372605e48ee636 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-577369 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountSt
ring:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0620 18:05:02.198666 362254 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0620 18:05:02.199399 362254 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0620 18:05:02.277488 362254 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:52 SystemTime:2024-06-20 18:05:02.268025856 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1063-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:26.1.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:d2d58213f83a351ca8f528a95fbd145f5654e957 Expected:d2d58213f83a351ca8f528a95fbd145f5654e957} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.1]] Warnings:<nil>}}
I0620 18:05:02.277832 362254 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0620 18:05:02.277866 362254 cni.go:84] Creating CNI manager for ""
I0620 18:05:02.277878 362254 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
I0620 18:05:02.277923 362254 start.go:340] cluster config:
{Name:old-k8s-version-577369 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718753665-19106@sha256:735aacbd61d487240dc39ba6e4d70dd6ae1ad6181ca2ba092d372605e48ee636 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-577369 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountI
P: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0620 18:05:02.280605 362254 out.go:177] * Starting "old-k8s-version-577369" primary control-plane node in "old-k8s-version-577369" cluster
I0620 18:05:02.284655 362254 cache.go:121] Beginning downloading kic base image for docker with docker
I0620 18:05:02.286489 362254 out.go:177] * Pulling base image v0.0.44-1718753665-19106 ...
I0620 18:05:02.289062 362254 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
I0620 18:05:02.289128 362254 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19106-2452/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4
I0620 18:05:02.289142 362254 cache.go:56] Caching tarball of preloaded images
I0620 18:05:02.289237 362254 preload.go:173] Found /home/jenkins/minikube-integration/19106-2452/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
I0620 18:05:02.289252 362254 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
I0620 18:05:02.289360 362254 profile.go:143] Saving config to /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/old-k8s-version-577369/config.json ...
I0620 18:05:02.289565 362254 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718753665-19106@sha256:735aacbd61d487240dc39ba6e4d70dd6ae1ad6181ca2ba092d372605e48ee636 in local docker daemon
I0620 18:05:02.313717 362254 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718753665-19106@sha256:735aacbd61d487240dc39ba6e4d70dd6ae1ad6181ca2ba092d372605e48ee636 in local docker daemon, skipping pull
I0620 18:05:02.313745 362254 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718753665-19106@sha256:735aacbd61d487240dc39ba6e4d70dd6ae1ad6181ca2ba092d372605e48ee636 exists in daemon, skipping load
I0620 18:05:02.313764 362254 cache.go:194] Successfully downloaded all kic artifacts
I0620 18:05:02.313791 362254 start.go:360] acquireMachinesLock for old-k8s-version-577369: {Name:mk9b1b6d4b408a6c11c5d4aaff15ef14fb8ad6d5 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0620 18:05:02.313868 362254 start.go:364] duration metric: took 46.744µs to acquireMachinesLock for "old-k8s-version-577369"
I0620 18:05:02.313892 362254 start.go:96] Skipping create...Using existing machine configuration
I0620 18:05:02.313901 362254 fix.go:54] fixHost starting:
I0620 18:05:02.314184 362254 cli_runner.go:164] Run: docker container inspect old-k8s-version-577369 --format={{.State.Status}}
I0620 18:05:02.344504 362254 fix.go:112] recreateIfNeeded on old-k8s-version-577369: state=Stopped err=<nil>
W0620 18:05:02.344543 362254 fix.go:138] unexpected machine state, will restart: <nil>
I0620 18:05:02.346773 362254 out.go:177] * Restarting existing docker container for "old-k8s-version-577369" ...
I0620 18:05:02.349594 362254 cli_runner.go:164] Run: docker start old-k8s-version-577369
I0620 18:05:02.805846 362254 cli_runner.go:164] Run: docker container inspect old-k8s-version-577369 --format={{.State.Status}}
I0620 18:05:02.827076 362254 kic.go:430] container "old-k8s-version-577369" state is running.
I0620 18:05:02.831790 362254 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-577369
I0620 18:05:02.882583 362254 profile.go:143] Saving config to /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/old-k8s-version-577369/config.json ...
I0620 18:05:02.882820 362254 machine.go:94] provisionDockerMachine start ...
I0620 18:05:02.882894 362254 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-577369
I0620 18:05:02.922775 362254 main.go:141] libmachine: Using SSH client type: native
I0620 18:05:02.923122 362254 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2bc0] 0x3e5420 <nil> [] 0s} 127.0.0.1 33128 <nil> <nil>}
I0620 18:05:02.923142 362254 main.go:141] libmachine: About to run SSH command:
hostname
I0620 18:05:02.924004 362254 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0620 18:05:06.063326 362254 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-577369
I0620 18:05:06.063351 362254 ubuntu.go:169] provisioning hostname "old-k8s-version-577369"
I0620 18:05:06.063422 362254 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-577369
I0620 18:05:06.082204 362254 main.go:141] libmachine: Using SSH client type: native
I0620 18:05:06.082475 362254 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2bc0] 0x3e5420 <nil> [] 0s} 127.0.0.1 33128 <nil> <nil>}
I0620 18:05:06.082493 362254 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-577369 && echo "old-k8s-version-577369" | sudo tee /etc/hostname
I0620 18:05:06.233824 362254 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-577369
I0620 18:05:06.233910 362254 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-577369
I0620 18:05:06.251525 362254 main.go:141] libmachine: Using SSH client type: native
I0620 18:05:06.251887 362254 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2bc0] 0x3e5420 <nil> [] 0s} 127.0.0.1 33128 <nil> <nil>}
I0620 18:05:06.251913 362254 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-577369' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-577369/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-577369' | sudo tee -a /etc/hosts;
fi
fi
I0620 18:05:06.387362 362254 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0620 18:05:06.387388 362254 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19106-2452/.minikube CaCertPath:/home/jenkins/minikube-integration/19106-2452/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19106-2452/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19106-2452/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19106-2452/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19106-2452/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19106-2452/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19106-2452/.minikube}
I0620 18:05:06.387419 362254 ubuntu.go:177] setting up certificates
I0620 18:05:06.387429 362254 provision.go:84] configureAuth start
I0620 18:05:06.387493 362254 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-577369
I0620 18:05:06.409505 362254 provision.go:143] copyHostCerts
I0620 18:05:06.409583 362254 exec_runner.go:144] found /home/jenkins/minikube-integration/19106-2452/.minikube/ca.pem, removing ...
I0620 18:05:06.409597 362254 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19106-2452/.minikube/ca.pem
I0620 18:05:06.409674 362254 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19106-2452/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19106-2452/.minikube/ca.pem (1078 bytes)
I0620 18:05:06.409805 362254 exec_runner.go:144] found /home/jenkins/minikube-integration/19106-2452/.minikube/cert.pem, removing ...
I0620 18:05:06.409816 362254 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19106-2452/.minikube/cert.pem
I0620 18:05:06.409848 362254 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19106-2452/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19106-2452/.minikube/cert.pem (1123 bytes)
I0620 18:05:06.409907 362254 exec_runner.go:144] found /home/jenkins/minikube-integration/19106-2452/.minikube/key.pem, removing ...
I0620 18:05:06.409915 362254 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19106-2452/.minikube/key.pem
I0620 18:05:06.409940 362254 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19106-2452/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19106-2452/.minikube/key.pem (1675 bytes)
I0620 18:05:06.409992 362254 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19106-2452/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19106-2452/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19106-2452/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-577369 san=[127.0.0.1 192.168.85.2 localhost minikube old-k8s-version-577369]
I0620 18:05:06.667572 362254 provision.go:177] copyRemoteCerts
I0620 18:05:06.667651 362254 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0620 18:05:06.667696 362254 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-577369
I0620 18:05:06.683724 362254 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/19106-2452/.minikube/machines/old-k8s-version-577369/id_rsa Username:docker}
I0620 18:05:06.782852 362254 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0620 18:05:06.806890 362254 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0620 18:05:06.830888 362254 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0620 18:05:06.855372 362254 provision.go:87] duration metric: took 467.925213ms to configureAuth
I0620 18:05:06.855403 362254 ubuntu.go:193] setting minikube options for container-runtime
I0620 18:05:06.855606 362254 config.go:182] Loaded profile config "old-k8s-version-577369": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0
I0620 18:05:06.855669 362254 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-577369
I0620 18:05:06.873422 362254 main.go:141] libmachine: Using SSH client type: native
I0620 18:05:06.873681 362254 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2bc0] 0x3e5420 <nil> [] 0s} 127.0.0.1 33128 <nil> <nil>}
I0620 18:05:06.873691 362254 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0620 18:05:07.005273 362254 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0620 18:05:07.005308 362254 ubuntu.go:71] root file system type: overlay
I0620 18:05:07.005430 362254 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
I0620 18:05:07.005516 362254 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-577369
I0620 18:05:07.023189 362254 main.go:141] libmachine: Using SSH client type: native
I0620 18:05:07.023444 362254 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2bc0] 0x3e5420 <nil> [] 0s} 127.0.0.1 33128 <nil> <nil>}
I0620 18:05:07.023528 362254 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0620 18:05:07.167582 362254 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0620 18:05:07.167704 362254 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-577369
I0620 18:05:07.186269 362254 main.go:141] libmachine: Using SSH client type: native
I0620 18:05:07.186558 362254 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2bc0] 0x3e5420 <nil> [] 0s} 127.0.0.1 33128 <nil> <nil>}
I0620 18:05:07.186580 362254 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0620 18:05:07.324192 362254 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0620 18:05:07.324277 362254 machine.go:97] duration metric: took 4.441438755s to provisionDockerMachine
I0620 18:05:07.324301 362254 start.go:293] postStartSetup for "old-k8s-version-577369" (driver="docker")
I0620 18:05:07.324343 362254 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0620 18:05:07.324435 362254 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0620 18:05:07.324508 362254 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-577369
I0620 18:05:07.345790 362254 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/19106-2452/.minikube/machines/old-k8s-version-577369/id_rsa Username:docker}
I0620 18:05:07.441768 362254 ssh_runner.go:195] Run: cat /etc/os-release
I0620 18:05:07.444962 362254 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0620 18:05:07.445001 362254 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0620 18:05:07.445018 362254 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0620 18:05:07.445026 362254 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0620 18:05:07.445040 362254 filesync.go:126] Scanning /home/jenkins/minikube-integration/19106-2452/.minikube/addons for local assets ...
I0620 18:05:07.445107 362254 filesync.go:126] Scanning /home/jenkins/minikube-integration/19106-2452/.minikube/files for local assets ...
I0620 18:05:07.445210 362254 filesync.go:149] local asset: /home/jenkins/minikube-integration/19106-2452/.minikube/files/etc/ssl/certs/77842.pem -> 77842.pem in /etc/ssl/certs
I0620 18:05:07.445324 362254 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0620 18:05:07.454680 362254 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/files/etc/ssl/certs/77842.pem --> /etc/ssl/certs/77842.pem (1708 bytes)
I0620 18:05:07.479523 362254 start.go:296] duration metric: took 155.177307ms for postStartSetup
I0620 18:05:07.479665 362254 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0620 18:05:07.479746 362254 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-577369
I0620 18:05:07.495983 362254 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/19106-2452/.minikube/machines/old-k8s-version-577369/id_rsa Username:docker}
I0620 18:05:07.587896 362254 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0620 18:05:07.592834 362254 fix.go:56] duration metric: took 5.278923959s for fixHost
I0620 18:05:07.592861 362254 start.go:83] releasing machines lock for "old-k8s-version-577369", held for 5.27898073s
I0620 18:05:07.592934 362254 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-577369
I0620 18:05:07.608643 362254 ssh_runner.go:195] Run: cat /version.json
I0620 18:05:07.608708 362254 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-577369
I0620 18:05:07.608969 362254 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0620 18:05:07.609037 362254 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-577369
I0620 18:05:07.626012 362254 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/19106-2452/.minikube/machines/old-k8s-version-577369/id_rsa Username:docker}
I0620 18:05:07.627183 362254 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/19106-2452/.minikube/machines/old-k8s-version-577369/id_rsa Username:docker}
I0620 18:05:07.718614 362254 ssh_runner.go:195] Run: systemctl --version
I0620 18:05:07.847712 362254 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0620 18:05:07.852373 362254 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0620 18:05:07.871102 362254 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0620 18:05:07.871186 362254 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
I0620 18:05:07.888938 362254 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
I0620 18:05:07.907746 362254 cni.go:308] configured [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0620 18:05:07.907778 362254 start.go:494] detecting cgroup driver to use...
I0620 18:05:07.907813 362254 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0620 18:05:07.907925 362254 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0620 18:05:07.924926 362254 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0620 18:05:07.935168 362254 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0620 18:05:07.945988 362254 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0620 18:05:07.946064 362254 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0620 18:05:07.957103 362254 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0620 18:05:07.967622 362254 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0620 18:05:07.977556 362254 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0620 18:05:07.987971 362254 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0620 18:05:07.997590 362254 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0620 18:05:08.009155 362254 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0620 18:05:08.019954 362254 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0620 18:05:08.030135 362254 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0620 18:05:08.127231 362254 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0620 18:05:08.256451 362254 start.go:494] detecting cgroup driver to use...
I0620 18:05:08.256544 362254 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0620 18:05:08.256626 362254 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0620 18:05:08.270873 362254 cruntime.go:279] skipping containerd shutdown because we are bound to it
I0620 18:05:08.271020 362254 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0620 18:05:08.285851 362254 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0620 18:05:08.305597 362254 ssh_runner.go:195] Run: which cri-dockerd
I0620 18:05:08.310306 362254 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0620 18:05:08.319532 362254 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
I0620 18:05:08.338691 362254 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0620 18:05:08.486148 362254 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0620 18:05:08.589718 362254 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I0620 18:05:08.589894 362254 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I0620 18:05:08.611237 362254 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0620 18:05:08.711763 362254 ssh_runner.go:195] Run: sudo systemctl restart docker
I0620 18:05:09.148859 362254 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0620 18:05:09.172027 362254 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0620 18:05:09.200782 362254 out.go:204] * Preparing Kubernetes v1.20.0 on Docker 26.1.4 ...
I0620 18:05:09.200887 362254 cli_runner.go:164] Run: docker network inspect old-k8s-version-577369 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0620 18:05:09.221480 362254 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0620 18:05:09.225183 362254 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0620 18:05:09.236844 362254 kubeadm.go:877] updating cluster {Name:old-k8s-version-577369 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718753665-19106@sha256:735aacbd61d487240dc39ba6e4d70dd6ae1ad6181ca2ba092d372605e48ee636 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-577369 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkin
s:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0620 18:05:09.236974 362254 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
I0620 18:05:09.237036 362254 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0620 18:05:09.255587 362254 docker.go:685] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
registry.k8s.io/kube-proxy:v1.20.0
k8s.gcr.io/kube-proxy:v1.20.0
k8s.gcr.io/kube-apiserver:v1.20.0
registry.k8s.io/kube-apiserver:v1.20.0
k8s.gcr.io/kube-controller-manager:v1.20.0
registry.k8s.io/kube-controller-manager:v1.20.0
k8s.gcr.io/kube-scheduler:v1.20.0
registry.k8s.io/kube-scheduler:v1.20.0
k8s.gcr.io/etcd:3.4.13-0
registry.k8s.io/etcd:3.4.13-0
k8s.gcr.io/coredns:1.7.0
registry.k8s.io/coredns:1.7.0
k8s.gcr.io/pause:3.2
registry.k8s.io/pause:3.2
gcr.io/k8s-minikube/busybox:1.28.4-glibc
-- /stdout --
I0620 18:05:09.255619 362254 docker.go:615] Images already preloaded, skipping extraction
I0620 18:05:09.255688 362254 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0620 18:05:09.274939 362254 docker.go:685] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-proxy:v1.20.0
registry.k8s.io/kube-proxy:v1.20.0
k8s.gcr.io/kube-apiserver:v1.20.0
registry.k8s.io/kube-apiserver:v1.20.0
k8s.gcr.io/kube-controller-manager:v1.20.0
registry.k8s.io/kube-controller-manager:v1.20.0
k8s.gcr.io/kube-scheduler:v1.20.0
registry.k8s.io/kube-scheduler:v1.20.0
k8s.gcr.io/etcd:3.4.13-0
registry.k8s.io/etcd:3.4.13-0
k8s.gcr.io/coredns:1.7.0
registry.k8s.io/coredns:1.7.0
k8s.gcr.io/pause:3.2
registry.k8s.io/pause:3.2
gcr.io/k8s-minikube/busybox:1.28.4-glibc
-- /stdout --
I0620 18:05:09.274960 362254 cache_images.go:84] Images are preloaded, skipping loading
I0620 18:05:09.274969 362254 kubeadm.go:928] updating node { 192.168.85.2 8443 v1.20.0 docker true true} ...
I0620 18:05:09.275107 362254 kubeadm.go:940] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-577369 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-577369 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0620 18:05:09.275183 362254 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0620 18:05:09.320269 362254 cni.go:84] Creating CNI manager for ""
I0620 18:05:09.320300 362254 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
I0620 18:05:09.320309 362254 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0620 18:05:09.320338 362254 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-577369 NodeName:old-k8s-version-577369 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticP
odPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0620 18:05:09.320485 362254 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-577369"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0620 18:05:09.320555 362254 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0620 18:05:09.329466 362254 binaries.go:44] Found k8s binaries, skipping transfer
I0620 18:05:09.329535 362254 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0620 18:05:09.338188 362254 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (348 bytes)
I0620 18:05:09.357370 362254 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0620 18:05:09.377246 362254 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2118 bytes)
I0620 18:05:09.397326 362254 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0620 18:05:09.401022 362254 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0620 18:05:09.412824 362254 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0620 18:05:09.494437 362254 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0620 18:05:09.511408 362254 certs.go:68] Setting up /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/old-k8s-version-577369 for IP: 192.168.85.2
I0620 18:05:09.511438 362254 certs.go:194] generating shared ca certs ...
I0620 18:05:09.511456 362254 certs.go:226] acquiring lock for ca certs: {Name:mk1f8a102b3933d1e67f4b3f5a97c6bde91190df Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0620 18:05:09.511660 362254 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19106-2452/.minikube/ca.key
I0620 18:05:09.511745 362254 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19106-2452/.minikube/proxy-client-ca.key
I0620 18:05:09.511759 362254 certs.go:256] generating profile certs ...
I0620 18:05:09.511863 362254 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/old-k8s-version-577369/client.key
I0620 18:05:09.511948 362254 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/old-k8s-version-577369/apiserver.key.88bbc3ef
I0620 18:05:09.512015 362254 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/old-k8s-version-577369/proxy-client.key
I0620 18:05:09.512177 362254 certs.go:484] found cert: /home/jenkins/minikube-integration/19106-2452/.minikube/certs/7784.pem (1338 bytes)
W0620 18:05:09.512231 362254 certs.go:480] ignoring /home/jenkins/minikube-integration/19106-2452/.minikube/certs/7784_empty.pem, impossibly tiny 0 bytes
I0620 18:05:09.512247 362254 certs.go:484] found cert: /home/jenkins/minikube-integration/19106-2452/.minikube/certs/ca-key.pem (1675 bytes)
I0620 18:05:09.512277 362254 certs.go:484] found cert: /home/jenkins/minikube-integration/19106-2452/.minikube/certs/ca.pem (1078 bytes)
I0620 18:05:09.512338 362254 certs.go:484] found cert: /home/jenkins/minikube-integration/19106-2452/.minikube/certs/cert.pem (1123 bytes)
I0620 18:05:09.512370 362254 certs.go:484] found cert: /home/jenkins/minikube-integration/19106-2452/.minikube/certs/key.pem (1675 bytes)
I0620 18:05:09.512436 362254 certs.go:484] found cert: /home/jenkins/minikube-integration/19106-2452/.minikube/files/etc/ssl/certs/77842.pem (1708 bytes)
I0620 18:05:09.513191 362254 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0620 18:05:09.542581 362254 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0620 18:05:09.568798 362254 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0620 18:05:09.594096 362254 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0620 18:05:09.619811 362254 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/old-k8s-version-577369/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0620 18:05:09.644618 362254 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/old-k8s-version-577369/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0620 18:05:09.683724 362254 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/old-k8s-version-577369/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0620 18:05:09.718279 362254 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/old-k8s-version-577369/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0620 18:05:09.749046 362254 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0620 18:05:09.786813 362254 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/certs/7784.pem --> /usr/share/ca-certificates/7784.pem (1338 bytes)
I0620 18:05:09.820250 362254 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/files/etc/ssl/certs/77842.pem --> /usr/share/ca-certificates/77842.pem (1708 bytes)
I0620 18:05:09.846958 362254 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0620 18:05:09.866653 362254 ssh_runner.go:195] Run: openssl version
I0620 18:05:09.872211 362254 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/77842.pem && ln -fs /usr/share/ca-certificates/77842.pem /etc/ssl/certs/77842.pem"
I0620 18:05:09.881974 362254 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/77842.pem
I0620 18:05:09.885645 362254 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jun 20 17:09 /usr/share/ca-certificates/77842.pem
I0620 18:05:09.885778 362254 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/77842.pem
I0620 18:05:09.893019 362254 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/77842.pem /etc/ssl/certs/3ec20f2e.0"
I0620 18:05:09.901984 362254 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0620 18:05:09.911668 362254 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0620 18:05:09.915325 362254 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 20 17:02 /usr/share/ca-certificates/minikubeCA.pem
I0620 18:05:09.915400 362254 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0620 18:05:09.922504 362254 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0620 18:05:09.931799 362254 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7784.pem && ln -fs /usr/share/ca-certificates/7784.pem /etc/ssl/certs/7784.pem"
I0620 18:05:09.941599 362254 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7784.pem
I0620 18:05:09.945229 362254 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jun 20 17:09 /usr/share/ca-certificates/7784.pem
I0620 18:05:09.945314 362254 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7784.pem
I0620 18:05:09.952397 362254 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/7784.pem /etc/ssl/certs/51391683.0"
I0620 18:05:09.961670 362254 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0620 18:05:09.965732 362254 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0620 18:05:09.973123 362254 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0620 18:05:09.980371 362254 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0620 18:05:09.987722 362254 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0620 18:05:09.994956 362254 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0620 18:05:10.005268 362254 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0620 18:05:10.014434 362254 kubeadm.go:391] StartCluster: {Name:old-k8s-version-577369 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718753665-19106@sha256:735aacbd61d487240dc39ba6e4d70dd6ae1ad6181ca2ba092d372605e48ee636 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-577369 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/
minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0620 18:05:10.014652 362254 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0620 18:05:10.036766 362254 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0620 18:05:10.047735 362254 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0620 18:05:10.047759 362254 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0620 18:05:10.047765 362254 kubeadm.go:587] restartPrimaryControlPlane start ...
I0620 18:05:10.047838 362254 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0620 18:05:10.057508 362254 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0620 18:05:10.058492 362254 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-577369" does not appear in /home/jenkins/minikube-integration/19106-2452/kubeconfig
I0620 18:05:10.059077 362254 kubeconfig.go:62] /home/jenkins/minikube-integration/19106-2452/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-577369" cluster setting kubeconfig missing "old-k8s-version-577369" context setting]
I0620 18:05:10.059901 362254 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19106-2452/kubeconfig: {Name:mk967cf82c0948dae02e8ac8d029ebc6e66977ec Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0620 18:05:10.061729 362254 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0620 18:05:10.072189 362254 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.85.2
I0620 18:05:10.072273 362254 kubeadm.go:591] duration metric: took 24.502149ms to restartPrimaryControlPlane
I0620 18:05:10.072292 362254 kubeadm.go:393] duration metric: took 57.866944ms to StartCluster
I0620 18:05:10.072309 362254 settings.go:142] acquiring lock: {Name:mk6241da33092f9e98cd6bf3e519e03a5a9ec197 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0620 18:05:10.072382 362254 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19106-2452/kubeconfig
I0620 18:05:10.073905 362254 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19106-2452/kubeconfig: {Name:mk967cf82c0948dae02e8ac8d029ebc6e66977ec Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0620 18:05:10.074230 362254 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0620 18:05:10.074531 362254 config.go:182] Loaded profile config "old-k8s-version-577369": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0
I0620 18:05:10.074604 362254 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0620 18:05:10.074721 362254 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-577369"
I0620 18:05:10.074733 362254 addons.go:69] Setting dashboard=true in profile "old-k8s-version-577369"
I0620 18:05:10.074793 362254 addons.go:234] Setting addon dashboard=true in "old-k8s-version-577369"
W0620 18:05:10.074826 362254 addons.go:243] addon dashboard should already be in state true
I0620 18:05:10.074874 362254 host.go:66] Checking if "old-k8s-version-577369" exists ...
I0620 18:05:10.074758 362254 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-577369"
I0620 18:05:10.075496 362254 cli_runner.go:164] Run: docker container inspect old-k8s-version-577369 --format={{.State.Status}}
I0620 18:05:10.075609 362254 cli_runner.go:164] Run: docker container inspect old-k8s-version-577369 --format={{.State.Status}}
I0620 18:05:10.074728 362254 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-577369"
I0620 18:05:10.076101 362254 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-577369"
W0620 18:05:10.076121 362254 addons.go:243] addon metrics-server should already be in state true
I0620 18:05:10.076150 362254 host.go:66] Checking if "old-k8s-version-577369" exists ...
I0620 18:05:10.076745 362254 cli_runner.go:164] Run: docker container inspect old-k8s-version-577369 --format={{.State.Status}}
I0620 18:05:10.074721 362254 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-577369"
I0620 18:05:10.080055 362254 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-577369"
W0620 18:05:10.080078 362254 addons.go:243] addon storage-provisioner should already be in state true
I0620 18:05:10.080110 362254 host.go:66] Checking if "old-k8s-version-577369" exists ...
I0620 18:05:10.080590 362254 cli_runner.go:164] Run: docker container inspect old-k8s-version-577369 --format={{.State.Status}}
I0620 18:05:10.081030 362254 out.go:177] * Verifying Kubernetes components...
I0620 18:05:10.088001 362254 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0620 18:05:10.128224 362254 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0620 18:05:10.128851 362254 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-577369"
W0620 18:05:10.128865 362254 addons.go:243] addon default-storageclass should already be in state true
I0620 18:05:10.128894 362254 host.go:66] Checking if "old-k8s-version-577369" exists ...
I0620 18:05:10.129406 362254 cli_runner.go:164] Run: docker container inspect old-k8s-version-577369 --format={{.State.Status}}
I0620 18:05:10.135297 362254 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0620 18:05:10.140434 362254 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0620 18:05:10.140461 362254 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0620 18:05:10.140532 362254 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-577369
I0620 18:05:10.141010 362254 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0620 18:05:10.142637 362254 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0620 18:05:10.142657 362254 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0620 18:05:10.142730 362254 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-577369
I0620 18:05:10.154380 362254 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0620 18:05:10.156683 362254 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0620 18:05:10.156705 362254 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0620 18:05:10.156772 362254 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-577369
I0620 18:05:10.185857 362254 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0620 18:05:10.185878 362254 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0620 18:05:10.185944 362254 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-577369
I0620 18:05:10.215157 362254 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/19106-2452/.minikube/machines/old-k8s-version-577369/id_rsa Username:docker}
I0620 18:05:10.216163 362254 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/19106-2452/.minikube/machines/old-k8s-version-577369/id_rsa Username:docker}
I0620 18:05:10.228904 362254 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/19106-2452/.minikube/machines/old-k8s-version-577369/id_rsa Username:docker}
I0620 18:05:10.235002 362254 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33128 SSHKeyPath:/home/jenkins/minikube-integration/19106-2452/.minikube/machines/old-k8s-version-577369/id_rsa Username:docker}
I0620 18:05:10.255097 362254 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0620 18:05:10.295504 362254 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-577369" to be "Ready" ...
I0620 18:05:10.365152 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0620 18:05:10.380726 362254 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0620 18:05:10.380752 362254 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0620 18:05:10.396366 362254 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0620 18:05:10.396416 362254 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0620 18:05:10.417045 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0620 18:05:10.430817 362254 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0620 18:05:10.430844 362254 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0620 18:05:10.446542 362254 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0620 18:05:10.446575 362254 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0620 18:05:10.479537 362254 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0620 18:05:10.479563 362254 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0620 18:05:10.497986 362254 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0620 18:05:10.498012 362254 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
W0620 18:05:10.523920 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:10.523959 362254 retry.go:31] will retry after 348.212297ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:10.533552 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0620 18:05:10.569621 362254 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0620 18:05:10.569647 362254 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
W0620 18:05:10.599467 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:10.599502 362254 retry.go:31] will retry after 183.993197ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:10.614127 362254 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0620 18:05:10.614171 362254 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0620 18:05:10.633610 362254 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0620 18:05:10.633646 362254 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
W0620 18:05:10.646065 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:10.646100 362254 retry.go:31] will retry after 318.239177ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:10.653842 362254 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0620 18:05:10.653881 362254 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0620 18:05:10.672462 362254 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0620 18:05:10.672529 362254 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0620 18:05:10.691048 362254 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0620 18:05:10.691070 362254 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0620 18:05:10.712106 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0620 18:05:10.784354 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0620 18:05:10.789262 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:10.789296 362254 retry.go:31] will retry after 355.346233ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0620 18:05:10.857982 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:10.858012 362254 retry.go:31] will retry after 253.429944ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:10.873224 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0620 18:05:10.954848 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:10.954924 362254 retry.go:31] will retry after 297.412948ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:10.965238 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0620 18:05:11.044109 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:11.044139 362254 retry.go:31] will retry after 321.86944ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:11.112560 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0620 18:05:11.145149 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0620 18:05:11.216246 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:11.216319 362254 retry.go:31] will retry after 712.41259ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0620 18:05:11.236765 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:11.236795 362254 retry.go:31] will retry after 449.332514ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:11.252917 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0620 18:05:11.330686 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:11.330719 362254 retry.go:31] will retry after 351.587159ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:11.366940 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0620 18:05:11.442096 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:11.442128 362254 retry.go:31] will retry after 695.613361ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:11.682459 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0620 18:05:11.687059 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0620 18:05:11.787588 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:11.787635 362254 retry.go:31] will retry after 964.337127ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0620 18:05:11.812129 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:11.812160 362254 retry.go:31] will retry after 704.852171ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:11.929526 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0620 18:05:12.001432 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:12.001470 362254 retry.go:31] will retry after 922.118104ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:12.138972 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0620 18:05:12.215567 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:12.215603 362254 retry.go:31] will retry after 861.092518ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:12.296191 362254 node_ready.go:53] error getting node "old-k8s-version-577369": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-577369": dial tcp 192.168.85.2:8443: connect: connection refused
I0620 18:05:12.517727 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0620 18:05:12.602267 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:12.602348 362254 retry.go:31] will retry after 1.141858807s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:12.752580 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0620 18:05:12.835429 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:12.835468 362254 retry.go:31] will retry after 1.341747918s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:12.923841 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0620 18:05:13.014536 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:13.014570 362254 retry.go:31] will retry after 934.413097ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:13.077724 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0620 18:05:13.214445 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:13.214514 362254 retry.go:31] will retry after 1.178031532s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:13.744660 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0620 18:05:13.949669 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0620 18:05:13.976536 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:13.976565 362254 retry.go:31] will retry after 1.135116191s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:14.178159 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0620 18:05:14.298688 362254 node_ready.go:53] error getting node "old-k8s-version-577369": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-577369": dial tcp 192.168.85.2:8443: connect: connection refused
I0620 18:05:14.393475 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0620 18:05:14.410667 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:14.410696 362254 retry.go:31] will retry after 2.346773398s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0620 18:05:14.410732 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:14.410738 362254 retry.go:31] will retry after 2.203813949s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0620 18:05:14.671964 362254 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:14.671992 362254 retry.go:31] will retry after 1.638542745s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0620 18:05:15.112099 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0620 18:05:16.311386 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0620 18:05:16.614801 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0620 18:05:16.758616 362254 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0620 18:05:23.756129 362254 node_ready.go:49] node "old-k8s-version-577369" has status "Ready":"True"
I0620 18:05:23.756152 362254 node_ready.go:38] duration metric: took 13.460600585s for node "old-k8s-version-577369" to be "Ready" ...
I0620 18:05:23.756162 362254 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0620 18:05:24.140332 362254 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-92t8n" in "kube-system" namespace to be "Ready" ...
I0620 18:05:24.396147 362254 pod_ready.go:92] pod "coredns-74ff55c5b-92t8n" in "kube-system" namespace has status "Ready":"True"
I0620 18:05:24.396170 362254 pod_ready.go:81] duration metric: took 255.779187ms for pod "coredns-74ff55c5b-92t8n" in "kube-system" namespace to be "Ready" ...
I0620 18:05:24.396181 362254 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-577369" in "kube-system" namespace to be "Ready" ...
I0620 18:05:26.489531 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:05:26.804608 362254 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (11.692455011s)
I0620 18:05:26.804795 362254 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (10.49337593s)
I0620 18:05:26.804814 362254 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-577369"
I0620 18:05:26.804855 362254 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (10.190024236s)
I0620 18:05:26.804947 362254 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (10.046298772s)
I0620 18:05:26.807279 362254 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-577369 addons enable metrics-server
I0620 18:05:26.828751 362254 out.go:177] * Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
I0620 18:05:26.830948 362254 addons.go:510] duration metric: took 16.756344987s for enable addons: enabled=[metrics-server storage-provisioner dashboard default-storageclass]
I0620 18:05:28.904497 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:05:30.913014 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:05:32.962801 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:05:35.403188 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:05:37.902145 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:05:39.903616 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:05:41.903878 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:05:44.404313 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:05:46.904722 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:05:49.411946 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:05:51.905572 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:05:54.403345 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:05:56.903160 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:05:59.404173 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:01.406702 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:03.415590 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:05.902210 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:07.902785 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:10.402129 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:12.404012 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:14.906676 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:17.405088 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:19.903099 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:22.404115 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:24.902148 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:26.902212 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:28.902667 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:30.906114 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:32.906149 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:35.403503 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:37.405196 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:39.903362 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:41.903601 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:44.405671 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:46.412687 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:48.902060 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:50.902406 362254 pod_ready.go:102] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:52.404765 362254 pod_ready.go:92] pod "etcd-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"True"
I0620 18:06:52.404791 362254 pod_ready.go:81] duration metric: took 1m28.008602156s for pod "etcd-old-k8s-version-577369" in "kube-system" namespace to be "Ready" ...
I0620 18:06:52.404804 362254 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-577369" in "kube-system" namespace to be "Ready" ...
I0620 18:06:52.410584 362254 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"True"
I0620 18:06:52.410608 362254 pod_ready.go:81] duration metric: took 5.796677ms for pod "kube-apiserver-old-k8s-version-577369" in "kube-system" namespace to be "Ready" ...
I0620 18:06:52.410619 362254 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-577369" in "kube-system" namespace to be "Ready" ...
I0620 18:06:52.416168 362254 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"True"
I0620 18:06:52.416193 362254 pod_ready.go:81] duration metric: took 5.566241ms for pod "kube-controller-manager-old-k8s-version-577369" in "kube-system" namespace to be "Ready" ...
I0620 18:06:52.416204 362254 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-qh57b" in "kube-system" namespace to be "Ready" ...
I0620 18:06:52.421207 362254 pod_ready.go:92] pod "kube-proxy-qh57b" in "kube-system" namespace has status "Ready":"True"
I0620 18:06:52.421231 362254 pod_ready.go:81] duration metric: took 5.019226ms for pod "kube-proxy-qh57b" in "kube-system" namespace to be "Ready" ...
I0620 18:06:52.421244 362254 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-577369" in "kube-system" namespace to be "Ready" ...
I0620 18:06:52.425972 362254 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-577369" in "kube-system" namespace has status "Ready":"True"
I0620 18:06:52.425996 362254 pod_ready.go:81] duration metric: took 4.743942ms for pod "kube-scheduler-old-k8s-version-577369" in "kube-system" namespace to be "Ready" ...
I0620 18:06:52.426007 362254 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace to be "Ready" ...
I0620 18:06:54.433282 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:56.931912 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:06:58.932386 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:00.933410 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:03.432160 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:05.432746 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:07.932399 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:09.932701 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:12.432841 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:14.484895 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:16.931977 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:18.932660 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:21.432540 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:23.936820 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:26.432901 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:28.932873 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:31.431733 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:33.432627 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:35.931868 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:37.932565 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:40.433402 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:42.932231 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:44.932578 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:47.432166 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:49.437652 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:51.931714 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:53.931751 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:55.932823 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:07:58.432113 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:00.446605 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:02.932548 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:04.937607 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:07.432482 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:09.432949 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:11.433117 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:13.931631 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:15.933023 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:18.432623 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:20.931947 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:23.432276 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:25.932042 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:27.932502 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:30.432837 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:32.433782 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:34.932712 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:37.431735 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:39.433077 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:41.932607 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:44.432206 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:46.932710 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:49.432633 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:51.940410 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:54.432991 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:56.932396 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:08:59.432327 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:01.931976 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:03.932339 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:05.932754 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:08.432551 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:10.432698 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:12.932430 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:15.433253 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:17.938368 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:20.432874 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:22.932519 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:25.433194 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:27.933027 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:30.438071 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:32.932220 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:34.936100 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:37.432407 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:39.931938 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:41.933548 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:44.432536 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:46.932947 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:48.940303 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:51.439825 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:53.933306 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:56.012496 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:09:58.432068 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:00.458844 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:02.931431 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:05.431874 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:07.433865 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:09.932314 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:11.933181 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:13.934449 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:16.444821 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:18.932133 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:20.932170 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:23.434756 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:25.932711 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:27.933287 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:30.433760 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:32.932786 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:34.932888 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:36.933040 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:38.933262 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:41.441396 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:43.954833 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:46.530593 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:48.932893 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:50.936039 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:52.432238 362254 pod_ready.go:81] duration metric: took 4m0.006216679s for pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace to be "Ready" ...
E0620 18:10:52.432430 362254 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0620 18:10:52.432456 362254 pod_ready.go:38] duration metric: took 5m28.676281099s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0620 18:10:52.432502 362254 api_server.go:52] waiting for apiserver process to appear ...
I0620 18:10:52.432625 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0620 18:10:52.455740 362254 logs.go:276] 2 containers: [075e697d07c8 760f9a7d272c]
I0620 18:10:52.455824 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0620 18:10:52.475939 362254 logs.go:276] 2 containers: [25a953b6e46d 81eaddbb4b45]
I0620 18:10:52.476016 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0620 18:10:52.494299 362254 logs.go:276] 2 containers: [5534d9d547fd 7e60d81fce7f]
I0620 18:10:52.494380 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0620 18:10:52.512744 362254 logs.go:276] 2 containers: [4ed5438feb8b ab177be73cae]
I0620 18:10:52.512827 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0620 18:10:52.536524 362254 logs.go:276] 2 containers: [0b32a67571bb c47b7591b320]
I0620 18:10:52.536611 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0620 18:10:52.563389 362254 logs.go:276] 2 containers: [aab72b193950 a4eee0f3ea35]
I0620 18:10:52.563475 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0620 18:10:52.582302 362254 logs.go:276] 0 containers: []
W0620 18:10:52.582326 362254 logs.go:278] No container was found matching "kindnet"
I0620 18:10:52.582383 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0620 18:10:52.622007 362254 logs.go:276] 1 containers: [49efdc60eccc]
I0620 18:10:52.622087 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0620 18:10:52.650609 362254 logs.go:276] 2 containers: [74b467d165b4 16e28ef3ddc9]
I0620 18:10:52.650645 362254 logs.go:123] Gathering logs for kube-apiserver [760f9a7d272c] ...
I0620 18:10:52.650656 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 760f9a7d272c"
I0620 18:10:52.730252 362254 logs.go:123] Gathering logs for kube-proxy [0b32a67571bb] ...
I0620 18:10:52.730312 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0b32a67571bb"
I0620 18:10:52.753952 362254 logs.go:123] Gathering logs for kube-proxy [c47b7591b320] ...
I0620 18:10:52.753983 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c47b7591b320"
I0620 18:10:52.788507 362254 logs.go:123] Gathering logs for kube-controller-manager [aab72b193950] ...
I0620 18:10:52.788535 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 aab72b193950"
I0620 18:10:52.863485 362254 logs.go:123] Gathering logs for container status ...
I0620 18:10:52.863526 362254 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0620 18:10:52.948470 362254 logs.go:123] Gathering logs for describe nodes ...
I0620 18:10:52.948501 362254 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0620 18:10:53.151745 362254 logs.go:123] Gathering logs for kube-apiserver [075e697d07c8] ...
I0620 18:10:53.151776 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 075e697d07c8"
I0620 18:10:53.215264 362254 logs.go:123] Gathering logs for etcd [81eaddbb4b45] ...
I0620 18:10:53.215345 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 81eaddbb4b45"
I0620 18:10:53.278713 362254 logs.go:123] Gathering logs for coredns [5534d9d547fd] ...
I0620 18:10:53.278786 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5534d9d547fd"
I0620 18:10:53.303506 362254 logs.go:123] Gathering logs for storage-provisioner [74b467d165b4] ...
I0620 18:10:53.303539 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 74b467d165b4"
I0620 18:10:53.330579 362254 logs.go:123] Gathering logs for kubelet ...
I0620 18:10:53.330606 362254 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0620 18:10:53.394844 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.695585 1201 reflector.go:138] object-"kube-system"/"metrics-server-token-xd7wc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-xd7wc" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:10:53.395084 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.698643 1201 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:10:53.395315 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.698704 1201 reflector.go:138] object-"kube-system"/"storage-provisioner-token-b9lfw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-b9lfw" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:10:53.395517 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.698918 1201 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:10:53.395728 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.699130 1201 reflector.go:138] object-"kube-system"/"coredns-token-br6s7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-br6s7" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:10:53.395936 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.699223 1201 reflector.go:138] object-"default"/"default-token-9m8v4": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-9m8v4" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:10:53.396154 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.699291 1201 reflector.go:138] object-"kube-system"/"kube-proxy-token-kwb2s": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-kwb2s" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:10:53.402899 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:28 old-k8s-version-577369 kubelet[1201]: E0620 18:05:27.999585 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0620 18:10:53.403705 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:28 old-k8s-version-577369 kubelet[1201]: E0620 18:05:28.453263 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.406169 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:41 old-k8s-version-577369 kubelet[1201]: E0620 18:05:41.280792 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0620 18:10:53.410905 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:46 old-k8s-version-577369 kubelet[1201]: E0620 18:05:46.379764 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0620 18:10:53.411492 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:46 old-k8s-version-577369 kubelet[1201]: E0620 18:05:46.795712 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.411691 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:47 old-k8s-version-577369 kubelet[1201]: E0620 18:05:47.792472 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.412058 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:53 old-k8s-version-577369 kubelet[1201]: E0620 18:05:53.229484 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.412707 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:58 old-k8s-version-577369 kubelet[1201]: E0620 18:05:58.937844 1201 pod_workers.go:191] Error syncing pod 47a50d23-d504-4f3b-a3a1-97513673c10e ("storage-provisioner_kube-system(47a50d23-d504-4f3b-a3a1-97513673c10e)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(47a50d23-d504-4f3b-a3a1-97513673c10e)"
W0620 18:10:53.415122 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:00 old-k8s-version-577369 kubelet[1201]: E0620 18:06:00.973843 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0620 18:10:53.417576 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:06 old-k8s-version-577369 kubelet[1201]: E0620 18:06:06.253227 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0620 18:10:53.417909 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:12 old-k8s-version-577369 kubelet[1201]: E0620 18:06:12.213225 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.418095 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:20 old-k8s-version-577369 kubelet[1201]: E0620 18:06:20.220208 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.420319 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:25 old-k8s-version-577369 kubelet[1201]: E0620 18:06:25.880053 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0620 18:10:53.420506 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:34 old-k8s-version-577369 kubelet[1201]: E0620 18:06:34.213970 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.420708 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:39 old-k8s-version-577369 kubelet[1201]: E0620 18:06:39.231731 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.422875 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:49 old-k8s-version-577369 kubelet[1201]: E0620 18:06:49.256445 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0620 18:10:53.423094 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:53 old-k8s-version-577369 kubelet[1201]: E0620 18:06:53.229559 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.423282 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:02 old-k8s-version-577369 kubelet[1201]: E0620 18:07:02.213019 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.425508 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:07 old-k8s-version-577369 kubelet[1201]: E0620 18:07:07.909458 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0620 18:10:53.425695 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:17 old-k8s-version-577369 kubelet[1201]: E0620 18:07:17.213306 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.425892 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:20 old-k8s-version-577369 kubelet[1201]: E0620 18:07:20.213221 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.426129 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:32 old-k8s-version-577369 kubelet[1201]: E0620 18:07:32.213001 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.426358 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:35 old-k8s-version-577369 kubelet[1201]: E0620 18:07:35.214923 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.426574 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:47 old-k8s-version-577369 kubelet[1201]: E0620 18:07:47.215155 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.426803 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:50 old-k8s-version-577369 kubelet[1201]: E0620 18:07:50.213002 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.427024 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:02 old-k8s-version-577369 kubelet[1201]: E0620 18:08:02.213224 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.427277 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:04 old-k8s-version-577369 kubelet[1201]: E0620 18:08:04.224800 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.429643 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:13 old-k8s-version-577369 kubelet[1201]: E0620 18:08:13.248654 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0620 18:10:53.429866 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:18 old-k8s-version-577369 kubelet[1201]: E0620 18:08:18.213216 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.430079 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:24 old-k8s-version-577369 kubelet[1201]: E0620 18:08:24.213044 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.432435 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:31 old-k8s-version-577369 kubelet[1201]: E0620 18:08:31.863326 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0620 18:10:53.432690 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:35 old-k8s-version-577369 kubelet[1201]: E0620 18:08:35.226288 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.432906 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:44 old-k8s-version-577369 kubelet[1201]: E0620 18:08:44.214061 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.433095 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:46 old-k8s-version-577369 kubelet[1201]: E0620 18:08:46.213051 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.433312 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:57 old-k8s-version-577369 kubelet[1201]: E0620 18:08:57.213817 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.434754 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:58 old-k8s-version-577369 kubelet[1201]: E0620 18:08:58.213216 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.434962 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:11 old-k8s-version-577369 kubelet[1201]: E0620 18:09:11.219178 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.435211 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:11 old-k8s-version-577369 kubelet[1201]: E0620 18:09:11.223804 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.435405 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:25 old-k8s-version-577369 kubelet[1201]: E0620 18:09:25.213628 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.435612 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:25 old-k8s-version-577369 kubelet[1201]: E0620 18:09:25.220085 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.435796 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:37 old-k8s-version-577369 kubelet[1201]: E0620 18:09:37.218633 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.435993 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:39 old-k8s-version-577369 kubelet[1201]: E0620 18:09:39.213129 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.436176 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:49 old-k8s-version-577369 kubelet[1201]: E0620 18:09:49.212880 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.436373 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:52 old-k8s-version-577369 kubelet[1201]: E0620 18:09:52.213161 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.436556 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:01 old-k8s-version-577369 kubelet[1201]: E0620 18:10:01.220058 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.436792 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:07 old-k8s-version-577369 kubelet[1201]: E0620 18:10:07.213133 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.436983 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:16 old-k8s-version-577369 kubelet[1201]: E0620 18:10:16.212946 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.437180 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:18 old-k8s-version-577369 kubelet[1201]: E0620 18:10:18.220165 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.437378 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:31 old-k8s-version-577369 kubelet[1201]: E0620 18:10:31.213199 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.437565 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:31 old-k8s-version-577369 kubelet[1201]: E0620 18:10:31.215427 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.443097 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:42 old-k8s-version-577369 kubelet[1201]: E0620 18:10:42.213713 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.443303 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:43 old-k8s-version-577369 kubelet[1201]: E0620 18:10:43.221571 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0620 18:10:53.443318 362254 logs.go:123] Gathering logs for etcd [25a953b6e46d] ...
I0620 18:10:53.443331 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25a953b6e46d"
I0620 18:10:53.484821 362254 logs.go:123] Gathering logs for storage-provisioner [16e28ef3ddc9] ...
I0620 18:10:53.484852 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 16e28ef3ddc9"
I0620 18:10:53.512687 362254 logs.go:123] Gathering logs for Docker ...
I0620 18:10:53.512715 362254 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0620 18:10:53.542148 362254 logs.go:123] Gathering logs for kubernetes-dashboard [49efdc60eccc] ...
I0620 18:10:53.542183 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49efdc60eccc"
I0620 18:10:53.570140 362254 logs.go:123] Gathering logs for dmesg ...
I0620 18:10:53.570171 362254 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0620 18:10:53.588771 362254 logs.go:123] Gathering logs for coredns [7e60d81fce7f] ...
I0620 18:10:53.588800 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7e60d81fce7f"
I0620 18:10:53.615089 362254 logs.go:123] Gathering logs for kube-scheduler [4ed5438feb8b] ...
I0620 18:10:53.615127 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4ed5438feb8b"
I0620 18:10:53.647925 362254 logs.go:123] Gathering logs for kube-scheduler [ab177be73cae] ...
I0620 18:10:53.647953 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ab177be73cae"
I0620 18:10:53.678028 362254 logs.go:123] Gathering logs for kube-controller-manager [a4eee0f3ea35] ...
I0620 18:10:53.678058 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a4eee0f3ea35"
I0620 18:10:53.741842 362254 out.go:304] Setting ErrFile to fd 2...
I0620 18:10:53.741873 362254 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0620 18:10:53.741941 362254 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0620 18:10:53.741956 362254 out.go:239] Jun 20 18:10:18 old-k8s-version-577369 kubelet[1201]: E0620 18:10:18.220165 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 20 18:10:18 old-k8s-version-577369 kubelet[1201]: E0620 18:10:18.220165 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.741969 362254 out.go:239] Jun 20 18:10:31 old-k8s-version-577369 kubelet[1201]: E0620 18:10:31.213199 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 20 18:10:31 old-k8s-version-577369 kubelet[1201]: E0620 18:10:31.213199 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.741977 362254 out.go:239] Jun 20 18:10:31 old-k8s-version-577369 kubelet[1201]: E0620 18:10:31.215427 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 20 18:10:31 old-k8s-version-577369 kubelet[1201]: E0620 18:10:31.215427 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.741984 362254 out.go:239] Jun 20 18:10:42 old-k8s-version-577369 kubelet[1201]: E0620 18:10:42.213713 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 20 18:10:42 old-k8s-version-577369 kubelet[1201]: E0620 18:10:42.213713 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.742104 362254 out.go:239] Jun 20 18:10:43 old-k8s-version-577369 kubelet[1201]: E0620 18:10:43.221571 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 20 18:10:43 old-k8s-version-577369 kubelet[1201]: E0620 18:10:43.221571 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0620 18:10:53.742120 362254 out.go:304] Setting ErrFile to fd 2...
I0620 18:10:53.742126 362254 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0620 18:11:03.744154 362254 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0620 18:11:03.759975 362254 api_server.go:72] duration metric: took 5m53.685709451s to wait for apiserver process to appear ...
I0620 18:11:03.759998 362254 api_server.go:88] waiting for apiserver healthz status ...
I0620 18:11:03.760078 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0620 18:11:03.798135 362254 logs.go:276] 2 containers: [075e697d07c8 760f9a7d272c]
I0620 18:11:03.798211 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0620 18:11:03.831434 362254 logs.go:276] 2 containers: [25a953b6e46d 81eaddbb4b45]
I0620 18:11:03.831511 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0620 18:11:03.861101 362254 logs.go:276] 2 containers: [5534d9d547fd 7e60d81fce7f]
I0620 18:11:03.861185 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0620 18:11:03.905927 362254 logs.go:276] 2 containers: [4ed5438feb8b ab177be73cae]
I0620 18:11:03.906011 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0620 18:11:03.944486 362254 logs.go:276] 2 containers: [0b32a67571bb c47b7591b320]
I0620 18:11:03.944579 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0620 18:11:03.975451 362254 logs.go:276] 2 containers: [aab72b193950 a4eee0f3ea35]
I0620 18:11:03.975533 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0620 18:11:03.998509 362254 logs.go:276] 0 containers: []
W0620 18:11:03.998529 362254 logs.go:278] No container was found matching "kindnet"
I0620 18:11:03.998586 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0620 18:11:04.031360 362254 logs.go:276] 1 containers: [49efdc60eccc]
I0620 18:11:04.031444 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0620 18:11:04.057548 362254 logs.go:276] 2 containers: [74b467d165b4 16e28ef3ddc9]
I0620 18:11:04.057630 362254 logs.go:123] Gathering logs for kubelet ...
I0620 18:11:04.057656 362254 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0620 18:11:04.137517 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.695585 1201 reflector.go:138] object-"kube-system"/"metrics-server-token-xd7wc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-xd7wc" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:11:04.137802 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.698643 1201 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:11:04.138082 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.698704 1201 reflector.go:138] object-"kube-system"/"storage-provisioner-token-b9lfw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-b9lfw" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:11:04.138316 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.698918 1201 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:11:04.138554 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.699130 1201 reflector.go:138] object-"kube-system"/"coredns-token-br6s7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-br6s7" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:11:04.138788 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.699223 1201 reflector.go:138] object-"default"/"default-token-9m8v4": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-9m8v4" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:11:04.139088 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.699291 1201 reflector.go:138] object-"kube-system"/"kube-proxy-token-kwb2s": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-kwb2s" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:11:04.145789 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:28 old-k8s-version-577369 kubelet[1201]: E0620 18:05:27.999585 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0620 18:11:04.146521 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:28 old-k8s-version-577369 kubelet[1201]: E0620 18:05:28.453263 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.149146 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:41 old-k8s-version-577369 kubelet[1201]: E0620 18:05:41.280792 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0620 18:11:04.155757 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:46 old-k8s-version-577369 kubelet[1201]: E0620 18:05:46.379764 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0620 18:11:04.156394 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:46 old-k8s-version-577369 kubelet[1201]: E0620 18:05:46.795712 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.156632 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:47 old-k8s-version-577369 kubelet[1201]: E0620 18:05:47.792472 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.157039 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:53 old-k8s-version-577369 kubelet[1201]: E0620 18:05:53.229484 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.157839 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:58 old-k8s-version-577369 kubelet[1201]: E0620 18:05:58.937844 1201 pod_workers.go:191] Error syncing pod 47a50d23-d504-4f3b-a3a1-97513673c10e ("storage-provisioner_kube-system(47a50d23-d504-4f3b-a3a1-97513673c10e)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(47a50d23-d504-4f3b-a3a1-97513673c10e)"
W0620 18:11:04.160409 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:00 old-k8s-version-577369 kubelet[1201]: E0620 18:06:00.973843 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0620 18:11:04.162846 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:06 old-k8s-version-577369 kubelet[1201]: E0620 18:06:06.253227 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0620 18:11:04.163226 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:12 old-k8s-version-577369 kubelet[1201]: E0620 18:06:12.213225 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.163438 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:20 old-k8s-version-577369 kubelet[1201]: E0620 18:06:20.220208 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.165695 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:25 old-k8s-version-577369 kubelet[1201]: E0620 18:06:25.880053 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0620 18:11:04.165909 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:34 old-k8s-version-577369 kubelet[1201]: E0620 18:06:34.213970 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.166131 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:39 old-k8s-version-577369 kubelet[1201]: E0620 18:06:39.231731 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.168276 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:49 old-k8s-version-577369 kubelet[1201]: E0620 18:06:49.256445 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0620 18:11:04.168505 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:53 old-k8s-version-577369 kubelet[1201]: E0620 18:06:53.229559 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.168720 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:02 old-k8s-version-577369 kubelet[1201]: E0620 18:07:02.213019 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.170964 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:07 old-k8s-version-577369 kubelet[1201]: E0620 18:07:07.909458 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0620 18:11:04.176940 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:17 old-k8s-version-577369 kubelet[1201]: E0620 18:07:17.213306 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.177172 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:20 old-k8s-version-577369 kubelet[1201]: E0620 18:07:20.213221 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.177380 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:32 old-k8s-version-577369 kubelet[1201]: E0620 18:07:32.213001 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.177601 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:35 old-k8s-version-577369 kubelet[1201]: E0620 18:07:35.214923 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.177809 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:47 old-k8s-version-577369 kubelet[1201]: E0620 18:07:47.215155 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.178032 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:50 old-k8s-version-577369 kubelet[1201]: E0620 18:07:50.213002 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.178241 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:02 old-k8s-version-577369 kubelet[1201]: E0620 18:08:02.213224 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.178468 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:04 old-k8s-version-577369 kubelet[1201]: E0620 18:08:04.224800 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.180581 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:13 old-k8s-version-577369 kubelet[1201]: E0620 18:08:13.248654 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0620 18:11:04.180807 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:18 old-k8s-version-577369 kubelet[1201]: E0620 18:08:18.213216 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.181015 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:24 old-k8s-version-577369 kubelet[1201]: E0620 18:08:24.213044 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.186304 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:31 old-k8s-version-577369 kubelet[1201]: E0620 18:08:31.863326 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0620 18:11:04.186572 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:35 old-k8s-version-577369 kubelet[1201]: E0620 18:08:35.226288 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.186801 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:44 old-k8s-version-577369 kubelet[1201]: E0620 18:08:44.214061 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.187082 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:46 old-k8s-version-577369 kubelet[1201]: E0620 18:08:46.213051 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.187306 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:57 old-k8s-version-577369 kubelet[1201]: E0620 18:08:57.213817 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.187514 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:58 old-k8s-version-577369 kubelet[1201]: E0620 18:08:58.213216 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.187732 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:11 old-k8s-version-577369 kubelet[1201]: E0620 18:09:11.219178 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.187954 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:11 old-k8s-version-577369 kubelet[1201]: E0620 18:09:11.223804 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.188162 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:25 old-k8s-version-577369 kubelet[1201]: E0620 18:09:25.213628 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.188387 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:25 old-k8s-version-577369 kubelet[1201]: E0620 18:09:25.220085 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.188608 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:37 old-k8s-version-577369 kubelet[1201]: E0620 18:09:37.218633 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.188830 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:39 old-k8s-version-577369 kubelet[1201]: E0620 18:09:39.213129 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.189038 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:49 old-k8s-version-577369 kubelet[1201]: E0620 18:09:49.212880 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.189258 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:52 old-k8s-version-577369 kubelet[1201]: E0620 18:09:52.213161 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.189468 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:01 old-k8s-version-577369 kubelet[1201]: E0620 18:10:01.220058 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.189694 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:07 old-k8s-version-577369 kubelet[1201]: E0620 18:10:07.213133 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.189902 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:16 old-k8s-version-577369 kubelet[1201]: E0620 18:10:16.212946 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.190121 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:18 old-k8s-version-577369 kubelet[1201]: E0620 18:10:18.220165 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.190341 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:31 old-k8s-version-577369 kubelet[1201]: E0620 18:10:31.213199 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.190550 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:31 old-k8s-version-577369 kubelet[1201]: E0620 18:10:31.215427 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.190773 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:42 old-k8s-version-577369 kubelet[1201]: E0620 18:10:42.213713 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.193468 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:43 old-k8s-version-577369 kubelet[1201]: E0620 18:10:43.221571 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.193769 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:55 old-k8s-version-577369 kubelet[1201]: E0620 18:10:55.213780 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.195893 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:56 old-k8s-version-577369 kubelet[1201]: E0620 18:10:56.254103 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
I0620 18:11:04.195923 362254 logs.go:123] Gathering logs for describe nodes ...
I0620 18:11:04.195949 362254 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0620 18:11:04.426160 362254 logs.go:123] Gathering logs for kube-apiserver [760f9a7d272c] ...
I0620 18:11:04.426342 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 760f9a7d272c"
I0620 18:11:04.528343 362254 logs.go:123] Gathering logs for kube-scheduler [ab177be73cae] ...
I0620 18:11:04.528424 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ab177be73cae"
I0620 18:11:04.573441 362254 logs.go:123] Gathering logs for storage-provisioner [16e28ef3ddc9] ...
I0620 18:11:04.573520 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 16e28ef3ddc9"
I0620 18:11:04.632739 362254 logs.go:123] Gathering logs for Docker ...
I0620 18:11:04.632808 362254 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0620 18:11:04.676322 362254 logs.go:123] Gathering logs for kube-apiserver [075e697d07c8] ...
I0620 18:11:04.676396 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 075e697d07c8"
I0620 18:11:04.751250 362254 logs.go:123] Gathering logs for etcd [25a953b6e46d] ...
I0620 18:11:04.751327 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25a953b6e46d"
I0620 18:11:04.825564 362254 logs.go:123] Gathering logs for kube-controller-manager [a4eee0f3ea35] ...
I0620 18:11:04.825644 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a4eee0f3ea35"
I0620 18:11:04.916404 362254 logs.go:123] Gathering logs for dmesg ...
I0620 18:11:04.916479 362254 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0620 18:11:04.944002 362254 logs.go:123] Gathering logs for etcd [81eaddbb4b45] ...
I0620 18:11:04.944073 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 81eaddbb4b45"
I0620 18:11:04.995804 362254 logs.go:123] Gathering logs for coredns [5534d9d547fd] ...
I0620 18:11:04.995893 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5534d9d547fd"
I0620 18:11:05.044664 362254 logs.go:123] Gathering logs for kube-scheduler [4ed5438feb8b] ...
I0620 18:11:05.044747 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4ed5438feb8b"
I0620 18:11:05.082366 362254 logs.go:123] Gathering logs for kube-proxy [0b32a67571bb] ...
I0620 18:11:05.082463 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0b32a67571bb"
I0620 18:11:05.141372 362254 logs.go:123] Gathering logs for kubernetes-dashboard [49efdc60eccc] ...
I0620 18:11:05.141442 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49efdc60eccc"
I0620 18:11:05.173015 362254 logs.go:123] Gathering logs for storage-provisioner [74b467d165b4] ...
I0620 18:11:05.173101 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 74b467d165b4"
I0620 18:11:05.211503 362254 logs.go:123] Gathering logs for coredns [7e60d81fce7f] ...
I0620 18:11:05.211569 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7e60d81fce7f"
I0620 18:11:05.253118 362254 logs.go:123] Gathering logs for kube-proxy [c47b7591b320] ...
I0620 18:11:05.253195 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c47b7591b320"
I0620 18:11:05.285055 362254 logs.go:123] Gathering logs for kube-controller-manager [aab72b193950] ...
I0620 18:11:05.285121 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 aab72b193950"
I0620 18:11:05.348716 362254 logs.go:123] Gathering logs for container status ...
I0620 18:11:05.348790 362254 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0620 18:11:05.447039 362254 out.go:304] Setting ErrFile to fd 2...
I0620 18:11:05.447134 362254 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0620 18:11:05.447272 362254 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0620 18:11:05.447326 362254 out.go:239] Jun 20 18:10:31 old-k8s-version-577369 kubelet[1201]: E0620 18:10:31.215427 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 20 18:10:31 old-k8s-version-577369 kubelet[1201]: E0620 18:10:31.215427 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:05.447358 362254 out.go:239] Jun 20 18:10:42 old-k8s-version-577369 kubelet[1201]: E0620 18:10:42.213713 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 20 18:10:42 old-k8s-version-577369 kubelet[1201]: E0620 18:10:42.213713 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:05.447432 362254 out.go:239] Jun 20 18:10:43 old-k8s-version-577369 kubelet[1201]: E0620 18:10:43.221571 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 20 18:10:43 old-k8s-version-577369 kubelet[1201]: E0620 18:10:43.221571 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:05.447521 362254 out.go:239] Jun 20 18:10:55 old-k8s-version-577369 kubelet[1201]: E0620 18:10:55.213780 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 20 18:10:55 old-k8s-version-577369 kubelet[1201]: E0620 18:10:55.213780 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:05.447602 362254 out.go:239] Jun 20 18:10:56 old-k8s-version-577369 kubelet[1201]: E0620 18:10:56.254103 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Jun 20 18:10:56 old-k8s-version-577369 kubelet[1201]: E0620 18:10:56.254103 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
I0620 18:11:05.447662 362254 out.go:304] Setting ErrFile to fd 2...
I0620 18:11:05.447707 362254 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0620 18:11:15.449472 362254 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0620 18:11:15.463258 362254 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0620 18:11:15.465704 362254 out.go:177]
W0620 18:11:15.467872 362254 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0620 18:11:15.467924 362254 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0620 18:11:15.467944 362254 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0620 18:11:15.467950 362254 out.go:239] *
*
W0620 18:11:15.468829 362254 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0620 18:11:15.471344 362254 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-577369 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=docker --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-577369
helpers_test.go:235: (dbg) docker inspect old-k8s-version-577369:
-- stdout --
[
{
"Id": "c4d3d73364cad899054ce908aa131722f0ea31d5c2d95544fcf715bd51754671",
"Created": "2024-06-20T18:02:15.594669718Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 362440,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-06-20T18:05:02.794317634Z",
"FinishedAt": "2024-06-20T18:05:01.413666697Z"
},
"Image": "sha256:d01e921d87b5c98766e198911bba95096a87baa7b20caabee6d66ddda3a30e16",
"ResolvConfPath": "/var/lib/docker/containers/c4d3d73364cad899054ce908aa131722f0ea31d5c2d95544fcf715bd51754671/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/c4d3d73364cad899054ce908aa131722f0ea31d5c2d95544fcf715bd51754671/hostname",
"HostsPath": "/var/lib/docker/containers/c4d3d73364cad899054ce908aa131722f0ea31d5c2d95544fcf715bd51754671/hosts",
"LogPath": "/var/lib/docker/containers/c4d3d73364cad899054ce908aa131722f0ea31d5c2d95544fcf715bd51754671/c4d3d73364cad899054ce908aa131722f0ea31d5c2d95544fcf715bd51754671-json.log",
"Name": "/old-k8s-version-577369",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-577369:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-577369",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/12a39ce1488abdfe7a427108b1f33bc367db04f2ce3023e8fbc4fa76863f37e3-init/diff:/var/lib/docker/overlay2/3f60bca961993969053ba4629c08bd2e3000c79c5940aaa31be086f923fe76a2/diff",
"MergedDir": "/var/lib/docker/overlay2/12a39ce1488abdfe7a427108b1f33bc367db04f2ce3023e8fbc4fa76863f37e3/merged",
"UpperDir": "/var/lib/docker/overlay2/12a39ce1488abdfe7a427108b1f33bc367db04f2ce3023e8fbc4fa76863f37e3/diff",
"WorkDir": "/var/lib/docker/overlay2/12a39ce1488abdfe7a427108b1f33bc367db04f2ce3023e8fbc4fa76863f37e3/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-577369",
"Source": "/var/lib/docker/volumes/old-k8s-version-577369/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-577369",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718753665-19106@sha256:735aacbd61d487240dc39ba6e4d70dd6ae1ad6181ca2ba092d372605e48ee636",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-577369",
"name.minikube.sigs.k8s.io": "old-k8s-version-577369",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "3931d835949d51cdaba053e30d371365c5c397b1d4566768bd331c8958a78b13",
"SandboxKey": "/var/run/docker/netns/3931d835949d",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33128"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33127"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33124"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33126"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33125"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-577369": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:55:02",
"NetworkID": "c61783ab8de1f95a445bcccb1c20832a63d43cf0050441f45622bd62211b83ae",
"EndpointID": "5730e8426e7592f02fe86bb8198377828cfc0d258c3f72d90eae3d4273a8df33",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DriverOpts": null,
"DNSNames": [
"old-k8s-version-577369",
"c4d3d73364ca"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-577369 -n old-k8s-version-577369
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-577369 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-577369 logs -n 25: (1.545539736s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| ssh | -p kubenet-978988 sudo | kubenet-978988 | jenkins | v1.33.1 | 20 Jun 24 18:03 UTC | 20 Jun 24 18:03 UTC |
| | systemctl cat containerd | | | | | |
| | --no-pager | | | | | |
| ssh | -p kubenet-978988 sudo cat | kubenet-978988 | jenkins | v1.33.1 | 20 Jun 24 18:03 UTC | 20 Jun 24 18:03 UTC |
| | /lib/systemd/system/containerd.service | | | | | |
| ssh | -p kubenet-978988 sudo cat | kubenet-978988 | jenkins | v1.33.1 | 20 Jun 24 18:03 UTC | 20 Jun 24 18:03 UTC |
| | /etc/containerd/config.toml | | | | | |
| ssh | -p kubenet-978988 sudo | kubenet-978988 | jenkins | v1.33.1 | 20 Jun 24 18:03 UTC | 20 Jun 24 18:03 UTC |
| | containerd config dump | | | | | |
| ssh | -p kubenet-978988 sudo | kubenet-978988 | jenkins | v1.33.1 | 20 Jun 24 18:03 UTC | |
| | systemctl status crio --all | | | | | |
| | --full --no-pager | | | | | |
| ssh | -p kubenet-978988 sudo | kubenet-978988 | jenkins | v1.33.1 | 20 Jun 24 18:03 UTC | 20 Jun 24 18:03 UTC |
| | systemctl cat crio --no-pager | | | | | |
| ssh | -p kubenet-978988 sudo find | kubenet-978988 | jenkins | v1.33.1 | 20 Jun 24 18:03 UTC | 20 Jun 24 18:03 UTC |
| | /etc/crio -type f -exec sh -c | | | | | |
| | 'echo {}; cat {}' \; | | | | | |
| ssh | -p kubenet-978988 sudo crio | kubenet-978988 | jenkins | v1.33.1 | 20 Jun 24 18:03 UTC | 20 Jun 24 18:03 UTC |
| | config | | | | | |
| delete | -p kubenet-978988 | kubenet-978988 | jenkins | v1.33.1 | 20 Jun 24 18:04 UTC | 20 Jun 24 18:04 UTC |
| start | -p embed-certs-221669 | embed-certs-221669 | jenkins | v1.33.1 | 20 Jun 24 18:04 UTC | 20 Jun 24 18:04 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --kubernetes-version=v1.30.2 | | | | | |
| addons | enable metrics-server -p old-k8s-version-577369 | old-k8s-version-577369 | jenkins | v1.33.1 | 20 Jun 24 18:04 UTC | 20 Jun 24 18:04 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-577369 | old-k8s-version-577369 | jenkins | v1.33.1 | 20 Jun 24 18:04 UTC | 20 Jun 24 18:05 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p embed-certs-221669 | embed-certs-221669 | jenkins | v1.33.1 | 20 Jun 24 18:05 UTC | 20 Jun 24 18:05 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| addons | enable dashboard -p old-k8s-version-577369 | old-k8s-version-577369 | jenkins | v1.33.1 | 20 Jun 24 18:05 UTC | 20 Jun 24 18:05 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-577369 | old-k8s-version-577369 | jenkins | v1.33.1 | 20 Jun 24 18:05 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| stop | -p embed-certs-221669 | embed-certs-221669 | jenkins | v1.33.1 | 20 Jun 24 18:05 UTC | 20 Jun 24 18:05 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p embed-certs-221669 | embed-certs-221669 | jenkins | v1.33.1 | 20 Jun 24 18:05 UTC | 20 Jun 24 18:05 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p embed-certs-221669 | embed-certs-221669 | jenkins | v1.33.1 | 20 Jun 24 18:05 UTC | 20 Jun 24 18:10 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --kubernetes-version=v1.30.2 | | | | | |
| image | embed-certs-221669 image list | embed-certs-221669 | jenkins | v1.33.1 | 20 Jun 24 18:10 UTC | 20 Jun 24 18:10 UTC |
| | --format=json | | | | | |
| pause | -p embed-certs-221669 | embed-certs-221669 | jenkins | v1.33.1 | 20 Jun 24 18:10 UTC | 20 Jun 24 18:10 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p embed-certs-221669 | embed-certs-221669 | jenkins | v1.33.1 | 20 Jun 24 18:10 UTC | 20 Jun 24 18:10 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p embed-certs-221669 | embed-certs-221669 | jenkins | v1.33.1 | 20 Jun 24 18:10 UTC | 20 Jun 24 18:10 UTC |
| delete | -p embed-certs-221669 | embed-certs-221669 | jenkins | v1.33.1 | 20 Jun 24 18:10 UTC | 20 Jun 24 18:10 UTC |
| delete | -p | disable-driver-mounts-710184 | jenkins | v1.33.1 | 20 Jun 24 18:10 UTC | 20 Jun 24 18:10 UTC |
| | disable-driver-mounts-710184 | | | | | |
| start | -p no-preload-581163 | no-preload-581163 | jenkins | v1.33.1 | 20 Jun 24 18:10 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --kubernetes-version=v1.30.2 | | | | | |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/06/20 18:10:25
Running on machine: ip-172-31-30-239
Binary: Built with gc go1.22.4 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0620 18:10:25.140286 374244 out.go:291] Setting OutFile to fd 1 ...
I0620 18:10:25.140419 374244 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0620 18:10:25.140429 374244 out.go:304] Setting ErrFile to fd 2...
I0620 18:10:25.140434 374244 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0620 18:10:25.140703 374244 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19106-2452/.minikube/bin
I0620 18:10:25.141134 374244 out.go:298] Setting JSON to false
I0620 18:10:25.142344 374244 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":6776,"bootTime":1718900249,"procs":226,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1063-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
I0620 18:10:25.142471 374244 start.go:139] virtualization:
I0620 18:10:25.145030 374244 out.go:177] * [no-preload-581163] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0620 18:10:25.148076 374244 out.go:177] - MINIKUBE_LOCATION=19106
I0620 18:10:25.148194 374244 notify.go:220] Checking for updates...
I0620 18:10:25.152794 374244 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0620 18:10:25.154851 374244 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19106-2452/kubeconfig
I0620 18:10:25.157021 374244 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19106-2452/.minikube
I0620 18:10:25.159087 374244 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0620 18:10:25.161364 374244 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0620 18:10:25.164043 374244 config.go:182] Loaded profile config "old-k8s-version-577369": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0
I0620 18:10:25.164151 374244 driver.go:392] Setting default libvirt URI to qemu:///system
I0620 18:10:25.195171 374244 docker.go:122] docker version: linux-26.1.4:Docker Engine - Community
I0620 18:10:25.195376 374244 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0620 18:10:25.272049 374244 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:33 OomKillDisable:true NGoroutines:52 SystemTime:2024-06-20 18:10:25.262577932 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1063-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:26.1.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:d2d58213f83a351ca8f528a95fbd145f5654e957 Expected:d2d58213f83a351ca8f528a95fbd145f5654e957} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.1]] Warnings:<nil>}}
I0620 18:10:25.272319 374244 docker.go:295] overlay module found
I0620 18:10:25.274882 374244 out.go:177] * Using the docker driver based on user configuration
I0620 18:10:25.276978 374244 start.go:297] selected driver: docker
I0620 18:10:25.276998 374244 start.go:901] validating driver "docker" against <nil>
I0620 18:10:25.277028 374244 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0620 18:10:25.277694 374244 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0620 18:10:25.329313 374244 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:33 OomKillDisable:true NGoroutines:52 SystemTime:2024-06-20 18:10:25.320019962 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1063-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:26.1.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:d2d58213f83a351ca8f528a95fbd145f5654e957 Expected:d2d58213f83a351ca8f528a95fbd145f5654e957} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.1]] Warnings:<nil>}}
I0620 18:10:25.329481 374244 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0620 18:10:25.329766 374244 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0620 18:10:25.331793 374244 out.go:177] * Using Docker driver with root privileges
I0620 18:10:25.333591 374244 cni.go:84] Creating CNI manager for ""
I0620 18:10:25.333619 374244 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0620 18:10:25.333631 374244 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0620 18:10:25.333713 374244 start.go:340] cluster config:
{Name:no-preload-581163 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718753665-19106@sha256:735aacbd61d487240dc39ba6e4d70dd6ae1ad6181ca2ba092d372605e48ee636 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:no-preload-581163 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHA
uthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0620 18:10:25.337658 374244 out.go:177] * Starting "no-preload-581163" primary control-plane node in "no-preload-581163" cluster
I0620 18:10:25.339490 374244 cache.go:121] Beginning downloading kic base image for docker with docker
I0620 18:10:25.341478 374244 out.go:177] * Pulling base image v0.0.44-1718753665-19106 ...
I0620 18:10:25.343276 374244 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime docker
I0620 18:10:25.343417 374244 profile.go:143] Saving config to /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/config.json ...
I0620 18:10:25.343453 374244 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/config.json: {Name:mk4f7553f0df17b50adb52af5140e59aedb3b299 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0620 18:10:25.343641 374244 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718753665-19106@sha256:735aacbd61d487240dc39ba6e4d70dd6ae1ad6181ca2ba092d372605e48ee636 in local docker daemon
I0620 18:10:25.343755 374244 cache.go:107] acquiring lock: {Name:mkedbce372c8b021b75e838a4e792c036a761200 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0620 18:10:25.343835 374244 cache.go:115] /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
I0620 18:10:25.343845 374244 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 96.343µs
I0620 18:10:25.343950 374244 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
I0620 18:10:25.343963 374244 cache.go:107] acquiring lock: {Name:mkd10451646dfb916de1a6eb2fe0396f4af72a3b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0620 18:10:25.344053 374244 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.30.2
I0620 18:10:25.344232 374244 cache.go:107] acquiring lock: {Name:mkee8d060f0fb886e89d8e5c583392b7f43c7bdd Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0620 18:10:25.344331 374244 cache.go:107] acquiring lock: {Name:mk04ededaedba903b8dff8c7ec32d396b026e506 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0620 18:10:25.344420 374244 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.30.2
I0620 18:10:25.344516 374244 cache.go:107] acquiring lock: {Name:mkbebf560fd4699e07827812d3acd0c318918852 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0620 18:10:25.344645 374244 cache.go:107] acquiring lock: {Name:mk06f8b9e9d5335d07d14799382f12deab117d6b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0620 18:10:25.344722 374244 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.30.2
I0620 18:10:25.344849 374244 cache.go:107] acquiring lock: {Name:mk17407c60e3cd8dcfba4c3820b6dc24090765d7 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0620 18:10:25.344778 374244 cache.go:107] acquiring lock: {Name:mkc3933946500b54b23529b39e969a689c10d776 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0620 18:10:25.345092 374244 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.12-0
I0620 18:10:25.345777 374244 image.go:134] retrieving image: registry.k8s.io/pause:3.9
I0620 18:10:25.346051 374244 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.30.2
I0620 18:10:25.346969 374244 image.go:134] retrieving image: registry.k8s.io/coredns/coredns:v1.11.1
I0620 18:10:25.350550 374244 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.12-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.12-0
I0620 18:10:25.351027 374244 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.30.2: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.30.2
I0620 18:10:25.351232 374244 image.go:177] daemon lookup for registry.k8s.io/pause:3.9: Error response from daemon: No such image: registry.k8s.io/pause:3.9
I0620 18:10:25.351428 374244 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.30.2: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.30.2
I0620 18:10:25.351618 374244 image.go:177] daemon lookup for registry.k8s.io/coredns/coredns:v1.11.1: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.11.1
I0620 18:10:25.352693 374244 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.30.2: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.30.2
I0620 18:10:25.353918 374244 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.30.2: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.30.2
I0620 18:10:25.364362 374244 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718753665-19106@sha256:735aacbd61d487240dc39ba6e4d70dd6ae1ad6181ca2ba092d372605e48ee636 in local docker daemon, skipping pull
I0620 18:10:25.364385 374244 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718753665-19106@sha256:735aacbd61d487240dc39ba6e4d70dd6ae1ad6181ca2ba092d372605e48ee636 exists in daemon, skipping load
I0620 18:10:25.364405 374244 cache.go:194] Successfully downloaded all kic artifacts
I0620 18:10:25.364443 374244 start.go:360] acquireMachinesLock for no-preload-581163: {Name:mk527853ec2d83cc217bc2bea3950d445008ca15 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0620 18:10:25.364559 374244 start.go:364] duration metric: took 93.856µs to acquireMachinesLock for "no-preload-581163"
I0620 18:10:25.364604 374244 start.go:93] Provisioning new machine with config: &{Name:no-preload-581163 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718753665-19106@sha256:735aacbd61d487240dc39ba6e4d70dd6ae1ad6181ca2ba092d372605e48ee636 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:no-preload-581163 Namespace:default APIServerHAVIP: APIServer
Name:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fa
lse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true}
I0620 18:10:25.364679 374244 start.go:125] createHost starting for "" (driver="docker")
I0620 18:10:23.434756 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:25.932711 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:25.369007 374244 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0620 18:10:25.369246 374244 start.go:159] libmachine.API.Create for "no-preload-581163" (driver="docker")
I0620 18:10:25.369277 374244 client.go:168] LocalClient.Create starting
I0620 18:10:25.369346 374244 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19106-2452/.minikube/certs/ca.pem
I0620 18:10:25.369381 374244 main.go:141] libmachine: Decoding PEM data...
I0620 18:10:25.369394 374244 main.go:141] libmachine: Parsing certificate...
I0620 18:10:25.369453 374244 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19106-2452/.minikube/certs/cert.pem
I0620 18:10:25.369479 374244 main.go:141] libmachine: Decoding PEM data...
I0620 18:10:25.369494 374244 main.go:141] libmachine: Parsing certificate...
I0620 18:10:25.369871 374244 cli_runner.go:164] Run: docker network inspect no-preload-581163 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0620 18:10:25.392403 374244 cli_runner.go:211] docker network inspect no-preload-581163 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0620 18:10:25.392565 374244 network_create.go:284] running [docker network inspect no-preload-581163] to gather additional debugging logs...
I0620 18:10:25.392607 374244 cli_runner.go:164] Run: docker network inspect no-preload-581163
W0620 18:10:25.413318 374244 cli_runner.go:211] docker network inspect no-preload-581163 returned with exit code 1
I0620 18:10:25.413347 374244 network_create.go:287] error running [docker network inspect no-preload-581163]: docker network inspect no-preload-581163: exit status 1
stdout:
[]
stderr:
Error response from daemon: network no-preload-581163 not found
I0620 18:10:25.413359 374244 network_create.go:289] output of [docker network inspect no-preload-581163]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network no-preload-581163 not found
** /stderr **
I0620 18:10:25.413458 374244 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0620 18:10:25.436030 374244 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-9fc608b50896 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:1f:52:bf:e7} reservation:<nil>}
I0620 18:10:25.436434 374244 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-b5401af0733d IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:5f:fb:31:97} reservation:<nil>}
I0620 18:10:25.436964 374244 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-914a5cb18dec IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:8c:e7:e6:fd} reservation:<nil>}
I0620 18:10:25.437544 374244 network.go:206] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001b483c0}
I0620 18:10:25.437584 374244 network_create.go:124] attempt to create docker network no-preload-581163 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I0620 18:10:25.437662 374244 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=no-preload-581163 no-preload-581163
I0620 18:10:25.518393 374244 network_create.go:108] docker network no-preload-581163 192.168.76.0/24 created
I0620 18:10:25.518425 374244 kic.go:121] calculated static IP "192.168.76.2" for the "no-preload-581163" container
I0620 18:10:25.518497 374244 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0620 18:10:25.534658 374244 cli_runner.go:164] Run: docker volume create no-preload-581163 --label name.minikube.sigs.k8s.io=no-preload-581163 --label created_by.minikube.sigs.k8s.io=true
I0620 18:10:25.551117 374244 oci.go:103] Successfully created a docker volume no-preload-581163
I0620 18:10:25.551213 374244 cli_runner.go:164] Run: docker run --rm --name no-preload-581163-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=no-preload-581163 --entrypoint /usr/bin/test -v no-preload-581163:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718753665-19106@sha256:735aacbd61d487240dc39ba6e4d70dd6ae1ad6181ca2ba092d372605e48ee636 -d /var/lib
I0620 18:10:25.887022 374244 cache.go:162] opening: /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.30.2
I0620 18:10:25.906506 374244 cache.go:162] opening: /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9
I0620 18:10:25.910363 374244 cache.go:162] opening: /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.12-0
I0620 18:10:25.916621 374244 cache.go:162] opening: /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1
I0620 18:10:25.936924 374244 cache.go:162] opening: /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.30.2
I0620 18:10:25.962239 374244 cache.go:162] opening: /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.30.2
I0620 18:10:26.007523 374244 cache.go:162] opening: /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.30.2
I0620 18:10:26.014658 374244 cache.go:157] /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9 exists
I0620 18:10:26.014690 374244 cache.go:96] cache image "registry.k8s.io/pause:3.9" -> "/home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9" took 670.360734ms
I0620 18:10:26.014704 374244 cache.go:80] save to tar file registry.k8s.io/pause:3.9 -> /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9 succeeded
I0620 18:10:26.262000 374244 oci.go:107] Successfully prepared a docker volume no-preload-581163
I0620 18:10:26.262032 374244 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime docker
W0620 18:10:26.262159 374244 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0620 18:10:26.262277 374244 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0620 18:10:26.371195 374244 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname no-preload-581163 --name no-preload-581163 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=no-preload-581163 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=no-preload-581163 --network no-preload-581163 --ip 192.168.76.2 --volume no-preload-581163:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718753665-19106@sha256:735aacbd61d487240dc39ba6e4d70dd6ae1ad6181ca2ba092d372605e48ee636
I0620 18:10:26.711511 374244 cache.go:157] /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.30.2 exists
I0620 18:10:26.711615 374244 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.30.2" -> "/home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.30.2" took 1.367405795s
I0620 18:10:26.711644 374244 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.30.2 -> /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.30.2 succeeded
I0620 18:10:26.797761 374244 cli_runner.go:164] Run: docker container inspect no-preload-581163 --format={{.State.Running}}
I0620 18:10:26.842087 374244 cli_runner.go:164] Run: docker container inspect no-preload-581163 --format={{.State.Status}}
I0620 18:10:26.876008 374244 cli_runner.go:164] Run: docker exec no-preload-581163 stat /var/lib/dpkg/alternatives/iptables
I0620 18:10:26.979680 374244 oci.go:144] the created container "no-preload-581163" has a running status.
I0620 18:10:26.979705 374244 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19106-2452/.minikube/machines/no-preload-581163/id_rsa...
I0620 18:10:27.128500 374244 cache.go:157] /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 exists
I0620 18:10:27.128545 374244 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1" took 1.78376557s
I0620 18:10:27.128560 374244 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
I0620 18:10:27.141429 374244 cache.go:157] /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.30.2 exists
I0620 18:10:27.141457 374244 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.30.2" -> "/home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.30.2" took 1.796608371s
I0620 18:10:27.141470 374244 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.30.2 -> /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.30.2 succeeded
I0620 18:10:27.284953 374244 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19106-2452/.minikube/machines/no-preload-581163/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0620 18:10:27.310013 374244 cli_runner.go:164] Run: docker container inspect no-preload-581163 --format={{.State.Status}}
I0620 18:10:27.335828 374244 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0620 18:10:27.335846 374244 kic_runner.go:114] Args: [docker exec --privileged no-preload-581163 chown docker:docker /home/docker/.ssh/authorized_keys]
I0620 18:10:27.470194 374244 cli_runner.go:164] Run: docker container inspect no-preload-581163 --format={{.State.Status}}
I0620 18:10:27.508500 374244 machine.go:94] provisionDockerMachine start ...
I0620 18:10:27.508603 374244 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-581163
I0620 18:10:27.563227 374244 main.go:141] libmachine: Using SSH client type: native
I0620 18:10:27.563490 374244 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2bc0] 0x3e5420 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0620 18:10:27.563499 374244 main.go:141] libmachine: About to run SSH command:
hostname
I0620 18:10:27.564194 374244 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:52676->127.0.0.1:33138: read: connection reset by peer
I0620 18:10:27.587781 374244 cache.go:157] /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.30.2 exists
I0620 18:10:27.587814 374244 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.30.2" -> "/home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.30.2" took 2.243172109s
I0620 18:10:27.587827 374244 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.30.2 -> /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.30.2 succeeded
I0620 18:10:27.691185 374244 cache.go:157] /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.30.2 exists
I0620 18:10:27.691440 374244 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.30.2" -> "/home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.30.2" took 2.347473981s
I0620 18:10:27.691485 374244 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.30.2 -> /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.30.2 succeeded
I0620 18:10:28.909295 374244 cache.go:157] /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.12-0 exists
I0620 18:10:28.909366 374244 cache.go:96] cache image "registry.k8s.io/etcd:3.5.12-0" -> "/home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.12-0" took 3.564854402s
I0620 18:10:28.909386 374244 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.12-0 -> /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.12-0 succeeded
I0620 18:10:28.909403 374244 cache.go:87] Successfully saved all images to host disk.
I0620 18:10:27.933287 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:30.433760 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:30.706785 374244 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-581163
I0620 18:10:30.706819 374244 ubuntu.go:169] provisioning hostname "no-preload-581163"
I0620 18:10:30.706903 374244 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-581163
I0620 18:10:30.725058 374244 main.go:141] libmachine: Using SSH client type: native
I0620 18:10:30.725355 374244 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2bc0] 0x3e5420 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0620 18:10:30.725374 374244 main.go:141] libmachine: About to run SSH command:
sudo hostname no-preload-581163 && echo "no-preload-581163" | sudo tee /etc/hostname
I0620 18:10:30.872291 374244 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-581163
I0620 18:10:30.872378 374244 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-581163
I0620 18:10:30.891250 374244 main.go:141] libmachine: Using SSH client type: native
I0620 18:10:30.891726 374244 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2bc0] 0x3e5420 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0620 18:10:30.891751 374244 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-581163' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-581163/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-581163' | sudo tee -a /etc/hosts;
fi
fi
I0620 18:10:31.023292 374244 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0620 18:10:31.023372 374244 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19106-2452/.minikube CaCertPath:/home/jenkins/minikube-integration/19106-2452/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19106-2452/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19106-2452/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19106-2452/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19106-2452/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19106-2452/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19106-2452/.minikube}
I0620 18:10:31.023419 374244 ubuntu.go:177] setting up certificates
I0620 18:10:31.023437 374244 provision.go:84] configureAuth start
I0620 18:10:31.023498 374244 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-581163
I0620 18:10:31.041564 374244 provision.go:143] copyHostCerts
I0620 18:10:31.041639 374244 exec_runner.go:144] found /home/jenkins/minikube-integration/19106-2452/.minikube/ca.pem, removing ...
I0620 18:10:31.041655 374244 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19106-2452/.minikube/ca.pem
I0620 18:10:31.041735 374244 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19106-2452/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19106-2452/.minikube/ca.pem (1078 bytes)
I0620 18:10:31.041834 374244 exec_runner.go:144] found /home/jenkins/minikube-integration/19106-2452/.minikube/cert.pem, removing ...
I0620 18:10:31.041842 374244 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19106-2452/.minikube/cert.pem
I0620 18:10:31.041870 374244 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19106-2452/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19106-2452/.minikube/cert.pem (1123 bytes)
I0620 18:10:31.041926 374244 exec_runner.go:144] found /home/jenkins/minikube-integration/19106-2452/.minikube/key.pem, removing ...
I0620 18:10:31.041934 374244 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19106-2452/.minikube/key.pem
I0620 18:10:31.041959 374244 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19106-2452/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19106-2452/.minikube/key.pem (1675 bytes)
I0620 18:10:31.042010 374244 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19106-2452/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19106-2452/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19106-2452/.minikube/certs/ca-key.pem org=jenkins.no-preload-581163 san=[127.0.0.1 192.168.76.2 localhost minikube no-preload-581163]
I0620 18:10:31.307877 374244 provision.go:177] copyRemoteCerts
I0620 18:10:31.307948 374244 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0620 18:10:31.308005 374244 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-581163
I0620 18:10:31.325058 374244 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19106-2452/.minikube/machines/no-preload-581163/id_rsa Username:docker}
I0620 18:10:31.420461 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0620 18:10:31.450321 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0620 18:10:31.475252 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0620 18:10:31.504446 374244 provision.go:87] duration metric: took 480.995555ms to configureAuth
I0620 18:10:31.504480 374244 ubuntu.go:193] setting minikube options for container-runtime
I0620 18:10:31.504678 374244 config.go:182] Loaded profile config "no-preload-581163": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.30.2
I0620 18:10:31.504737 374244 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-581163
I0620 18:10:31.523191 374244 main.go:141] libmachine: Using SSH client type: native
I0620 18:10:31.523434 374244 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2bc0] 0x3e5420 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0620 18:10:31.523450 374244 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0620 18:10:31.660375 374244 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0620 18:10:31.660402 374244 ubuntu.go:71] root file system type: overlay
I0620 18:10:31.660545 374244 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
I0620 18:10:31.660650 374244 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-581163
I0620 18:10:31.678609 374244 main.go:141] libmachine: Using SSH client type: native
I0620 18:10:31.678863 374244 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2bc0] 0x3e5420 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0620 18:10:31.678952 374244 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0620 18:10:31.823983 374244 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0620 18:10:31.824089 374244 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-581163
I0620 18:10:31.842053 374244 main.go:141] libmachine: Using SSH client type: native
I0620 18:10:31.842319 374244 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2bc0] 0x3e5420 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0620 18:10:31.842342 374244 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0620 18:10:32.701285 374244 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2024-06-05 11:27:22.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2024-06-20 18:10:31.815399824 +0000
@@ -1,46 +1,49 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service time-set.target
-Wants=network-online.target containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
+Wants=network-online.target
Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutStartSec=0
-RestartSec=2
-Restart=always
+Restart=on-failure
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
+LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0620 18:10:32.701378 374244 machine.go:97] duration metric: took 5.192857729s to provisionDockerMachine
I0620 18:10:32.701415 374244 client.go:171] duration metric: took 7.332128835s to LocalClient.Create
I0620 18:10:32.701445 374244 start.go:167] duration metric: took 7.332198972s to libmachine.API.Create "no-preload-581163"
I0620 18:10:32.701459 374244 start.go:293] postStartSetup for "no-preload-581163" (driver="docker")
I0620 18:10:32.701470 374244 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0620 18:10:32.701562 374244 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0620 18:10:32.701610 374244 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-581163
I0620 18:10:32.718870 374244 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19106-2452/.minikube/machines/no-preload-581163/id_rsa Username:docker}
I0620 18:10:32.816530 374244 ssh_runner.go:195] Run: cat /etc/os-release
I0620 18:10:32.820296 374244 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0620 18:10:32.820330 374244 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0620 18:10:32.820341 374244 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0620 18:10:32.820348 374244 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0620 18:10:32.820357 374244 filesync.go:126] Scanning /home/jenkins/minikube-integration/19106-2452/.minikube/addons for local assets ...
I0620 18:10:32.820423 374244 filesync.go:126] Scanning /home/jenkins/minikube-integration/19106-2452/.minikube/files for local assets ...
I0620 18:10:32.820565 374244 filesync.go:149] local asset: /home/jenkins/minikube-integration/19106-2452/.minikube/files/etc/ssl/certs/77842.pem -> 77842.pem in /etc/ssl/certs
I0620 18:10:32.820681 374244 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0620 18:10:32.830092 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/files/etc/ssl/certs/77842.pem --> /etc/ssl/certs/77842.pem (1708 bytes)
I0620 18:10:32.856387 374244 start.go:296] duration metric: took 154.913455ms for postStartSetup
I0620 18:10:32.856754 374244 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-581163
I0620 18:10:32.873440 374244 profile.go:143] Saving config to /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/config.json ...
I0620 18:10:32.873724 374244 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0620 18:10:32.873778 374244 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-581163
I0620 18:10:32.890811 374244 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19106-2452/.minikube/machines/no-preload-581163/id_rsa Username:docker}
I0620 18:10:32.984061 374244 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0620 18:10:32.988718 374244 start.go:128] duration metric: took 7.624024242s to createHost
I0620 18:10:32.988745 374244 start.go:83] releasing machines lock for "no-preload-581163", held for 7.62417468s
I0620 18:10:32.988816 374244 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-581163
I0620 18:10:33.011565 374244 ssh_runner.go:195] Run: cat /version.json
I0620 18:10:33.011630 374244 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-581163
I0620 18:10:33.011642 374244 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0620 18:10:33.011706 374244 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-581163
I0620 18:10:33.038299 374244 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19106-2452/.minikube/machines/no-preload-581163/id_rsa Username:docker}
I0620 18:10:33.039561 374244 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19106-2452/.minikube/machines/no-preload-581163/id_rsa Username:docker}
I0620 18:10:33.130884 374244 ssh_runner.go:195] Run: systemctl --version
I0620 18:10:33.286901 374244 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0620 18:10:33.291422 374244 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0620 18:10:33.318595 374244 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0620 18:10:33.318678 374244 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0620 18:10:33.350123 374244 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0620 18:10:33.350165 374244 start.go:494] detecting cgroup driver to use...
I0620 18:10:33.350204 374244 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0620 18:10:33.350301 374244 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0620 18:10:33.368279 374244 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0620 18:10:33.379332 374244 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0620 18:10:33.389691 374244 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0620 18:10:33.389763 374244 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0620 18:10:33.400258 374244 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0620 18:10:33.410649 374244 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0620 18:10:33.420781 374244 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0620 18:10:33.433471 374244 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0620 18:10:33.443920 374244 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0620 18:10:33.456471 374244 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0620 18:10:33.467847 374244 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0620 18:10:33.479133 374244 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0620 18:10:33.488228 374244 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0620 18:10:33.497118 374244 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0620 18:10:33.596813 374244 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0620 18:10:33.706015 374244 start.go:494] detecting cgroup driver to use...
I0620 18:10:33.706107 374244 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0620 18:10:33.706185 374244 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0620 18:10:33.722198 374244 cruntime.go:279] skipping containerd shutdown because we are bound to it
I0620 18:10:33.722315 374244 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0620 18:10:33.736876 374244 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0620 18:10:33.756994 374244 ssh_runner.go:195] Run: which cri-dockerd
I0620 18:10:33.761088 374244 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0620 18:10:33.775238 374244 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
I0620 18:10:33.796146 374244 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0620 18:10:33.905504 374244 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0620 18:10:34.022698 374244 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I0620 18:10:34.022856 374244 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I0620 18:10:34.048007 374244 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0620 18:10:34.155194 374244 ssh_runner.go:195] Run: sudo systemctl restart docker
I0620 18:10:34.425354 374244 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket
I0620 18:10:34.440313 374244 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I0620 18:10:34.453182 374244 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I0620 18:10:34.561639 374244 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0620 18:10:34.666404 374244 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0620 18:10:34.759211 374244 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I0620 18:10:34.774003 374244 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I0620 18:10:34.787740 374244 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0620 18:10:34.881296 374244 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service
I0620 18:10:34.978599 374244 start.go:541] Will wait 60s for socket path /var/run/cri-dockerd.sock
I0620 18:10:34.978671 374244 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
I0620 18:10:34.983969 374244 start.go:562] Will wait 60s for crictl version
I0620 18:10:34.984045 374244 ssh_runner.go:195] Run: which crictl
I0620 18:10:34.987753 374244 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0620 18:10:35.041174 374244 start.go:578] Version: 0.1.0
RuntimeName: docker
RuntimeVersion: 26.1.4
RuntimeApiVersion: v1
I0620 18:10:35.041251 374244 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0620 18:10:35.064568 374244 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0620 18:10:35.089453 374244 out.go:204] * Preparing Kubernetes v1.30.2 on Docker 26.1.4 ...
I0620 18:10:35.089577 374244 cli_runner.go:164] Run: docker network inspect no-preload-581163 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0620 18:10:35.111853 374244 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0620 18:10:35.115839 374244 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0620 18:10:35.127737 374244 kubeadm.go:877] updating cluster {Name:no-preload-581163 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718753665-19106@sha256:735aacbd61d487240dc39ba6e4d70dd6ae1ad6181ca2ba092d372605e48ee636 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:no-preload-581163 Namespace:default APIServerHAVIP: APIServerName:minikubeCA API
ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cus
tomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0620 18:10:35.127857 374244 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime docker
I0620 18:10:35.127909 374244 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0620 18:10:32.932786 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:34.932888 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:36.933040 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:35.144645 374244 docker.go:685] Got preloaded images:
I0620 18:10:35.144668 374244 docker.go:691] registry.k8s.io/kube-apiserver:v1.30.2 wasn't preloaded
I0620 18:10:35.144675 374244 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.30.2 registry.k8s.io/kube-controller-manager:v1.30.2 registry.k8s.io/kube-scheduler:v1.30.2 registry.k8s.io/kube-proxy:v1.30.2 registry.k8s.io/pause:3.9 registry.k8s.io/etcd:3.5.12-0 registry.k8s.io/coredns/coredns:v1.11.1 gcr.io/k8s-minikube/storage-provisioner:v5]
I0620 18:10:35.147307 374244 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.12-0
I0620 18:10:35.147597 374244 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.30.2
I0620 18:10:35.147913 374244 image.go:134] retrieving image: registry.k8s.io/coredns/coredns:v1.11.1
I0620 18:10:35.148056 374244 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.30.2
I0620 18:10:35.148356 374244 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0620 18:10:35.148444 374244 image.go:134] retrieving image: registry.k8s.io/pause:3.9
I0620 18:10:35.148473 374244 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.30.2
I0620 18:10:35.148653 374244 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.30.2
I0620 18:10:35.149763 374244 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.12-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.12-0
I0620 18:10:35.150057 374244 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.30.2: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.30.2
I0620 18:10:35.151011 374244 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.30.2: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.30.2
I0620 18:10:35.151070 374244 image.go:177] daemon lookup for registry.k8s.io/pause:3.9: Error response from daemon: No such image: registry.k8s.io/pause:3.9
I0620 18:10:35.151178 374244 image.go:177] daemon lookup for registry.k8s.io/coredns/coredns:v1.11.1: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.11.1
I0620 18:10:35.151252 374244 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0620 18:10:35.151377 374244 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.30.2: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.30.2
I0620 18:10:35.151617 374244 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.30.2: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.30.2
I0620 18:10:35.441081 374244 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns/coredns:v1.11.1
I0620 18:10:35.468314 374244 cache_images.go:116] "registry.k8s.io/coredns/coredns:v1.11.1" needs transfer: "registry.k8s.io/coredns/coredns:v1.11.1" does not exist at hash "2437cf762177702dec2dfe99a09c37427a15af6d9a57c456b65352667c223d93" in container runtime
I0620 18:10:35.468384 374244 docker.go:337] Removing image: registry.k8s.io/coredns/coredns:v1.11.1
I0620 18:10:35.468457 374244 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns/coredns:v1.11.1
I0620 18:10:35.489963 374244 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1
I0620 18:10:35.490066 374244 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_v1.11.1
I0620 18:10:35.493586 374244 ssh_runner.go:352] existence check for /var/lib/minikube/images/coredns_v1.11.1: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_v1.11.1: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/images/coredns_v1.11.1': No such file or directory
I0620 18:10:35.493623 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 --> /var/lib/minikube/images/coredns_v1.11.1 (16488960 bytes)
I0620 18:10:35.528921 374244 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.30.2
I0620 18:10:35.578264 374244 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.30.2" needs transfer: "registry.k8s.io/kube-apiserver:v1.30.2" does not exist at hash "84c601f3f72c87776cdcf77a73329d1f45297e43a92508b0f289fa2fcf8872a0" in container runtime
I0620 18:10:35.578323 374244 docker.go:337] Removing image: registry.k8s.io/kube-apiserver:v1.30.2
I0620 18:10:35.578384 374244 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.30.2
I0620 18:10:35.609392 374244 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.30.2
I0620 18:10:35.609499 374244 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-apiserver_v1.30.2
I0620 18:10:35.616661 374244 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.5.12-0
I0620 18:10:35.631289 374244 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.30.2
I0620 18:10:35.631360 374244 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.30.2
I0620 18:10:35.631657 374244 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.9
I0620 18:10:35.639795 374244 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.30.2
W0620 18:10:35.683378 374244 image.go:265] image gcr.io/k8s-minikube/storage-provisioner:v5 arch mismatch: want arm64 got amd64. fixing
I0620 18:10:35.683665 374244 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0620 18:10:35.714066 374244 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-apiserver_v1.30.2: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-apiserver_v1.30.2: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/images/kube-apiserver_v1.30.2': No such file or directory
I0620 18:10:35.714107 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.30.2 --> /var/lib/minikube/images/kube-apiserver_v1.30.2 (29947392 bytes)
I0620 18:10:35.714181 374244 cache_images.go:116] "registry.k8s.io/etcd:3.5.12-0" needs transfer: "registry.k8s.io/etcd:3.5.12-0" does not exist at hash "014faa467e29798aeef733fe6d1a3b5e382688217b053ad23410e6cccd5d22fd" in container runtime
I0620 18:10:35.714329 374244 docker.go:337] Removing image: registry.k8s.io/etcd:3.5.12-0
I0620 18:10:35.714385 374244 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.5.12-0
I0620 18:10:35.720676 374244 cache_images.go:116] "registry.k8s.io/pause:3.9" needs transfer: "registry.k8s.io/pause:3.9" does not exist at hash "829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e" in container runtime
I0620 18:10:35.720763 374244 docker.go:337] Removing image: registry.k8s.io/pause:3.9
I0620 18:10:35.720821 374244 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.9
I0620 18:10:35.765866 374244 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.30.2" needs transfer: "registry.k8s.io/kube-proxy:v1.30.2" does not exist at hash "66dbb96a9149f69913ff817f696be766014cacdffc2ce0889a76c81165415fae" in container runtime
I0620 18:10:35.765910 374244 docker.go:337] Removing image: registry.k8s.io/kube-proxy:v1.30.2
I0620 18:10:35.765986 374244 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.30.2
I0620 18:10:35.766055 374244 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.30.2" needs transfer: "registry.k8s.io/kube-controller-manager:v1.30.2" does not exist at hash "e1dcc3400d3ea6a268c7ea6e66c3a196703770a8e346b695f54344ab53a47567" in container runtime
I0620 18:10:35.766087 374244 docker.go:337] Removing image: registry.k8s.io/kube-controller-manager:v1.30.2
I0620 18:10:35.766131 374244 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.30.2
I0620 18:10:35.766178 374244 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.30.2" needs transfer: "registry.k8s.io/kube-scheduler:v1.30.2" does not exist at hash "c7dd04b1bafeb51c650fde7f34ac0fdafa96030e77ea7a822135ff302d895dd5" in container runtime
I0620 18:10:35.766228 374244 docker.go:337] Removing image: registry.k8s.io/kube-scheduler:v1.30.2
I0620 18:10:35.766261 374244 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.30.2
I0620 18:10:35.766320 374244 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "66749159455b3f08c8318fe0233122f54d0f5889f9c5fdfb73c3fd9d99895b51" in container runtime
I0620 18:10:35.766342 374244 docker.go:337] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
I0620 18:10:35.766382 374244 ssh_runner.go:195] Run: docker rmi gcr.io/k8s-minikube/storage-provisioner:v5
I0620 18:10:35.766437 374244 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.12-0
I0620 18:10:35.766517 374244 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/etcd_3.5.12-0
I0620 18:10:35.779840 374244 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9
I0620 18:10:35.779966 374244 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/pause_3.9
I0620 18:10:35.849606 374244 ssh_runner.go:352] existence check for /var/lib/minikube/images/etcd_3.5.12-0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/etcd_3.5.12-0: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/images/etcd_3.5.12-0': No such file or directory
I0620 18:10:35.849698 374244 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.30.2
I0620 18:10:35.849803 374244 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.30.2
I0620 18:10:35.849874 374244 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.30.2
I0620 18:10:35.849941 374244 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-proxy_v1.30.2
I0620 18:10:35.849996 374244 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.30.2
I0620 18:10:35.850057 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.12-0 --> /var/lib/minikube/images/etcd_3.5.12-0 (66196992 bytes)
I0620 18:10:35.850119 374244 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5
I0620 18:10:35.850170 374244 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-controller-manager_v1.30.2
I0620 18:10:35.850224 374244 ssh_runner.go:352] existence check for /var/lib/minikube/images/pause_3.9: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/pause_3.9: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/images/pause_3.9': No such file or directory
I0620 18:10:35.850241 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9 --> /var/lib/minikube/images/pause_3.9 (268288 bytes)
I0620 18:10:35.850302 374244 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5
I0620 18:10:35.885054 374244 ssh_runner.go:352] existence check for /var/lib/minikube/images/storage-provisioner_v5: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/images/storage-provisioner_v5': No such file or directory
I0620 18:10:35.885095 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 --> /var/lib/minikube/images/storage-provisioner_v5 (8035840 bytes)
I0620 18:10:35.885180 374244 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-scheduler_v1.30.2: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.30.2: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/images/kube-scheduler_v1.30.2': No such file or directory
I0620 18:10:35.885222 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.30.2 --> /var/lib/minikube/images/kube-scheduler_v1.30.2 (17653248 bytes)
I0620 18:10:35.885271 374244 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-proxy_v1.30.2: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-proxy_v1.30.2: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/images/kube-proxy_v1.30.2': No such file or directory
I0620 18:10:35.885285 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.30.2 --> /var/lib/minikube/images/kube-proxy_v1.30.2 (25635840 bytes)
I0620 18:10:35.885352 374244 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-controller-manager_v1.30.2: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-controller-manager_v1.30.2: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/images/kube-controller-manager_v1.30.2': No such file or directory
I0620 18:10:35.885368 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.30.2 --> /var/lib/minikube/images/kube-controller-manager_v1.30.2 (28379136 bytes)
I0620 18:10:35.940896 374244 docker.go:304] Loading image: /var/lib/minikube/images/pause_3.9
I0620 18:10:35.940962 374244 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/pause_3.9 | docker load"
I0620 18:10:36.140782 374244 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9 from cache
I0620 18:10:36.140843 374244 docker.go:304] Loading image: /var/lib/minikube/images/coredns_v1.11.1
I0620 18:10:36.140864 374244 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/coredns_v1.11.1 | docker load"
I0620 18:10:37.611804 374244 ssh_runner.go:235] Completed: /bin/bash -c "sudo cat /var/lib/minikube/images/coredns_v1.11.1 | docker load": (1.470918939s)
I0620 18:10:37.611829 374244 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 from cache
I0620 18:10:37.611847 374244 docker.go:304] Loading image: /var/lib/minikube/images/storage-provisioner_v5
I0620 18:10:37.611860 374244 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/storage-provisioner_v5 | docker load"
I0620 18:10:37.872572 374244 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 from cache
I0620 18:10:37.872610 374244 docker.go:304] Loading image: /var/lib/minikube/images/kube-scheduler_v1.30.2
I0620 18:10:37.872623 374244 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/kube-scheduler_v1.30.2 | docker load"
I0620 18:10:38.870952 374244 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.30.2 from cache
I0620 18:10:38.871016 374244 docker.go:304] Loading image: /var/lib/minikube/images/kube-apiserver_v1.30.2
I0620 18:10:38.871031 374244 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/kube-apiserver_v1.30.2 | docker load"
I0620 18:10:39.798239 374244 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.30.2 from cache
I0620 18:10:39.798277 374244 docker.go:304] Loading image: /var/lib/minikube/images/kube-proxy_v1.30.2
I0620 18:10:39.798300 374244 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/kube-proxy_v1.30.2 | docker load"
I0620 18:10:38.933262 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:41.441396 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:40.852115 374244 ssh_runner.go:235] Completed: /bin/bash -c "sudo cat /var/lib/minikube/images/kube-proxy_v1.30.2 | docker load": (1.053789832s)
I0620 18:10:40.852144 374244 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.30.2 from cache
I0620 18:10:40.852163 374244 docker.go:304] Loading image: /var/lib/minikube/images/kube-controller-manager_v1.30.2
I0620 18:10:40.852174 374244 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/kube-controller-manager_v1.30.2 | docker load"
I0620 18:10:41.756528 374244 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.30.2 from cache
I0620 18:10:41.756570 374244 docker.go:304] Loading image: /var/lib/minikube/images/etcd_3.5.12-0
I0620 18:10:41.756597 374244 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/etcd_3.5.12-0 | docker load"
I0620 18:10:43.743915 374244 ssh_runner.go:235] Completed: /bin/bash -c "sudo cat /var/lib/minikube/images/etcd_3.5.12-0 | docker load": (1.987292245s)
I0620 18:10:43.743943 374244 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/19106-2452/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.12-0 from cache
I0620 18:10:43.743964 374244 cache_images.go:123] Successfully loaded all cached images
I0620 18:10:43.743969 374244 cache_images.go:92] duration metric: took 8.59928085s to LoadCachedImages
I0620 18:10:43.743987 374244 kubeadm.go:928] updating node { 192.168.76.2 8443 v1.30.2 docker true true} ...
I0620 18:10:43.744096 374244 kubeadm.go:940] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.30.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=no-preload-581163 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.30.2 ClusterName:no-preload-581163 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0620 18:10:43.744170 374244 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0620 18:10:43.793777 374244 cni.go:84] Creating CNI manager for ""
I0620 18:10:43.793802 374244 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0620 18:10:43.793815 374244 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0620 18:10:43.793835 374244 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.30.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-581163 NodeName:no-preload-581163 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/e
tc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0620 18:10:43.793973 374244 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/cri-dockerd.sock
name: "no-preload-581163"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.30.2
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0620 18:10:43.794046 374244 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.2
I0620 18:10:43.803880 374244 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.2: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/binaries/v1.30.2': No such file or directory
Initiating transfer...
I0620 18:10:43.803947 374244 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.2
I0620 18:10:43.813121 374244 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.2/bin/linux/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.2/bin/linux/arm64/kubectl.sha256
I0620 18:10:43.813219 374244 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.2/kubectl
I0620 18:10:43.813803 374244 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.2/bin/linux/arm64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.2/bin/linux/arm64/kubeadm.sha256 -> /home/jenkins/minikube-integration/19106-2452/.minikube/cache/linux/arm64/v1.30.2/kubeadm
I0620 18:10:43.814011 374244 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.2/bin/linux/arm64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.2/bin/linux/arm64/kubelet.sha256 -> /home/jenkins/minikube-integration/19106-2452/.minikube/cache/linux/arm64/v1.30.2/kubelet
I0620 18:10:43.818027 374244 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.2/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.2/kubectl: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.30.2/kubectl': No such file or directory
I0620 18:10:43.818062 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/cache/linux/arm64/v1.30.2/kubectl --> /var/lib/minikube/binaries/v1.30.2/kubectl (49938584 bytes)
I0620 18:10:44.533801 374244 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.2/kubeadm
I0620 18:10:44.538845 374244 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.2/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.2/kubeadm: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.30.2/kubeadm': No such file or directory
I0620 18:10:44.538887 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/cache/linux/arm64/v1.30.2/kubeadm --> /var/lib/minikube/binaries/v1.30.2/kubeadm (48955544 bytes)
I0620 18:10:45.067302 374244 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0620 18:10:45.087469 374244 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.2/kubelet
I0620 18:10:45.094567 374244 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.2/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.2/kubelet: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.30.2/kubelet': No such file or directory
I0620 18:10:45.094612 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/cache/linux/arm64/v1.30.2/kubelet --> /var/lib/minikube/binaries/v1.30.2/kubelet (96463128 bytes)
I0620 18:10:43.954833 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:46.530593 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:45.714593 374244 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0620 18:10:45.724665 374244 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (316 bytes)
I0620 18:10:45.744135 374244 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0620 18:10:45.764040 374244 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2159 bytes)
I0620 18:10:45.783885 374244 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0620 18:10:45.787547 374244 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0620 18:10:45.800633 374244 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0620 18:10:45.903546 374244 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0620 18:10:45.922094 374244 certs.go:68] Setting up /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163 for IP: 192.168.76.2
I0620 18:10:45.922154 374244 certs.go:194] generating shared ca certs ...
I0620 18:10:45.922184 374244 certs.go:226] acquiring lock for ca certs: {Name:mk1f8a102b3933d1e67f4b3f5a97c6bde91190df Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0620 18:10:45.922343 374244 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19106-2452/.minikube/ca.key
I0620 18:10:45.922410 374244 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19106-2452/.minikube/proxy-client-ca.key
I0620 18:10:45.922456 374244 certs.go:256] generating profile certs ...
I0620 18:10:45.922543 374244 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/client.key
I0620 18:10:45.922589 374244 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/client.crt with IP's: []
I0620 18:10:46.306291 374244 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/client.crt ...
I0620 18:10:46.306361 374244 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/client.crt: {Name:mka3b4d553cc119a74ee0a077766b116258d014c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0620 18:10:46.307212 374244 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/client.key ...
I0620 18:10:46.307229 374244 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/client.key: {Name:mkdd6c1442c582cbf1a959446667cfde1a63cf26 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0620 18:10:46.307335 374244 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/apiserver.key.7e6ca817
I0620 18:10:46.307358 374244 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/apiserver.crt.7e6ca817 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.76.2]
I0620 18:10:46.929484 374244 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/apiserver.crt.7e6ca817 ...
I0620 18:10:46.929512 374244 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/apiserver.crt.7e6ca817: {Name:mka752e639e97333050738282c8cc6a508cfb4f0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0620 18:10:46.929675 374244 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/apiserver.key.7e6ca817 ...
I0620 18:10:46.929686 374244 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/apiserver.key.7e6ca817: {Name:mk34759e0fa1614ef83e0929ecfd6a5c5d3db620 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0620 18:10:46.929758 374244 certs.go:381] copying /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/apiserver.crt.7e6ca817 -> /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/apiserver.crt
I0620 18:10:46.929828 374244 certs.go:385] copying /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/apiserver.key.7e6ca817 -> /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/apiserver.key
I0620 18:10:46.929878 374244 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/proxy-client.key
I0620 18:10:46.929894 374244 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/proxy-client.crt with IP's: []
I0620 18:10:47.491736 374244 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/proxy-client.crt ...
I0620 18:10:47.491765 374244 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/proxy-client.crt: {Name:mk1800b16acb258c10e8281e5efbd4d64210a20c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0620 18:10:47.491974 374244 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/proxy-client.key ...
I0620 18:10:47.491997 374244 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/proxy-client.key: {Name:mkb7f0fc5637157da44438ef72e369e98b9b596a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0620 18:10:47.492196 374244 certs.go:484] found cert: /home/jenkins/minikube-integration/19106-2452/.minikube/certs/7784.pem (1338 bytes)
W0620 18:10:47.492242 374244 certs.go:480] ignoring /home/jenkins/minikube-integration/19106-2452/.minikube/certs/7784_empty.pem, impossibly tiny 0 bytes
I0620 18:10:47.492255 374244 certs.go:484] found cert: /home/jenkins/minikube-integration/19106-2452/.minikube/certs/ca-key.pem (1675 bytes)
I0620 18:10:47.492280 374244 certs.go:484] found cert: /home/jenkins/minikube-integration/19106-2452/.minikube/certs/ca.pem (1078 bytes)
I0620 18:10:47.492310 374244 certs.go:484] found cert: /home/jenkins/minikube-integration/19106-2452/.minikube/certs/cert.pem (1123 bytes)
I0620 18:10:47.492335 374244 certs.go:484] found cert: /home/jenkins/minikube-integration/19106-2452/.minikube/certs/key.pem (1675 bytes)
I0620 18:10:47.492385 374244 certs.go:484] found cert: /home/jenkins/minikube-integration/19106-2452/.minikube/files/etc/ssl/certs/77842.pem (1708 bytes)
I0620 18:10:47.493050 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0620 18:10:47.519069 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0620 18:10:47.555847 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0620 18:10:47.586472 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0620 18:10:47.618627 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0620 18:10:47.643882 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0620 18:10:47.670082 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0620 18:10:47.695313 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/profiles/no-preload-581163/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0620 18:10:47.724765 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/files/etc/ssl/certs/77842.pem --> /usr/share/ca-certificates/77842.pem (1708 bytes)
I0620 18:10:47.751788 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0620 18:10:47.776780 374244 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19106-2452/.minikube/certs/7784.pem --> /usr/share/ca-certificates/7784.pem (1338 bytes)
I0620 18:10:47.801639 374244 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0620 18:10:47.819523 374244 ssh_runner.go:195] Run: openssl version
I0620 18:10:47.826694 374244 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/77842.pem && ln -fs /usr/share/ca-certificates/77842.pem /etc/ssl/certs/77842.pem"
I0620 18:10:47.836825 374244 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/77842.pem
I0620 18:10:47.840453 374244 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jun 20 17:09 /usr/share/ca-certificates/77842.pem
I0620 18:10:47.840558 374244 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/77842.pem
I0620 18:10:47.849427 374244 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/77842.pem /etc/ssl/certs/3ec20f2e.0"
I0620 18:10:47.858798 374244 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0620 18:10:47.868718 374244 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0620 18:10:47.872663 374244 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 20 17:02 /usr/share/ca-certificates/minikubeCA.pem
I0620 18:10:47.872746 374244 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0620 18:10:47.879498 374244 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0620 18:10:47.888559 374244 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7784.pem && ln -fs /usr/share/ca-certificates/7784.pem /etc/ssl/certs/7784.pem"
I0620 18:10:47.897827 374244 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7784.pem
I0620 18:10:47.901415 374244 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jun 20 17:09 /usr/share/ca-certificates/7784.pem
I0620 18:10:47.901482 374244 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7784.pem
I0620 18:10:47.908648 374244 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/7784.pem /etc/ssl/certs/51391683.0"
I0620 18:10:47.918121 374244 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0620 18:10:47.921295 374244 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0620 18:10:47.921350 374244 kubeadm.go:391] StartCluster: {Name:no-preload-581163 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718753665-19106@sha256:735aacbd61d487240dc39ba6e4d70dd6ae1ad6181ca2ba092d372605e48ee636 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:no-preload-581163 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0620 18:10:47.921475 374244 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0620 18:10:47.940408 374244 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0620 18:10:47.949541 374244 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0620 18:10:47.958132 374244 kubeadm.go:213] ignoring SystemVerification for kubeadm because of docker driver
I0620 18:10:47.958195 374244 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0620 18:10:47.966769 374244 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0620 18:10:47.966786 374244 kubeadm.go:156] found existing configuration files:
I0620 18:10:47.966850 374244 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0620 18:10:47.975823 374244 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0620 18:10:47.975887 374244 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0620 18:10:47.985511 374244 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0620 18:10:47.994094 374244 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0620 18:10:47.994203 374244 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0620 18:10:48.007107 374244 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0620 18:10:48.018749 374244 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0620 18:10:48.018879 374244 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0620 18:10:48.028858 374244 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0620 18:10:48.039630 374244 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0620 18:10:48.039714 374244 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0620 18:10:48.049455 374244 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0620 18:10:48.099107 374244 kubeadm.go:309] [init] Using Kubernetes version: v1.30.2
I0620 18:10:48.099201 374244 kubeadm.go:309] [preflight] Running pre-flight checks
I0620 18:10:48.143226 374244 kubeadm.go:309] [preflight] The system verification failed. Printing the output from the verification:
I0620 18:10:48.143301 374244 kubeadm.go:309] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1063-aws[0m
I0620 18:10:48.143343 374244 kubeadm.go:309] [0;37mOS[0m: [0;32mLinux[0m
I0620 18:10:48.143394 374244 kubeadm.go:309] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0620 18:10:48.143445 374244 kubeadm.go:309] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0620 18:10:48.143496 374244 kubeadm.go:309] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0620 18:10:48.143545 374244 kubeadm.go:309] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0620 18:10:48.143596 374244 kubeadm.go:309] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0620 18:10:48.143645 374244 kubeadm.go:309] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0620 18:10:48.143692 374244 kubeadm.go:309] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0620 18:10:48.143740 374244 kubeadm.go:309] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0620 18:10:48.143788 374244 kubeadm.go:309] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0620 18:10:48.226760 374244 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0620 18:10:48.226954 374244 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0620 18:10:48.227101 374244 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0620 18:10:48.503785 374244 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0620 18:10:48.508695 374244 out.go:204] - Generating certificates and keys ...
I0620 18:10:48.508886 374244 kubeadm.go:309] [certs] Using existing ca certificate authority
I0620 18:10:48.508994 374244 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0620 18:10:48.745400 374244 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0620 18:10:49.240360 374244 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0620 18:10:49.872758 374244 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0620 18:10:48.932893 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:50.936039 362254 pod_ready.go:102] pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace has status "Ready":"False"
I0620 18:10:50.541579 374244 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0620 18:10:51.158562 374244 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0620 18:10:51.158859 374244 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost no-preload-581163] and IPs [192.168.76.2 127.0.0.1 ::1]
I0620 18:10:51.559660 374244 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0620 18:10:51.560050 374244 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost no-preload-581163] and IPs [192.168.76.2 127.0.0.1 ::1]
I0620 18:10:52.104042 374244 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0620 18:10:53.036546 374244 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0620 18:10:53.726948 374244 kubeadm.go:309] [certs] Generating "sa" key and public key
I0620 18:10:53.736075 374244 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0620 18:10:54.420071 374244 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0620 18:10:52.432238 362254 pod_ready.go:81] duration metric: took 4m0.006216679s for pod "metrics-server-9975d5f86-nxk7p" in "kube-system" namespace to be "Ready" ...
E0620 18:10:52.432430 362254 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0620 18:10:52.432456 362254 pod_ready.go:38] duration metric: took 5m28.676281099s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0620 18:10:52.432502 362254 api_server.go:52] waiting for apiserver process to appear ...
I0620 18:10:52.432625 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0620 18:10:52.455740 362254 logs.go:276] 2 containers: [075e697d07c8 760f9a7d272c]
I0620 18:10:52.455824 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0620 18:10:52.475939 362254 logs.go:276] 2 containers: [25a953b6e46d 81eaddbb4b45]
I0620 18:10:52.476016 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0620 18:10:52.494299 362254 logs.go:276] 2 containers: [5534d9d547fd 7e60d81fce7f]
I0620 18:10:52.494380 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0620 18:10:52.512744 362254 logs.go:276] 2 containers: [4ed5438feb8b ab177be73cae]
I0620 18:10:52.512827 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0620 18:10:52.536524 362254 logs.go:276] 2 containers: [0b32a67571bb c47b7591b320]
I0620 18:10:52.536611 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0620 18:10:52.563389 362254 logs.go:276] 2 containers: [aab72b193950 a4eee0f3ea35]
I0620 18:10:52.563475 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0620 18:10:52.582302 362254 logs.go:276] 0 containers: []
W0620 18:10:52.582326 362254 logs.go:278] No container was found matching "kindnet"
I0620 18:10:52.582383 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0620 18:10:52.622007 362254 logs.go:276] 1 containers: [49efdc60eccc]
I0620 18:10:52.622087 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0620 18:10:52.650609 362254 logs.go:276] 2 containers: [74b467d165b4 16e28ef3ddc9]
I0620 18:10:52.650645 362254 logs.go:123] Gathering logs for kube-apiserver [760f9a7d272c] ...
I0620 18:10:52.650656 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 760f9a7d272c"
I0620 18:10:52.730252 362254 logs.go:123] Gathering logs for kube-proxy [0b32a67571bb] ...
I0620 18:10:52.730312 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0b32a67571bb"
I0620 18:10:52.753952 362254 logs.go:123] Gathering logs for kube-proxy [c47b7591b320] ...
I0620 18:10:52.753983 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c47b7591b320"
I0620 18:10:52.788507 362254 logs.go:123] Gathering logs for kube-controller-manager [aab72b193950] ...
I0620 18:10:52.788535 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 aab72b193950"
I0620 18:10:52.863485 362254 logs.go:123] Gathering logs for container status ...
I0620 18:10:52.863526 362254 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0620 18:10:52.948470 362254 logs.go:123] Gathering logs for describe nodes ...
I0620 18:10:52.948501 362254 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0620 18:10:53.151745 362254 logs.go:123] Gathering logs for kube-apiserver [075e697d07c8] ...
I0620 18:10:53.151776 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 075e697d07c8"
I0620 18:10:53.215264 362254 logs.go:123] Gathering logs for etcd [81eaddbb4b45] ...
I0620 18:10:53.215345 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 81eaddbb4b45"
I0620 18:10:53.278713 362254 logs.go:123] Gathering logs for coredns [5534d9d547fd] ...
I0620 18:10:53.278786 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5534d9d547fd"
I0620 18:10:53.303506 362254 logs.go:123] Gathering logs for storage-provisioner [74b467d165b4] ...
I0620 18:10:53.303539 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 74b467d165b4"
I0620 18:10:53.330579 362254 logs.go:123] Gathering logs for kubelet ...
I0620 18:10:53.330606 362254 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0620 18:10:53.394844 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.695585 1201 reflector.go:138] object-"kube-system"/"metrics-server-token-xd7wc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-xd7wc" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:10:53.395084 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.698643 1201 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:10:53.395315 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.698704 1201 reflector.go:138] object-"kube-system"/"storage-provisioner-token-b9lfw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-b9lfw" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:10:53.395517 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.698918 1201 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:10:53.395728 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.699130 1201 reflector.go:138] object-"kube-system"/"coredns-token-br6s7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-br6s7" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:10:53.395936 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.699223 1201 reflector.go:138] object-"default"/"default-token-9m8v4": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-9m8v4" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:10:53.396154 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.699291 1201 reflector.go:138] object-"kube-system"/"kube-proxy-token-kwb2s": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-kwb2s" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:10:53.402899 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:28 old-k8s-version-577369 kubelet[1201]: E0620 18:05:27.999585 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0620 18:10:53.403705 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:28 old-k8s-version-577369 kubelet[1201]: E0620 18:05:28.453263 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.406169 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:41 old-k8s-version-577369 kubelet[1201]: E0620 18:05:41.280792 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0620 18:10:53.410905 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:46 old-k8s-version-577369 kubelet[1201]: E0620 18:05:46.379764 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0620 18:10:53.411492 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:46 old-k8s-version-577369 kubelet[1201]: E0620 18:05:46.795712 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.411691 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:47 old-k8s-version-577369 kubelet[1201]: E0620 18:05:47.792472 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.412058 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:53 old-k8s-version-577369 kubelet[1201]: E0620 18:05:53.229484 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.412707 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:58 old-k8s-version-577369 kubelet[1201]: E0620 18:05:58.937844 1201 pod_workers.go:191] Error syncing pod 47a50d23-d504-4f3b-a3a1-97513673c10e ("storage-provisioner_kube-system(47a50d23-d504-4f3b-a3a1-97513673c10e)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(47a50d23-d504-4f3b-a3a1-97513673c10e)"
W0620 18:10:53.415122 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:00 old-k8s-version-577369 kubelet[1201]: E0620 18:06:00.973843 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0620 18:10:53.417576 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:06 old-k8s-version-577369 kubelet[1201]: E0620 18:06:06.253227 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0620 18:10:53.417909 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:12 old-k8s-version-577369 kubelet[1201]: E0620 18:06:12.213225 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.418095 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:20 old-k8s-version-577369 kubelet[1201]: E0620 18:06:20.220208 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.420319 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:25 old-k8s-version-577369 kubelet[1201]: E0620 18:06:25.880053 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0620 18:10:53.420506 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:34 old-k8s-version-577369 kubelet[1201]: E0620 18:06:34.213970 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.420708 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:39 old-k8s-version-577369 kubelet[1201]: E0620 18:06:39.231731 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.422875 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:49 old-k8s-version-577369 kubelet[1201]: E0620 18:06:49.256445 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0620 18:10:53.423094 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:53 old-k8s-version-577369 kubelet[1201]: E0620 18:06:53.229559 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.423282 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:02 old-k8s-version-577369 kubelet[1201]: E0620 18:07:02.213019 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.425508 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:07 old-k8s-version-577369 kubelet[1201]: E0620 18:07:07.909458 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0620 18:10:53.425695 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:17 old-k8s-version-577369 kubelet[1201]: E0620 18:07:17.213306 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.425892 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:20 old-k8s-version-577369 kubelet[1201]: E0620 18:07:20.213221 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.426129 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:32 old-k8s-version-577369 kubelet[1201]: E0620 18:07:32.213001 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.426358 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:35 old-k8s-version-577369 kubelet[1201]: E0620 18:07:35.214923 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.426574 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:47 old-k8s-version-577369 kubelet[1201]: E0620 18:07:47.215155 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.426803 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:50 old-k8s-version-577369 kubelet[1201]: E0620 18:07:50.213002 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.427024 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:02 old-k8s-version-577369 kubelet[1201]: E0620 18:08:02.213224 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.427277 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:04 old-k8s-version-577369 kubelet[1201]: E0620 18:08:04.224800 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.429643 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:13 old-k8s-version-577369 kubelet[1201]: E0620 18:08:13.248654 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0620 18:10:53.429866 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:18 old-k8s-version-577369 kubelet[1201]: E0620 18:08:18.213216 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.430079 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:24 old-k8s-version-577369 kubelet[1201]: E0620 18:08:24.213044 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.432435 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:31 old-k8s-version-577369 kubelet[1201]: E0620 18:08:31.863326 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0620 18:10:53.432690 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:35 old-k8s-version-577369 kubelet[1201]: E0620 18:08:35.226288 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.432906 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:44 old-k8s-version-577369 kubelet[1201]: E0620 18:08:44.214061 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.433095 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:46 old-k8s-version-577369 kubelet[1201]: E0620 18:08:46.213051 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.433312 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:57 old-k8s-version-577369 kubelet[1201]: E0620 18:08:57.213817 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.434754 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:58 old-k8s-version-577369 kubelet[1201]: E0620 18:08:58.213216 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.434962 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:11 old-k8s-version-577369 kubelet[1201]: E0620 18:09:11.219178 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.435211 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:11 old-k8s-version-577369 kubelet[1201]: E0620 18:09:11.223804 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.435405 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:25 old-k8s-version-577369 kubelet[1201]: E0620 18:09:25.213628 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.435612 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:25 old-k8s-version-577369 kubelet[1201]: E0620 18:09:25.220085 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.435796 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:37 old-k8s-version-577369 kubelet[1201]: E0620 18:09:37.218633 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.435993 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:39 old-k8s-version-577369 kubelet[1201]: E0620 18:09:39.213129 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.436176 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:49 old-k8s-version-577369 kubelet[1201]: E0620 18:09:49.212880 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.436373 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:52 old-k8s-version-577369 kubelet[1201]: E0620 18:09:52.213161 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.436556 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:01 old-k8s-version-577369 kubelet[1201]: E0620 18:10:01.220058 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.436792 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:07 old-k8s-version-577369 kubelet[1201]: E0620 18:10:07.213133 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.436983 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:16 old-k8s-version-577369 kubelet[1201]: E0620 18:10:16.212946 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.437180 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:18 old-k8s-version-577369 kubelet[1201]: E0620 18:10:18.220165 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.437378 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:31 old-k8s-version-577369 kubelet[1201]: E0620 18:10:31.213199 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.437565 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:31 old-k8s-version-577369 kubelet[1201]: E0620 18:10:31.215427 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.443097 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:42 old-k8s-version-577369 kubelet[1201]: E0620 18:10:42.213713 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.443303 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:43 old-k8s-version-577369 kubelet[1201]: E0620 18:10:43.221571 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0620 18:10:53.443318 362254 logs.go:123] Gathering logs for etcd [25a953b6e46d] ...
I0620 18:10:53.443331 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25a953b6e46d"
I0620 18:10:53.484821 362254 logs.go:123] Gathering logs for storage-provisioner [16e28ef3ddc9] ...
I0620 18:10:53.484852 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 16e28ef3ddc9"
I0620 18:10:53.512687 362254 logs.go:123] Gathering logs for Docker ...
I0620 18:10:53.512715 362254 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0620 18:10:53.542148 362254 logs.go:123] Gathering logs for kubernetes-dashboard [49efdc60eccc] ...
I0620 18:10:53.542183 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49efdc60eccc"
I0620 18:10:53.570140 362254 logs.go:123] Gathering logs for dmesg ...
I0620 18:10:53.570171 362254 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0620 18:10:53.588771 362254 logs.go:123] Gathering logs for coredns [7e60d81fce7f] ...
I0620 18:10:53.588800 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7e60d81fce7f"
I0620 18:10:53.615089 362254 logs.go:123] Gathering logs for kube-scheduler [4ed5438feb8b] ...
I0620 18:10:53.615127 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4ed5438feb8b"
I0620 18:10:53.647925 362254 logs.go:123] Gathering logs for kube-scheduler [ab177be73cae] ...
I0620 18:10:53.647953 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ab177be73cae"
I0620 18:10:53.678028 362254 logs.go:123] Gathering logs for kube-controller-manager [a4eee0f3ea35] ...
I0620 18:10:53.678058 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a4eee0f3ea35"
I0620 18:10:53.741842 362254 out.go:304] Setting ErrFile to fd 2...
I0620 18:10:53.741873 362254 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0620 18:10:53.741941 362254 out.go:239] X Problems detected in kubelet:
W0620 18:10:53.741956 362254 out.go:239] Jun 20 18:10:18 old-k8s-version-577369 kubelet[1201]: E0620 18:10:18.220165 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.741969 362254 out.go:239] Jun 20 18:10:31 old-k8s-version-577369 kubelet[1201]: E0620 18:10:31.213199 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.741977 362254 out.go:239] Jun 20 18:10:31 old-k8s-version-577369 kubelet[1201]: E0620 18:10:31.215427 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.741984 362254 out.go:239] Jun 20 18:10:42 old-k8s-version-577369 kubelet[1201]: E0620 18:10:42.213713 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:10:53.742104 362254 out.go:239] Jun 20 18:10:43 old-k8s-version-577369 kubelet[1201]: E0620 18:10:43.221571 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0620 18:10:53.742120 362254 out.go:304] Setting ErrFile to fd 2...
I0620 18:10:53.742126 362254 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0620 18:10:55.972976 374244 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0620 18:10:56.437195 374244 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0620 18:10:56.906582 374244 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0620 18:10:58.378177 374244 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0620 18:10:58.378517 374244 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0620 18:10:58.381887 374244 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0620 18:10:58.384376 374244 out.go:204] - Booting up control plane ...
I0620 18:10:58.384477 374244 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0620 18:10:58.384555 374244 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0620 18:10:58.385260 374244 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0620 18:10:58.396909 374244 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0620 18:10:58.398528 374244 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0620 18:10:58.398914 374244 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0620 18:10:58.511469 374244 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0620 18:10:58.511555 374244 kubeadm.go:309] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s
I0620 18:10:59.507131 374244 kubeadm.go:309] [kubelet-check] The kubelet is healthy after 1.001495822s
I0620 18:10:59.507223 374244 kubeadm.go:309] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0620 18:11:03.744154 362254 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0620 18:11:03.759975 362254 api_server.go:72] duration metric: took 5m53.685709451s to wait for apiserver process to appear ...
I0620 18:11:03.759998 362254 api_server.go:88] waiting for apiserver healthz status ...
I0620 18:11:03.760078 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0620 18:11:03.798135 362254 logs.go:276] 2 containers: [075e697d07c8 760f9a7d272c]
I0620 18:11:03.798211 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0620 18:11:03.831434 362254 logs.go:276] 2 containers: [25a953b6e46d 81eaddbb4b45]
I0620 18:11:03.831511 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0620 18:11:03.861101 362254 logs.go:276] 2 containers: [5534d9d547fd 7e60d81fce7f]
I0620 18:11:03.861185 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0620 18:11:03.905927 362254 logs.go:276] 2 containers: [4ed5438feb8b ab177be73cae]
I0620 18:11:03.906011 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0620 18:11:03.944486 362254 logs.go:276] 2 containers: [0b32a67571bb c47b7591b320]
I0620 18:11:03.944579 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0620 18:11:03.975451 362254 logs.go:276] 2 containers: [aab72b193950 a4eee0f3ea35]
I0620 18:11:03.975533 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0620 18:11:03.998509 362254 logs.go:276] 0 containers: []
W0620 18:11:03.998529 362254 logs.go:278] No container was found matching "kindnet"
I0620 18:11:03.998586 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0620 18:11:04.031360 362254 logs.go:276] 1 containers: [49efdc60eccc]
I0620 18:11:04.031444 362254 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0620 18:11:04.057548 362254 logs.go:276] 2 containers: [74b467d165b4 16e28ef3ddc9]
I0620 18:11:04.057630 362254 logs.go:123] Gathering logs for kubelet ...
I0620 18:11:04.057656 362254 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0620 18:11:04.137517 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.695585 1201 reflector.go:138] object-"kube-system"/"metrics-server-token-xd7wc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-xd7wc" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:11:04.137802 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.698643 1201 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:11:04.138082 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.698704 1201 reflector.go:138] object-"kube-system"/"storage-provisioner-token-b9lfw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-b9lfw" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:11:04.138316 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.698918 1201 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:11:04.138554 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.699130 1201 reflector.go:138] object-"kube-system"/"coredns-token-br6s7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-br6s7" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:11:04.138788 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.699223 1201 reflector.go:138] object-"default"/"default-token-9m8v4": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-9m8v4" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:11:04.139088 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:23 old-k8s-version-577369 kubelet[1201]: E0620 18:05:23.699291 1201 reflector.go:138] object-"kube-system"/"kube-proxy-token-kwb2s": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-kwb2s" is forbidden: User "system:node:old-k8s-version-577369" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-577369' and this object
W0620 18:11:04.145789 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:28 old-k8s-version-577369 kubelet[1201]: E0620 18:05:27.999585 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0620 18:11:04.146521 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:28 old-k8s-version-577369 kubelet[1201]: E0620 18:05:28.453263 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.149146 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:41 old-k8s-version-577369 kubelet[1201]: E0620 18:05:41.280792 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0620 18:11:04.155757 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:46 old-k8s-version-577369 kubelet[1201]: E0620 18:05:46.379764 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0620 18:11:04.156394 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:46 old-k8s-version-577369 kubelet[1201]: E0620 18:05:46.795712 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.156632 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:47 old-k8s-version-577369 kubelet[1201]: E0620 18:05:47.792472 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.157039 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:53 old-k8s-version-577369 kubelet[1201]: E0620 18:05:53.229484 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.157839 362254 logs.go:138] Found kubelet problem: Jun 20 18:05:58 old-k8s-version-577369 kubelet[1201]: E0620 18:05:58.937844 1201 pod_workers.go:191] Error syncing pod 47a50d23-d504-4f3b-a3a1-97513673c10e ("storage-provisioner_kube-system(47a50d23-d504-4f3b-a3a1-97513673c10e)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(47a50d23-d504-4f3b-a3a1-97513673c10e)"
W0620 18:11:04.160409 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:00 old-k8s-version-577369 kubelet[1201]: E0620 18:06:00.973843 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0620 18:11:04.162846 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:06 old-k8s-version-577369 kubelet[1201]: E0620 18:06:06.253227 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0620 18:11:04.163226 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:12 old-k8s-version-577369 kubelet[1201]: E0620 18:06:12.213225 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.163438 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:20 old-k8s-version-577369 kubelet[1201]: E0620 18:06:20.220208 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.165695 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:25 old-k8s-version-577369 kubelet[1201]: E0620 18:06:25.880053 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0620 18:11:04.165909 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:34 old-k8s-version-577369 kubelet[1201]: E0620 18:06:34.213970 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.166131 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:39 old-k8s-version-577369 kubelet[1201]: E0620 18:06:39.231731 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.168276 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:49 old-k8s-version-577369 kubelet[1201]: E0620 18:06:49.256445 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0620 18:11:04.168505 362254 logs.go:138] Found kubelet problem: Jun 20 18:06:53 old-k8s-version-577369 kubelet[1201]: E0620 18:06:53.229559 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.168720 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:02 old-k8s-version-577369 kubelet[1201]: E0620 18:07:02.213019 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.170964 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:07 old-k8s-version-577369 kubelet[1201]: E0620 18:07:07.909458 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0620 18:11:04.176940 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:17 old-k8s-version-577369 kubelet[1201]: E0620 18:07:17.213306 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.177172 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:20 old-k8s-version-577369 kubelet[1201]: E0620 18:07:20.213221 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.177380 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:32 old-k8s-version-577369 kubelet[1201]: E0620 18:07:32.213001 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.177601 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:35 old-k8s-version-577369 kubelet[1201]: E0620 18:07:35.214923 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.177809 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:47 old-k8s-version-577369 kubelet[1201]: E0620 18:07:47.215155 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.178032 362254 logs.go:138] Found kubelet problem: Jun 20 18:07:50 old-k8s-version-577369 kubelet[1201]: E0620 18:07:50.213002 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.178241 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:02 old-k8s-version-577369 kubelet[1201]: E0620 18:08:02.213224 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.178468 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:04 old-k8s-version-577369 kubelet[1201]: E0620 18:08:04.224800 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.180581 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:13 old-k8s-version-577369 kubelet[1201]: E0620 18:08:13.248654 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0620 18:11:04.180807 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:18 old-k8s-version-577369 kubelet[1201]: E0620 18:08:18.213216 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.181015 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:24 old-k8s-version-577369 kubelet[1201]: E0620 18:08:24.213044 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.186304 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:31 old-k8s-version-577369 kubelet[1201]: E0620 18:08:31.863326 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0620 18:11:04.186572 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:35 old-k8s-version-577369 kubelet[1201]: E0620 18:08:35.226288 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.186801 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:44 old-k8s-version-577369 kubelet[1201]: E0620 18:08:44.214061 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.187082 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:46 old-k8s-version-577369 kubelet[1201]: E0620 18:08:46.213051 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.187306 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:57 old-k8s-version-577369 kubelet[1201]: E0620 18:08:57.213817 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.187514 362254 logs.go:138] Found kubelet problem: Jun 20 18:08:58 old-k8s-version-577369 kubelet[1201]: E0620 18:08:58.213216 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.187732 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:11 old-k8s-version-577369 kubelet[1201]: E0620 18:09:11.219178 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.187954 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:11 old-k8s-version-577369 kubelet[1201]: E0620 18:09:11.223804 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.188162 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:25 old-k8s-version-577369 kubelet[1201]: E0620 18:09:25.213628 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.188387 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:25 old-k8s-version-577369 kubelet[1201]: E0620 18:09:25.220085 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.188608 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:37 old-k8s-version-577369 kubelet[1201]: E0620 18:09:37.218633 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.188830 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:39 old-k8s-version-577369 kubelet[1201]: E0620 18:09:39.213129 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.189038 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:49 old-k8s-version-577369 kubelet[1201]: E0620 18:09:49.212880 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.189258 362254 logs.go:138] Found kubelet problem: Jun 20 18:09:52 old-k8s-version-577369 kubelet[1201]: E0620 18:09:52.213161 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.189468 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:01 old-k8s-version-577369 kubelet[1201]: E0620 18:10:01.220058 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.189694 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:07 old-k8s-version-577369 kubelet[1201]: E0620 18:10:07.213133 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.189902 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:16 old-k8s-version-577369 kubelet[1201]: E0620 18:10:16.212946 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.190121 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:18 old-k8s-version-577369 kubelet[1201]: E0620 18:10:18.220165 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.190341 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:31 old-k8s-version-577369 kubelet[1201]: E0620 18:10:31.213199 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.190550 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:31 old-k8s-version-577369 kubelet[1201]: E0620 18:10:31.215427 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.190773 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:42 old-k8s-version-577369 kubelet[1201]: E0620 18:10:42.213713 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.193468 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:43 old-k8s-version-577369 kubelet[1201]: E0620 18:10:43.221571 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.193769 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:55 old-k8s-version-577369 kubelet[1201]: E0620 18:10:55.213780 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:04.195893 362254 logs.go:138] Found kubelet problem: Jun 20 18:10:56 old-k8s-version-577369 kubelet[1201]: E0620 18:10:56.254103 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
I0620 18:11:04.195923 362254 logs.go:123] Gathering logs for describe nodes ...
I0620 18:11:04.195949 362254 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0620 18:11:04.426160 362254 logs.go:123] Gathering logs for kube-apiserver [760f9a7d272c] ...
I0620 18:11:04.426342 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 760f9a7d272c"
I0620 18:11:04.528343 362254 logs.go:123] Gathering logs for kube-scheduler [ab177be73cae] ...
I0620 18:11:04.528424 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ab177be73cae"
I0620 18:11:04.573441 362254 logs.go:123] Gathering logs for storage-provisioner [16e28ef3ddc9] ...
I0620 18:11:04.573520 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 16e28ef3ddc9"
I0620 18:11:04.632739 362254 logs.go:123] Gathering logs for Docker ...
I0620 18:11:04.632808 362254 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0620 18:11:04.676322 362254 logs.go:123] Gathering logs for kube-apiserver [075e697d07c8] ...
I0620 18:11:04.676396 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 075e697d07c8"
I0620 18:11:04.751250 362254 logs.go:123] Gathering logs for etcd [25a953b6e46d] ...
I0620 18:11:04.751327 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25a953b6e46d"
I0620 18:11:04.825564 362254 logs.go:123] Gathering logs for kube-controller-manager [a4eee0f3ea35] ...
I0620 18:11:04.825644 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a4eee0f3ea35"
I0620 18:11:04.916404 362254 logs.go:123] Gathering logs for dmesg ...
I0620 18:11:04.916479 362254 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0620 18:11:04.944002 362254 logs.go:123] Gathering logs for etcd [81eaddbb4b45] ...
I0620 18:11:04.944073 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 81eaddbb4b45"
I0620 18:11:04.995804 362254 logs.go:123] Gathering logs for coredns [5534d9d547fd] ...
I0620 18:11:04.995893 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5534d9d547fd"
I0620 18:11:05.044664 362254 logs.go:123] Gathering logs for kube-scheduler [4ed5438feb8b] ...
I0620 18:11:05.044747 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4ed5438feb8b"
I0620 18:11:05.082366 362254 logs.go:123] Gathering logs for kube-proxy [0b32a67571bb] ...
I0620 18:11:05.082463 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0b32a67571bb"
I0620 18:11:05.141372 362254 logs.go:123] Gathering logs for kubernetes-dashboard [49efdc60eccc] ...
I0620 18:11:05.141442 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 49efdc60eccc"
I0620 18:11:05.173015 362254 logs.go:123] Gathering logs for storage-provisioner [74b467d165b4] ...
I0620 18:11:05.173101 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 74b467d165b4"
I0620 18:11:05.211503 362254 logs.go:123] Gathering logs for coredns [7e60d81fce7f] ...
I0620 18:11:05.211569 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7e60d81fce7f"
I0620 18:11:05.253118 362254 logs.go:123] Gathering logs for kube-proxy [c47b7591b320] ...
I0620 18:11:05.253195 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c47b7591b320"
I0620 18:11:05.285055 362254 logs.go:123] Gathering logs for kube-controller-manager [aab72b193950] ...
I0620 18:11:05.285121 362254 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 aab72b193950"
I0620 18:11:05.348716 362254 logs.go:123] Gathering logs for container status ...
I0620 18:11:05.348790 362254 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0620 18:11:05.447039 362254 out.go:304] Setting ErrFile to fd 2...
I0620 18:11:05.447134 362254 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0620 18:11:05.447272 362254 out.go:239] X Problems detected in kubelet:
W0620 18:11:05.447326 362254 out.go:239] Jun 20 18:10:31 old-k8s-version-577369 kubelet[1201]: E0620 18:10:31.215427 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:05.447358 362254 out.go:239] Jun 20 18:10:42 old-k8s-version-577369 kubelet[1201]: E0620 18:10:42.213713 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:05.447432 362254 out.go:239] Jun 20 18:10:43 old-k8s-version-577369 kubelet[1201]: E0620 18:10:43.221571 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0620 18:11:05.447521 362254 out.go:239] Jun 20 18:10:55 old-k8s-version-577369 kubelet[1201]: E0620 18:10:55.213780 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0620 18:11:05.447602 362254 out.go:239] Jun 20 18:10:56 old-k8s-version-577369 kubelet[1201]: E0620 18:10:56.254103 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
I0620 18:11:05.447662 362254 out.go:304] Setting ErrFile to fd 2...
I0620 18:11:05.447707 362254 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0620 18:11:07.508615 374244 kubeadm.go:309] [api-check] The API server is healthy after 8.001393188s
I0620 18:11:07.528898 374244 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0620 18:11:07.542411 374244 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0620 18:11:07.570599 374244 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0620 18:11:07.570795 374244 kubeadm.go:309] [mark-control-plane] Marking the node no-preload-581163 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0620 18:11:07.582943 374244 kubeadm.go:309] [bootstrap-token] Using token: uemerr.735al9maxxqt1jtu
I0620 18:11:07.584864 374244 out.go:204] - Configuring RBAC rules ...
I0620 18:11:07.584982 374244 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0620 18:11:07.614516 374244 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0620 18:11:07.634177 374244 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0620 18:11:07.639738 374244 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0620 18:11:07.645384 374244 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0620 18:11:07.650286 374244 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0620 18:11:07.918361 374244 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0620 18:11:08.396640 374244 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0620 18:11:08.922604 374244 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0620 18:11:08.923693 374244 kubeadm.go:309]
I0620 18:11:08.923775 374244 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0620 18:11:08.923785 374244 kubeadm.go:309]
I0620 18:11:08.923872 374244 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0620 18:11:08.923877 374244 kubeadm.go:309]
I0620 18:11:08.923909 374244 kubeadm.go:309] mkdir -p $HOME/.kube
I0620 18:11:08.923974 374244 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0620 18:11:08.924029 374244 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0620 18:11:08.924034 374244 kubeadm.go:309]
I0620 18:11:08.924095 374244 kubeadm.go:309] Alternatively, if you are the root user, you can run:
I0620 18:11:08.924103 374244 kubeadm.go:309]
I0620 18:11:08.924164 374244 kubeadm.go:309] export KUBECONFIG=/etc/kubernetes/admin.conf
I0620 18:11:08.924171 374244 kubeadm.go:309]
I0620 18:11:08.924229 374244 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0620 18:11:08.924330 374244 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0620 18:11:08.924397 374244 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0620 18:11:08.924401 374244 kubeadm.go:309]
I0620 18:11:08.924481 374244 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0620 18:11:08.924575 374244 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0620 18:11:08.924582 374244 kubeadm.go:309]
I0620 18:11:08.924681 374244 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token uemerr.735al9maxxqt1jtu \
I0620 18:11:08.924794 374244 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:56a399a874c06050b1e615cba34cc00267ff85569d8529edb2baa3c00e1104f2 \
I0620 18:11:08.924820 374244 kubeadm.go:309] --control-plane
I0620 18:11:08.924825 374244 kubeadm.go:309]
I0620 18:11:08.924913 374244 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0620 18:11:08.924924 374244 kubeadm.go:309]
I0620 18:11:08.925019 374244 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token uemerr.735al9maxxqt1jtu \
I0620 18:11:08.925135 374244 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:56a399a874c06050b1e615cba34cc00267ff85569d8529edb2baa3c00e1104f2
I0620 18:11:08.929657 374244 kubeadm.go:309] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1063-aws\n", err: exit status 1
I0620 18:11:08.929786 374244 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0620 18:11:08.929815 374244 cni.go:84] Creating CNI manager for ""
I0620 18:11:08.929833 374244 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0620 18:11:08.933051 374244 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0620 18:11:08.935242 374244 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0620 18:11:08.951748 374244 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)
I0620 18:11:08.975720 374244 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0620 18:11:08.975852 374244 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0620 18:11:08.975949 374244 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes no-preload-581163 minikube.k8s.io/updated_at=2024_06_20T18_11_08_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=a5bfa5828b76fe92a3c5f89a54d8c76f6b5f3f8b minikube.k8s.io/name=no-preload-581163 minikube.k8s.io/primary=true
I0620 18:11:09.129104 374244 ops.go:34] apiserver oom_adj: -16
I0620 18:11:09.129272 374244 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0620 18:11:09.630249 374244 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0620 18:11:10.129328 374244 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0620 18:11:10.629341 374244 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0620 18:11:11.130228 374244 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0620 18:11:11.630189 374244 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0620 18:11:12.129358 374244 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0620 18:11:12.630148 374244 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0620 18:11:13.129782 374244 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0620 18:11:13.629789 374244 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0620 18:11:14.130014 374244 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0620 18:11:14.629342 374244 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0620 18:11:15.129853 374244 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0620 18:11:15.449472 362254 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0620 18:11:15.463258 362254 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0620 18:11:15.465704 362254 out.go:177]
W0620 18:11:15.467872 362254 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0620 18:11:15.467924 362254 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0620 18:11:15.467944 362254 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0620 18:11:15.467950 362254 out.go:239] *
W0620 18:11:15.468829 362254 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0620 18:11:15.471344 362254 out.go:177]
==> Docker <==
Jun 20 18:06:00 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:06:00.970786627Z" level=info msg="Attempting next endpoint for pull after error: [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" spanID=e36cb4e713c49d31 traceID=65b672c9fba7c4e212bf9cf2cb7a8f91
Jun 20 18:06:06 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:06:06.244903113Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" spanID=6203455aaf42e303 traceID=e03707f105c39e77e4cabf556210b18b
Jun 20 18:06:06 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:06:06.244955411Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" spanID=6203455aaf42e303 traceID=e03707f105c39e77e4cabf556210b18b
Jun 20 18:06:06 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:06:06.252543250Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" spanID=6203455aaf42e303 traceID=e03707f105c39e77e4cabf556210b18b
Jun 20 18:06:25 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:06:25.589619234Z" level=warning msg="reference for unknown type: application/vnd.docker.distribution.manifest.v1+prettyjws" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=4ca7d1788d77f4ca traceID=4a76ee043bab3c9d153a5e459672ebaf
Jun 20 18:06:25 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:06:25.871198138Z" level=warning msg="Error persisting manifest" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" error="error committing manifest to content store: commit failed: unexpected commit digest sha256:eaee4c452b076cdb05b391ed7e75e1ad0aca136665875ab5d7e2f3d9f4675769, expected sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb: failed precondition" remote="registry.k8s.io/echoserver:1.4" spanID=4ca7d1788d77f4ca traceID=4a76ee043bab3c9d153a5e459672ebaf
Jun 20 18:06:25 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:06:25.871531177Z" level=warning msg="[DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=4ca7d1788d77f4ca traceID=4a76ee043bab3c9d153a5e459672ebaf
Jun 20 18:06:25 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:06:25.871667904Z" level=info msg="Attempting next endpoint for pull after error: [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" spanID=4ca7d1788d77f4ca traceID=4a76ee043bab3c9d153a5e459672ebaf
Jun 20 18:06:49 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:06:49.252253313Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" spanID=20f97471919c74f4 traceID=e84eb518076b83dd07a97acc77964edf
Jun 20 18:06:49 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:06:49.252370446Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" spanID=20f97471919c74f4 traceID=e84eb518076b83dd07a97acc77964edf
Jun 20 18:06:49 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:06:49.254853467Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" spanID=20f97471919c74f4 traceID=e84eb518076b83dd07a97acc77964edf
Jun 20 18:07:07 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:07:07.608620779Z" level=warning msg="reference for unknown type: application/vnd.docker.distribution.manifest.v1+prettyjws" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=504b3a75c1c5aac3 traceID=c2e9eb90def83472d4fa1710813ccdc0
Jun 20 18:07:07 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:07:07.906557281Z" level=warning msg="Error persisting manifest" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" error="error committing manifest to content store: commit failed: unexpected commit digest sha256:eaee4c452b076cdb05b391ed7e75e1ad0aca136665875ab5d7e2f3d9f4675769, expected sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb: failed precondition" remote="registry.k8s.io/echoserver:1.4" spanID=504b3a75c1c5aac3 traceID=c2e9eb90def83472d4fa1710813ccdc0
Jun 20 18:07:07 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:07:07.906705183Z" level=warning msg="[DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=504b3a75c1c5aac3 traceID=c2e9eb90def83472d4fa1710813ccdc0
Jun 20 18:07:07 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:07:07.906748768Z" level=info msg="Attempting next endpoint for pull after error: [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" spanID=504b3a75c1c5aac3 traceID=c2e9eb90def83472d4fa1710813ccdc0
Jun 20 18:08:13 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:08:13.243704717Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" spanID=e2bad89695e6bfc3 traceID=8c068e817337201bf3580c14bd541595
Jun 20 18:08:13 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:08:13.243762397Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" spanID=e2bad89695e6bfc3 traceID=8c068e817337201bf3580c14bd541595
Jun 20 18:08:13 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:08:13.247742568Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" spanID=e2bad89695e6bfc3 traceID=8c068e817337201bf3580c14bd541595
Jun 20 18:08:31 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:08:31.578290311Z" level=warning msg="reference for unknown type: application/vnd.docker.distribution.manifest.v1+prettyjws" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=3fee327a8a61db08 traceID=63160869622b13f7e28113eb3e6382e1
Jun 20 18:08:31 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:08:31.860162017Z" level=warning msg="Error persisting manifest" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" error="error committing manifest to content store: commit failed: unexpected commit digest sha256:eaee4c452b076cdb05b391ed7e75e1ad0aca136665875ab5d7e2f3d9f4675769, expected sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb: failed precondition" remote="registry.k8s.io/echoserver:1.4" spanID=3fee327a8a61db08 traceID=63160869622b13f7e28113eb3e6382e1
Jun 20 18:08:31 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:08:31.860304602Z" level=warning msg="[DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=3fee327a8a61db08 traceID=63160869622b13f7e28113eb3e6382e1
Jun 20 18:08:31 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:08:31.860341976Z" level=info msg="Attempting next endpoint for pull after error: [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" spanID=3fee327a8a61db08 traceID=63160869622b13f7e28113eb3e6382e1
Jun 20 18:10:56 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:10:56.249842714Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" spanID=8470b7b199957dda traceID=e4f7af4e8b7d445e435c474bce36f67f
Jun 20 18:10:56 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:10:56.249924058Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" spanID=8470b7b199957dda traceID=e4f7af4e8b7d445e435c474bce36f67f
Jun 20 18:10:56 old-k8s-version-577369 dockerd[971]: time="2024-06-20T18:10:56.253230104Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" spanID=8470b7b199957dda traceID=e4f7af4e8b7d445e435c474bce36f67f
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
74b467d165b47 ba04bb24b9575 5 minutes ago Running storage-provisioner 2 4e386924a6d6e storage-provisioner
49efdc60eccce kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93 5 minutes ago Running kubernetes-dashboard 0 38864320d656e kubernetes-dashboard-cd95d586-l4fmb
0b32a67571bbd 25a5233254979 5 minutes ago Running kube-proxy 1 3e56f33e55ff4 kube-proxy-qh57b
16e28ef3ddc9f ba04bb24b9575 5 minutes ago Exited storage-provisioner 1 4e386924a6d6e storage-provisioner
0de6cd1876d18 1611cd07b61d5 5 minutes ago Running busybox 1 e217c7b51c650 busybox
5534d9d547fd5 db91994f4ee8f 5 minutes ago Running coredns 1 e532ce493eb98 coredns-74ff55c5b-92t8n
25a953b6e46d0 05b738aa1bc63 6 minutes ago Running etcd 1 1871a1e6580fe etcd-old-k8s-version-577369
4ed5438feb8b3 e7605f88f17d6 6 minutes ago Running kube-scheduler 1 6f395675accae kube-scheduler-old-k8s-version-577369
aab72b1939501 1df8a2b116bd1 6 minutes ago Running kube-controller-manager 1 dfa7ffd3df3f8 kube-controller-manager-old-k8s-version-577369
075e697d07c85 2c08bbbc02d3a 6 minutes ago Running kube-apiserver 1 52d8ac1d85d54 kube-apiserver-old-k8s-version-577369
c2bc2d85c8203 gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e 6 minutes ago Exited busybox 0 63fb3af78e96b busybox
7e60d81fce7fe db91994f4ee8f 8 minutes ago Exited coredns 0 411b208d208d8 coredns-74ff55c5b-92t8n
c47b7591b3201 25a5233254979 8 minutes ago Exited kube-proxy 0 855b2a21e2baf kube-proxy-qh57b
ab177be73cae3 e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 2c01fe13146c0 kube-scheduler-old-k8s-version-577369
a4eee0f3ea354 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 7489744553e01 kube-controller-manager-old-k8s-version-577369
760f9a7d272ca 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 312a5efe42939 kube-apiserver-old-k8s-version-577369
81eaddbb4b456 05b738aa1bc63 8 minutes ago Exited etcd 0 f4a0fd051a764 etcd-old-k8s-version-577369
==> coredns [5534d9d547fd] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:60770 - 13699 "HINFO IN 4091923126135840625.1712342005459160035. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.020819605s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I0620 18:05:58.218647 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-06-20 18:05:28.217313028 +0000 UTC m=+0.043691740) (total time: 30.001233241s):
Trace[2019727887]: [30.001233241s] [30.001233241s] END
E0620 18:05:58.218688 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0620 18:05:58.221509 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-06-20 18:05:28.215930356 +0000 UTC m=+0.042309068) (total time: 30.005555259s):
Trace[939984059]: [30.005555259s] [30.005555259s] END
E0620 18:05:58.221536 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0620 18:05:58.221631 1 trace.go:116] Trace[1474941318]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-06-20 18:05:28.217944792 +0000 UTC m=+0.044323495) (total time: 30.003673916s):
Trace[1474941318]: [30.003673916s] [30.003673916s] END
E0620 18:05:58.221973 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> coredns [7e60d81fce7f] <==
I0620 18:03:46.924624 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-06-20 18:03:16.923925874 +0000 UTC m=+0.030073544) (total time: 30.000589279s):
Trace[2019727887]: [30.000589279s] [30.000589279s] END
I0620 18:03:46.924908 1 trace.go:116] Trace[1427131847]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-06-20 18:03:16.924533293 +0000 UTC m=+0.030680963) (total time: 30.000347553s):
Trace[1427131847]: [30.000347553s] [30.000347553s] END
E0620 18:03:46.924937 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
E0620 18:03:46.924914 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0620 18:03:46.925232 1 trace.go:116] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-06-20 18:03:16.92488421 +0000 UTC m=+0.031031880) (total time: 30.000332193s):
Trace[911902081]: [30.000332193s] [30.000332193s] END
E0620 18:03:46.925333 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
E0620 18:04:51.030078 1 reflector.go:382] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to watch *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?allowWatchBookmarks=true&resourceVersion=201&timeout=6m5s&timeoutSeconds=365&watch=true": dial tcp 10.96.0.1:443: connect: connection refused
E0620 18:04:51.030146 1 reflector.go:382] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to watch *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?allowWatchBookmarks=true&resourceVersion=584&timeout=8m23s&timeoutSeconds=503&watch=true": dial tcp 10.96.0.1:443: connect: connection refused
E0620 18:04:51.030556 1 reflector.go:382] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to watch *v1.Service: Get "https://10.96.0.1:443/api/v1/services?allowWatchBookmarks=true&resourceVersion=581&timeout=6m27s&timeoutSeconds=387&watch=true": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] Reloading
[INFO] plugin/health: Going into lameduck mode for 5s
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
[INFO] Reloading complete
[INFO] 127.0.0.1:50639 - 57127 "HINFO IN 982282391238305073.4272579212557183947. udp 56 false 512" NXDOMAIN qr,rd,ra 56 0.068021271s
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
==> describe nodes <==
Name: old-k8s-version-577369
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-577369
kubernetes.io/os=linux
minikube.k8s.io/commit=a5bfa5828b76fe92a3c5f89a54d8c76f6b5f3f8b
minikube.k8s.io/name=old-k8s-version-577369
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_06_20T18_03_00_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Thu, 20 Jun 2024 18:02:57 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-577369
AcquireTime: <unset>
RenewTime: Thu, 20 Jun 2024 18:11:16 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Thu, 20 Jun 2024 18:11:16 +0000 Thu, 20 Jun 2024 18:02:50 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Thu, 20 Jun 2024 18:11:16 +0000 Thu, 20 Jun 2024 18:02:50 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Thu, 20 Jun 2024 18:11:16 +0000 Thu, 20 Jun 2024 18:02:50 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Thu, 20 Jun 2024 18:11:16 +0000 Thu, 20 Jun 2024 18:03:14 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.85.2
Hostname: old-k8s-version-577369
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022364Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022364Ki
pods: 110
System Info:
Machine ID: 931519ae86cb4478acdcf011166db9ae
System UUID: 779bad83-2a0e-4933-8d7a-bb52fc649157
Boot ID: c14a5c8e-2318-4449-baf4-6a576bee7c02
Kernel Version: 5.15.0-1063-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: docker://26.1.4
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m36s
kube-system coredns-74ff55c5b-92t8n 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m1s
kube-system etcd-old-k8s-version-577369 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m12s
kube-system kube-apiserver-old-k8s-version-577369 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m12s
kube-system kube-controller-manager-old-k8s-version-577369 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m12s
kube-system kube-proxy-qh57b 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m1s
kube-system kube-scheduler-old-k8s-version-577369 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m12s
kube-system metrics-server-9975d5f86-nxk7p 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m26s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m59s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-hhrcd 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m32s
kubernetes-dashboard kubernetes-dashboard-cd95d586-l4fmb 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m32s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (42%!)(MISSING) 0 (0%!)(MISSING)
memory 370Mi (4%!)(MISSING) 170Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m29s (x4 over 8m29s) kubelet Node old-k8s-version-577369 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m29s (x4 over 8m29s) kubelet Node old-k8s-version-577369 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m29s (x3 over 8m29s) kubelet Node old-k8s-version-577369 status is now: NodeHasSufficientPID
Normal Starting 8m12s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m12s kubelet Node old-k8s-version-577369 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m12s kubelet Node old-k8s-version-577369 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m12s kubelet Node old-k8s-version-577369 status is now: NodeHasSufficientPID
Normal NodeNotReady 8m12s kubelet Node old-k8s-version-577369 status is now: NodeNotReady
Normal NodeAllocatableEnforced 8m12s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m2s kubelet Node old-k8s-version-577369 status is now: NodeReady
Normal Starting 7m59s kube-proxy Starting kube-proxy.
Normal Starting 6m3s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 6m3s (x8 over 6m3s) kubelet Node old-k8s-version-577369 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m3s (x8 over 6m3s) kubelet Node old-k8s-version-577369 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m3s (x7 over 6m3s) kubelet Node old-k8s-version-577369 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 6m3s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m48s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.000966] FS-Cache: N-cookie d=00000000f28f4ba9{9p.inode} n=00000000552c27c9
[ +0.001066] FS-Cache: N-key=[8] '836ced0000000000'
[ +0.008071] FS-Cache: Duplicate cookie detected
[ +0.000721] FS-Cache: O-cookie c=00000006 [p=00000003 fl=226 nc=0 na=1]
[ +0.001007] FS-Cache: O-cookie d=00000000f28f4ba9{9p.inode} n=0000000040d3cb50
[ +0.001263] FS-Cache: O-key=[8] '836ced0000000000'
[ +0.000776] FS-Cache: N-cookie c=0000000d [p=00000003 fl=2 nc=0 na=1]
[ +0.000959] FS-Cache: N-cookie d=00000000f28f4ba9{9p.inode} n=000000005ce3da04
[ +0.001044] FS-Cache: N-key=[8] '836ced0000000000'
[ +3.435202] FS-Cache: Duplicate cookie detected
[ +0.000686] FS-Cache: O-cookie c=00000004 [p=00000003 fl=226 nc=0 na=1]
[ +0.001032] FS-Cache: O-cookie d=00000000f28f4ba9{9p.inode} n=00000000b15183e6
[ +0.001024] FS-Cache: O-key=[8] '826ced0000000000'
[ +0.000690] FS-Cache: N-cookie c=0000000f [p=00000003 fl=2 nc=0 na=1]
[ +0.000936] FS-Cache: N-cookie d=00000000f28f4ba9{9p.inode} n=000000002b1edaf2
[ +0.001040] FS-Cache: N-key=[8] '826ced0000000000'
[ +0.341946] FS-Cache: Duplicate cookie detected
[ +0.000704] FS-Cache: O-cookie c=00000009 [p=00000003 fl=226 nc=0 na=1]
[ +0.000945] FS-Cache: O-cookie d=00000000f28f4ba9{9p.inode} n=000000003afd8a69
[ +0.001051] FS-Cache: O-key=[8] '8d6ced0000000000'
[ +0.000694] FS-Cache: N-cookie c=00000010 [p=00000003 fl=2 nc=0 na=1]
[ +0.000913] FS-Cache: N-cookie d=00000000f28f4ba9{9p.inode} n=000000008813ebd0
[ +0.001026] FS-Cache: N-key=[8] '8d6ced0000000000'
[Jun20 17:20] hrtimer: interrupt took 10275005 ns
[Jun20 17:49] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
==> etcd [25a953b6e46d] <==
2024-06-20 18:07:14.497109 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:07:24.496199 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:07:34.495823 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:07:44.495820 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:07:54.495814 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:08:04.495742 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:08:14.495933 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:08:24.495715 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:08:34.495776 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:08:44.496011 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:08:54.495859 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:09:04.495714 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:09:14.495833 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:09:24.495857 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:09:34.495737 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:09:44.497660 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:09:54.495754 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:10:04.495913 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:10:14.495976 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:10:24.495707 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:10:34.495868 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:10:44.495752 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:10:54.495958 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:11:04.495816 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:11:14.495932 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [81eaddbb4b45] <==
raft2024/06/20 18:02:48 INFO: 9f0758e1c58a86ed became leader at term 2
raft2024/06/20 18:02:48 INFO: raft.node: 9f0758e1c58a86ed elected leader 9f0758e1c58a86ed at term 2
2024-06-20 18:02:48.824462 I | etcdserver: setting up the initial cluster version to 3.4
2024-06-20 18:02:48.829701 N | etcdserver/membership: set the initial cluster version to 3.4
2024-06-20 18:02:48.829756 I | etcdserver/api: enabled capabilities for version 3.4
2024-06-20 18:02:48.829787 I | etcdserver: published {Name:old-k8s-version-577369 ClientURLs:[https://192.168.85.2:2379]} to cluster 68eaea490fab4e05
2024-06-20 18:02:48.829874 I | embed: ready to serve client requests
2024-06-20 18:02:48.835481 I | embed: serving client requests on 192.168.85.2:2379
2024-06-20 18:02:48.835536 I | embed: ready to serve client requests
2024-06-20 18:02:48.836556 I | embed: serving client requests on 127.0.0.1:2379
2024-06-20 18:02:58.193564 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:03:10.851043 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:03:13.496089 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:03:23.495843 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:03:33.496459 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:03:43.495919 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:03:53.495960 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:04:03.495822 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:04:13.495956 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:04:23.496205 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:04:33.496336 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:04:43.496045 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-20 18:04:51.121147 N | pkg/osutil: received terminated signal, shutting down...
WARNING: 2024/06/20 18:04:51 grpc: addrConn.createTransport failed to connect to {127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
2024-06-20 18:04:51.162172 I | etcdserver: skipped leadership transfer for single voting member cluster
==> kernel <==
18:11:17 up 1:53, 0 users, load average: 3.37, 2.77, 3.43
Linux old-k8s-version-577369 5.15.0-1063-aws #69~20.04.1-Ubuntu SMP Fri May 10 19:21:30 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kube-apiserver [075e697d07c8] <==
I0620 18:07:44.460574 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0620 18:07:44.460582 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0620 18:08:15.396472 1 client.go:360] parsed scheme: "passthrough"
I0620 18:08:15.396513 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0620 18:08:15.396533 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0620 18:08:28.122013 1 handler_proxy.go:102] no RequestInfo found in the context
E0620 18:08:28.122084 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0620 18:08:28.122093 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0620 18:08:47.177021 1 client.go:360] parsed scheme: "passthrough"
I0620 18:08:47.177061 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0620 18:08:47.177070 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0620 18:09:32.117308 1 client.go:360] parsed scheme: "passthrough"
I0620 18:09:32.117357 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0620 18:09:32.117366 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0620 18:10:15.239810 1 client.go:360] parsed scheme: "passthrough"
I0620 18:10:15.239853 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0620 18:10:15.239865 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0620 18:10:24.749448 1 handler_proxy.go:102] no RequestInfo found in the context
E0620 18:10:24.749532 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0620 18:10:24.749544 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0620 18:10:49.807185 1 client.go:360] parsed scheme: "passthrough"
I0620 18:10:49.807327 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0620 18:10:49.807389 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [760f9a7d272c] <==
W0620 18:04:51.166693 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.166736 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.166770 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.166808 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.166842 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.166901 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.166945 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.168598 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.168682 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.168722 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.168765 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.169168 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.169258 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.169267 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.169297 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.169339 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.169400 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.169474 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.169539 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.169591 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.169638 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.169680 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.169720 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.169755 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0620 18:04:51.169948 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
==> kube-controller-manager [a4eee0f3ea35] <==
I0620 18:03:15.694704 1 shared_informer.go:247] Caches are synced for ReplicationController
I0620 18:03:15.694761 1 shared_informer.go:247] Caches are synced for attach detach
I0620 18:03:15.698309 1 shared_informer.go:247] Caches are synced for resource quota
I0620 18:03:15.707927 1 shared_informer.go:247] Caches are synced for persistent volume
I0620 18:03:15.708754 1 shared_informer.go:247] Caches are synced for daemon sets
I0620 18:03:15.713159 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-74ff55c5b to 2"
I0620 18:03:15.724017 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-jdqbb"
E0620 18:03:15.735260 1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
I0620 18:03:15.761972 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-92t8n"
I0620 18:03:15.777119 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-qh57b"
I0620 18:03:15.835276 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0620 18:03:16.135481 1 shared_informer.go:247] Caches are synced for garbage collector
I0620 18:03:16.145139 1 shared_informer.go:247] Caches are synced for garbage collector
I0620 18:03:16.145160 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0620 18:03:16.443989 1 request.go:655] Throttling request took 1.045563564s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
I0620 18:03:17.245787 1 shared_informer.go:240] Waiting for caches to sync for resource quota
I0620 18:03:17.245826 1 shared_informer.go:247] Caches are synced for resource quota
I0620 18:03:17.445070 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0620 18:03:17.469412 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-jdqbb"
I0620 18:04:49.568039 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
I0620 18:04:49.651946 1 event.go:291] "Event occurred" object="kube-system/metrics-server-9975d5f86" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"metrics-server-9975d5f86-\" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount \"metrics-server\" not found"
E0620 18:04:49.683547 1 replica_set.go:532] sync "kube-system/metrics-server-9975d5f86" failed with pods "metrics-server-9975d5f86-" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount "metrics-server" not found
E0620 18:04:49.987319 1 clusterroleaggregation_controller.go:181] view failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "view": the object has been modified; please apply your changes to the latest version and try again
E0620 18:04:50.027474 1 clusterroleaggregation_controller.go:181] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
I0620 18:04:50.784892 1 event.go:291] "Event occurred" object="kube-system/metrics-server-9975d5f86" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: metrics-server-9975d5f86-nxk7p"
==> kube-controller-manager [aab72b193950] <==
W0620 18:06:50.438872 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0620 18:07:16.458728 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0620 18:07:22.089367 1 request.go:655] Throttling request took 1.048263979s, request: GET:https://192.168.85.2:8443/apis/authorization.k8s.io/v1beta1?timeout=32s
W0620 18:07:22.940727 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0620 18:07:46.960512 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0620 18:07:54.591142 1 request.go:655] Throttling request took 1.048376276s, request: GET:https://192.168.85.2:8443/apis/authentication.k8s.io/v1?timeout=32s
W0620 18:07:55.442754 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0620 18:08:17.462296 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0620 18:08:27.093235 1 request.go:655] Throttling request took 1.048362655s, request: GET:https://192.168.85.2:8443/apis/scheduling.k8s.io/v1?timeout=32s
W0620 18:08:27.944537 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0620 18:08:47.964068 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0620 18:08:59.595153 1 request.go:655] Throttling request took 1.048256777s, request: GET:https://192.168.85.2:8443/apis/batch/v1beta1?timeout=32s
W0620 18:09:00.446727 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0620 18:09:18.466128 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0620 18:09:32.097277 1 request.go:655] Throttling request took 1.048408366s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0620 18:09:32.948700 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0620 18:09:48.967983 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0620 18:10:04.599064 1 request.go:655] Throttling request took 1.048220114s, request: GET:https://192.168.85.2:8443/apis/batch/v1beta1?timeout=32s
W0620 18:10:05.450438 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0620 18:10:19.469955 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0620 18:10:37.100769 1 request.go:655] Throttling request took 1.047890726s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0620 18:10:37.952310 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0620 18:10:49.971751 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0620 18:11:09.602839 1 request.go:655] Throttling request took 1.048301491s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0620 18:11:10.454356 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-proxy [0b32a67571bb] <==
I0620 18:05:28.432216 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0620 18:05:28.432301 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0620 18:05:28.464983 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0620 18:05:28.465145 1 server_others.go:185] Using iptables Proxier.
I0620 18:05:28.465442 1 server.go:650] Version: v1.20.0
I0620 18:05:28.465967 1 config.go:315] Starting service config controller
I0620 18:05:28.466017 1 shared_informer.go:240] Waiting for caches to sync for service config
I0620 18:05:28.472264 1 config.go:224] Starting endpoint slice config controller
I0620 18:05:28.472291 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0620 18:05:28.567067 1 shared_informer.go:247] Caches are synced for service config
I0620 18:05:28.575135 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-proxy [c47b7591b320] <==
I0620 18:03:17.285474 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0620 18:03:17.285570 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0620 18:03:17.335755 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0620 18:03:17.335849 1 server_others.go:185] Using iptables Proxier.
I0620 18:03:17.336057 1 server.go:650] Version: v1.20.0
I0620 18:03:17.336506 1 config.go:315] Starting service config controller
I0620 18:03:17.336521 1 shared_informer.go:240] Waiting for caches to sync for service config
I0620 18:03:17.338418 1 config.go:224] Starting endpoint slice config controller
I0620 18:03:17.338462 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0620 18:03:17.440497 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0620 18:03:17.440609 1 shared_informer.go:247] Caches are synced for service config
==> kube-scheduler [4ed5438feb8b] <==
I0620 18:05:18.039312 1 serving.go:331] Generated self-signed cert in-memory
W0620 18:05:23.584231 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0620 18:05:23.584269 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0620 18:05:23.584295 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0620 18:05:23.584308 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0620 18:05:23.998366 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0620 18:05:23.998397 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0620 18:05:24.016711 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0620 18:05:24.036748 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0620 18:05:24.199986 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [ab177be73cae] <==
I0620 18:02:52.304687 1 serving.go:331] Generated self-signed cert in-memory
W0620 18:02:57.050580 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0620 18:02:57.050626 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0620 18:02:57.050650 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0620 18:02:57.050851 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0620 18:02:57.167304 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0620 18:02:57.167334 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0620 18:02:57.170657 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0620 18:02:57.170770 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0620 18:02:57.185619 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0620 18:02:57.186036 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0620 18:02:57.186231 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0620 18:02:57.186379 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0620 18:02:57.186629 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0620 18:02:57.186933 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0620 18:02:57.187256 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0620 18:02:57.202746 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0620 18:02:57.203026 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0620 18:02:57.203170 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0620 18:02:57.203275 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0620 18:02:57.203339 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0620 18:02:58.063127 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
I0620 18:02:58.767573 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Jun 20 18:08:57 old-k8s-version-577369 kubelet[1201]: E0620 18:08:57.213817 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 20 18:08:58 old-k8s-version-577369 kubelet[1201]: E0620 18:08:58.213216 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 20 18:09:11 old-k8s-version-577369 kubelet[1201]: E0620 18:09:11.219178 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 20 18:09:11 old-k8s-version-577369 kubelet[1201]: E0620 18:09:11.223804 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 20 18:09:25 old-k8s-version-577369 kubelet[1201]: E0620 18:09:25.213628 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 20 18:09:25 old-k8s-version-577369 kubelet[1201]: E0620 18:09:25.220085 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 20 18:09:37 old-k8s-version-577369 kubelet[1201]: E0620 18:09:37.218633 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 20 18:09:39 old-k8s-version-577369 kubelet[1201]: E0620 18:09:39.213129 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 20 18:09:49 old-k8s-version-577369 kubelet[1201]: E0620 18:09:49.212880 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 20 18:09:52 old-k8s-version-577369 kubelet[1201]: E0620 18:09:52.213161 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 20 18:10:01 old-k8s-version-577369 kubelet[1201]: E0620 18:10:01.220058 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 20 18:10:07 old-k8s-version-577369 kubelet[1201]: E0620 18:10:07.213133 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 20 18:10:16 old-k8s-version-577369 kubelet[1201]: E0620 18:10:16.212946 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 20 18:10:18 old-k8s-version-577369 kubelet[1201]: E0620 18:10:18.220165 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 20 18:10:31 old-k8s-version-577369 kubelet[1201]: E0620 18:10:31.213199 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 20 18:10:31 old-k8s-version-577369 kubelet[1201]: E0620 18:10:31.215427 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 20 18:10:42 old-k8s-version-577369 kubelet[1201]: E0620 18:10:42.213713 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 20 18:10:43 old-k8s-version-577369 kubelet[1201]: E0620 18:10:43.221571 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 20 18:10:55 old-k8s-version-577369 kubelet[1201]: E0620 18:10:55.213780 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 20 18:10:56 old-k8s-version-577369 kubelet[1201]: E0620 18:10:56.253796 1201 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host
Jun 20 18:10:56 old-k8s-version-577369 kubelet[1201]: E0620 18:10:56.253857 1201 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host
Jun 20 18:10:56 old-k8s-version-577369 kubelet[1201]: E0620 18:10:56.254038 1201 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-xd7wc,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exe
c:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-nxk7p_kube-system(18cfc5
9b-503a-463e-80f0-2a08c7711566): ErrImagePull: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host
Jun 20 18:10:56 old-k8s-version-577369 kubelet[1201]: E0620 18:10:56.254103 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Jun 20 18:11:09 old-k8s-version-577369 kubelet[1201]: E0620 18:11:09.227999 1201 pod_workers.go:191] Error syncing pod 18cfc59b-503a-463e-80f0-2a08c7711566 ("metrics-server-9975d5f86-nxk7p_kube-system(18cfc59b-503a-463e-80f0-2a08c7711566)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 20 18:11:10 old-k8s-version-577369 kubelet[1201]: E0620 18:11:10.213353 1201 pod_workers.go:191] Error syncing pod a0906cb1-30c6-4e85-9f0e-eb135fb00622 ("dashboard-metrics-scraper-8d5bb5db8-hhrcd_kubernetes-dashboard(a0906cb1-30c6-4e85-9f0e-eb135fb00622)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
==> kubernetes-dashboard [49efdc60eccc] <==
2024/06/20 18:05:51 Starting overwatch
2024/06/20 18:05:51 Using namespace: kubernetes-dashboard
2024/06/20 18:05:51 Using in-cluster config to connect to apiserver
2024/06/20 18:05:51 Using secret token for csrf signing
2024/06/20 18:05:51 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/06/20 18:05:52 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/06/20 18:05:52 Successful initial request to the apiserver, version: v1.20.0
2024/06/20 18:05:52 Generating JWE encryption key
2024/06/20 18:05:52 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/06/20 18:05:52 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/06/20 18:05:53 Initializing JWE encryption key from synchronized object
2024/06/20 18:05:53 Creating in-cluster Sidecar client
2024/06/20 18:05:53 Serving insecurely on HTTP port: 9090
2024/06/20 18:05:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/20 18:06:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/20 18:06:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/20 18:07:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/20 18:07:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/20 18:08:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/20 18:08:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/20 18:09:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/20 18:09:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/20 18:10:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/20 18:10:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
==> storage-provisioner [16e28ef3ddc9] <==
I0620 18:05:27.998603 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0620 18:05:58.000630 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
==> storage-provisioner [74b467d165b4] <==
I0620 18:06:09.360446 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0620 18:06:09.377319 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0620 18:06:09.377592 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0620 18:06:26.830163 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0620 18:06:26.830414 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-577369_717f0702-e3a0-4de6-8b89-1f27d7268bc4!
I0620 18:06:26.830628 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"a6fbd6e7-503b-4865-b8a7-b9bb08510499", APIVersion:"v1", ResourceVersion:"823", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-577369_717f0702-e3a0-4de6-8b89-1f27d7268bc4 became leader
I0620 18:06:26.931521 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-577369_717f0702-e3a0-4de6-8b89-1f27d7268bc4!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-577369 -n old-k8s-version-577369
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-577369 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-nxk7p dashboard-metrics-scraper-8d5bb5db8-hhrcd
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-577369 describe pod metrics-server-9975d5f86-nxk7p dashboard-metrics-scraper-8d5bb5db8-hhrcd
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-577369 describe pod metrics-server-9975d5f86-nxk7p dashboard-metrics-scraper-8d5bb5db8-hhrcd: exit status 1 (85.667689ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-nxk7p" not found
Error from server (NotFound): pods "dashboard-metrics-scraper-8d5bb5db8-hhrcd" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-577369 describe pod metrics-server-9975d5f86-nxk7p dashboard-metrics-scraper-8d5bb5db8-hhrcd: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (376.34s)