=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-879853 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=docker --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-879853 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=docker --kubernetes-version=v1.20.0: exit status 102 (6m12.958590078s)
-- stdout --
* [old-k8s-version-879853] minikube v1.33.1 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=18925
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18925-2151/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18925-2151/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.30.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.1
* Using the docker driver based on existing profile
* Starting "old-k8s-version-879853" primary control-plane node in "old-k8s-version-879853" cluster
* Pulling base image v0.0.44-1715707529-18887 ...
* Restarting existing docker container for "old-k8s-version-879853" ...
* Preparing Kubernetes v1.20.0 on Docker 26.1.2 ...
* Verifying Kubernetes components...
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image registry.k8s.io/echoserver:1.4
- Using image fake.domain/registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-879853 addons enable metrics-server
* Enabled addons: metrics-server, storage-provisioner, default-storageclass, dashboard
-- /stdout --
** stderr **
I0520 11:14:38.149610 294755 out.go:291] Setting OutFile to fd 1 ...
I0520 11:14:38.149766 294755 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0520 11:14:38.149773 294755 out.go:304] Setting ErrFile to fd 2...
I0520 11:14:38.149783 294755 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0520 11:14:38.150036 294755 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18925-2151/.minikube/bin
I0520 11:14:38.150387 294755 out.go:298] Setting JSON to false
I0520 11:14:38.151399 294755 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":3399,"bootTime":1716200280,"procs":200,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1061-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0520 11:14:38.151464 294755 start.go:139] virtualization:
I0520 11:14:38.154141 294755 out.go:177] * [old-k8s-version-879853] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0520 11:14:38.156555 294755 out.go:177] - MINIKUBE_LOCATION=18925
I0520 11:14:38.158198 294755 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0520 11:14:38.156598 294755 notify.go:220] Checking for updates...
I0520 11:14:38.162025 294755 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18925-2151/kubeconfig
I0520 11:14:38.163640 294755 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18925-2151/.minikube
I0520 11:14:38.165877 294755 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0520 11:14:38.167634 294755 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0520 11:14:38.170042 294755 config.go:182] Loaded profile config "old-k8s-version-879853": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0
I0520 11:14:38.172341 294755 out.go:177] * Kubernetes 1.30.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.1
I0520 11:14:38.174134 294755 driver.go:392] Setting default libvirt URI to qemu:///system
I0520 11:14:38.199870 294755 docker.go:122] docker version: linux-26.1.3:Docker Engine - Community
I0520 11:14:38.199983 294755 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0520 11:14:38.293889 294755 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:40 OomKillDisable:true NGoroutines:52 SystemTime:2024-05-20 11:14:38.282980487 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1061-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214966272 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:26.1.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.0]] Warnings:<nil>}}
I0520 11:14:38.294060 294755 docker.go:295] overlay module found
I0520 11:14:38.296183 294755 out.go:177] * Using the docker driver based on existing profile
I0520 11:14:38.298029 294755 start.go:297] selected driver: docker
I0520 11:14:38.298069 294755 start.go:901] validating driver "docker" against &{Name:old-k8s-version-879853 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-879853 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountSt
ring:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0520 11:14:38.298212 294755 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0520 11:14:38.298945 294755 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0520 11:14:38.385182 294755 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:40 OomKillDisable:true NGoroutines:52 SystemTime:2024-05-20 11:14:38.364777123 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1061-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214966272 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:26.1.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.0]] Warnings:<nil>}}
I0520 11:14:38.385527 294755 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0520 11:14:38.385548 294755 cni.go:84] Creating CNI manager for ""
I0520 11:14:38.385560 294755 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
I0520 11:14:38.385595 294755 start.go:340] cluster config:
{Name:old-k8s-version-879853 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-879853 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountI
P: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0520 11:14:38.387560 294755 out.go:177] * Starting "old-k8s-version-879853" primary control-plane node in "old-k8s-version-879853" cluster
I0520 11:14:38.389172 294755 cache.go:121] Beginning downloading kic base image for docker with docker
I0520 11:14:38.391191 294755 out.go:177] * Pulling base image v0.0.44-1715707529-18887 ...
I0520 11:14:38.392760 294755 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
I0520 11:14:38.392811 294755 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18925-2151/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4
I0520 11:14:38.392819 294755 cache.go:56] Caching tarball of preloaded images
I0520 11:14:38.392910 294755 preload.go:173] Found /home/jenkins/minikube-integration/18925-2151/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
I0520 11:14:38.392924 294755 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
I0520 11:14:38.393030 294755 profile.go:143] Saving config to /home/jenkins/minikube-integration/18925-2151/.minikube/profiles/old-k8s-version-879853/config.json ...
I0520 11:14:38.393268 294755 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a in local docker daemon
I0520 11:14:38.407859 294755 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a in local docker daemon, skipping pull
I0520 11:14:38.407892 294755 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a exists in daemon, skipping load
I0520 11:14:38.407912 294755 cache.go:194] Successfully downloaded all kic artifacts
I0520 11:14:38.407940 294755 start.go:360] acquireMachinesLock for old-k8s-version-879853: {Name:mka4c1e89cfccad8376ed22de63d5c67fb2dc918 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0520 11:14:38.407998 294755 start.go:364] duration metric: took 37.53µs to acquireMachinesLock for "old-k8s-version-879853"
I0520 11:14:38.408017 294755 start.go:96] Skipping create...Using existing machine configuration
I0520 11:14:38.408022 294755 fix.go:54] fixHost starting:
I0520 11:14:38.408292 294755 cli_runner.go:164] Run: docker container inspect old-k8s-version-879853 --format={{.State.Status}}
I0520 11:14:38.426529 294755 fix.go:112] recreateIfNeeded on old-k8s-version-879853: state=Stopped err=<nil>
W0520 11:14:38.426569 294755 fix.go:138] unexpected machine state, will restart: <nil>
I0520 11:14:38.428619 294755 out.go:177] * Restarting existing docker container for "old-k8s-version-879853" ...
I0520 11:14:38.430350 294755 cli_runner.go:164] Run: docker start old-k8s-version-879853
I0520 11:14:38.763122 294755 cli_runner.go:164] Run: docker container inspect old-k8s-version-879853 --format={{.State.Status}}
I0520 11:14:38.794479 294755 kic.go:430] container "old-k8s-version-879853" state is running.
I0520 11:14:38.796861 294755 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-879853
I0520 11:14:38.823289 294755 profile.go:143] Saving config to /home/jenkins/minikube-integration/18925-2151/.minikube/profiles/old-k8s-version-879853/config.json ...
I0520 11:14:38.823764 294755 machine.go:94] provisionDockerMachine start ...
I0520 11:14:38.823846 294755 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-879853
I0520 11:14:38.843812 294755 main.go:141] libmachine: Using SSH client type: native
I0520 11:14:38.844074 294755 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 33083 <nil> <nil>}
I0520 11:14:38.844091 294755 main.go:141] libmachine: About to run SSH command:
hostname
I0520 11:14:38.846212 294755 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0520 11:14:41.972756 294755 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-879853
I0520 11:14:41.972797 294755 ubuntu.go:169] provisioning hostname "old-k8s-version-879853"
I0520 11:14:41.972863 294755 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-879853
I0520 11:14:41.993898 294755 main.go:141] libmachine: Using SSH client type: native
I0520 11:14:41.994142 294755 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 33083 <nil> <nil>}
I0520 11:14:41.994154 294755 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-879853 && echo "old-k8s-version-879853" | sudo tee /etc/hostname
I0520 11:14:42.148643 294755 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-879853
I0520 11:14:42.148777 294755 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-879853
I0520 11:14:42.174919 294755 main.go:141] libmachine: Using SSH client type: native
I0520 11:14:42.175197 294755 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 33083 <nil> <nil>}
I0520 11:14:42.175220 294755 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-879853' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-879853/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-879853' | sudo tee -a /etc/hosts;
fi
fi
I0520 11:14:42.310113 294755 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0520 11:14:42.310227 294755 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18925-2151/.minikube CaCertPath:/home/jenkins/minikube-integration/18925-2151/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18925-2151/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18925-2151/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18925-2151/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18925-2151/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18925-2151/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18925-2151/.minikube}
I0520 11:14:42.310298 294755 ubuntu.go:177] setting up certificates
I0520 11:14:42.310351 294755 provision.go:84] configureAuth start
I0520 11:14:42.310456 294755 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-879853
I0520 11:14:42.332522 294755 provision.go:143] copyHostCerts
I0520 11:14:42.332600 294755 exec_runner.go:144] found /home/jenkins/minikube-integration/18925-2151/.minikube/cert.pem, removing ...
I0520 11:14:42.332609 294755 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18925-2151/.minikube/cert.pem
I0520 11:14:42.332717 294755 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18925-2151/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18925-2151/.minikube/cert.pem (1123 bytes)
I0520 11:14:42.332822 294755 exec_runner.go:144] found /home/jenkins/minikube-integration/18925-2151/.minikube/key.pem, removing ...
I0520 11:14:42.332827 294755 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18925-2151/.minikube/key.pem
I0520 11:14:42.332857 294755 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18925-2151/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18925-2151/.minikube/key.pem (1675 bytes)
I0520 11:14:42.332907 294755 exec_runner.go:144] found /home/jenkins/minikube-integration/18925-2151/.minikube/ca.pem, removing ...
I0520 11:14:42.332918 294755 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18925-2151/.minikube/ca.pem
I0520 11:14:42.332946 294755 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18925-2151/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18925-2151/.minikube/ca.pem (1078 bytes)
I0520 11:14:42.332996 294755 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18925-2151/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18925-2151/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18925-2151/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-879853 san=[127.0.0.1 192.168.85.2 localhost minikube old-k8s-version-879853]
I0520 11:14:43.164859 294755 provision.go:177] copyRemoteCerts
I0520 11:14:43.164986 294755 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0520 11:14:43.165099 294755 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-879853
I0520 11:14:43.181688 294755 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33083 SSHKeyPath:/home/jenkins/minikube-integration/18925-2151/.minikube/machines/old-k8s-version-879853/id_rsa Username:docker}
I0520 11:14:43.274259 294755 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-2151/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0520 11:14:43.312265 294755 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-2151/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0520 11:14:43.358934 294755 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-2151/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0520 11:14:43.387371 294755 provision.go:87] duration metric: took 1.076988978s to configureAuth
I0520 11:14:43.387399 294755 ubuntu.go:193] setting minikube options for container-runtime
I0520 11:14:43.387592 294755 config.go:182] Loaded profile config "old-k8s-version-879853": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0
I0520 11:14:43.387659 294755 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-879853
I0520 11:14:43.410132 294755 main.go:141] libmachine: Using SSH client type: native
I0520 11:14:43.410379 294755 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 33083 <nil> <nil>}
I0520 11:14:43.410392 294755 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0520 11:14:43.558364 294755 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0520 11:14:43.558435 294755 ubuntu.go:71] root file system type: overlay
I0520 11:14:43.558584 294755 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
I0520 11:14:43.558721 294755 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-879853
I0520 11:14:43.577611 294755 main.go:141] libmachine: Using SSH client type: native
I0520 11:14:43.577842 294755 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 33083 <nil> <nil>}
I0520 11:14:43.577916 294755 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0520 11:14:43.737847 294755 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0520 11:14:43.738001 294755 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-879853
I0520 11:14:43.762460 294755 main.go:141] libmachine: Using SSH client type: native
I0520 11:14:43.762715 294755 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 33083 <nil> <nil>}
I0520 11:14:43.762733 294755 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0520 11:14:43.922553 294755 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0520 11:14:43.922577 294755 machine.go:97] duration metric: took 5.098793916s to provisionDockerMachine
I0520 11:14:43.922589 294755 start.go:293] postStartSetup for "old-k8s-version-879853" (driver="docker")
I0520 11:14:43.922602 294755 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0520 11:14:43.922689 294755 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0520 11:14:43.922738 294755 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-879853
I0520 11:14:43.963912 294755 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33083 SSHKeyPath:/home/jenkins/minikube-integration/18925-2151/.minikube/machines/old-k8s-version-879853/id_rsa Username:docker}
I0520 11:14:44.074512 294755 ssh_runner.go:195] Run: cat /etc/os-release
I0520 11:14:44.081788 294755 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0520 11:14:44.081827 294755 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0520 11:14:44.081838 294755 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0520 11:14:44.081845 294755 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0520 11:14:44.081856 294755 filesync.go:126] Scanning /home/jenkins/minikube-integration/18925-2151/.minikube/addons for local assets ...
I0520 11:14:44.081923 294755 filesync.go:126] Scanning /home/jenkins/minikube-integration/18925-2151/.minikube/files for local assets ...
I0520 11:14:44.082036 294755 filesync.go:149] local asset: /home/jenkins/minikube-integration/18925-2151/.minikube/files/etc/ssl/certs/75122.pem -> 75122.pem in /etc/ssl/certs
I0520 11:14:44.082157 294755 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0520 11:14:44.096442 294755 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-2151/.minikube/files/etc/ssl/certs/75122.pem --> /etc/ssl/certs/75122.pem (1708 bytes)
I0520 11:14:44.137022 294755 start.go:296] duration metric: took 214.417638ms for postStartSetup
I0520 11:14:44.137174 294755 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0520 11:14:44.137222 294755 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-879853
I0520 11:14:44.163006 294755 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33083 SSHKeyPath:/home/jenkins/minikube-integration/18925-2151/.minikube/machines/old-k8s-version-879853/id_rsa Username:docker}
I0520 11:14:44.266358 294755 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0520 11:14:44.276384 294755 fix.go:56] duration metric: took 5.868353242s for fixHost
I0520 11:14:44.276409 294755 start.go:83] releasing machines lock for "old-k8s-version-879853", held for 5.86840262s
I0520 11:14:44.276483 294755 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-879853
I0520 11:14:44.303865 294755 ssh_runner.go:195] Run: cat /version.json
I0520 11:14:44.303921 294755 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-879853
I0520 11:14:44.304136 294755 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0520 11:14:44.304182 294755 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-879853
I0520 11:14:44.337737 294755 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33083 SSHKeyPath:/home/jenkins/minikube-integration/18925-2151/.minikube/machines/old-k8s-version-879853/id_rsa Username:docker}
I0520 11:14:44.341427 294755 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33083 SSHKeyPath:/home/jenkins/minikube-integration/18925-2151/.minikube/machines/old-k8s-version-879853/id_rsa Username:docker}
I0520 11:14:44.452504 294755 ssh_runner.go:195] Run: systemctl --version
I0520 11:14:44.612245 294755 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0520 11:14:44.617910 294755 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0520 11:14:44.657918 294755 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0520 11:14:44.658002 294755 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
I0520 11:14:44.682548 294755 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
I0520 11:14:44.710011 294755 cni.go:308] configured [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0520 11:14:44.710040 294755 start.go:494] detecting cgroup driver to use...
I0520 11:14:44.710072 294755 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0520 11:14:44.710172 294755 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0520 11:14:44.750950 294755 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0520 11:14:44.767009 294755 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0520 11:14:44.783930 294755 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0520 11:14:44.784001 294755 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0520 11:14:44.799805 294755 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0520 11:14:44.815676 294755 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0520 11:14:44.835972 294755 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0520 11:14:44.849143 294755 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0520 11:14:44.867269 294755 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0520 11:14:44.884891 294755 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0520 11:14:44.899109 294755 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0520 11:14:44.912727 294755 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0520 11:14:45.081288 294755 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0520 11:14:45.278405 294755 start.go:494] detecting cgroup driver to use...
I0520 11:14:45.278464 294755 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0520 11:14:45.278520 294755 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0520 11:14:45.307693 294755 cruntime.go:279] skipping containerd shutdown because we are bound to it
I0520 11:14:45.307818 294755 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0520 11:14:45.334617 294755 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0520 11:14:45.371776 294755 ssh_runner.go:195] Run: which cri-dockerd
I0520 11:14:45.381415 294755 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0520 11:14:45.406503 294755 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
I0520 11:14:45.449699 294755 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0520 11:14:45.621928 294755 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0520 11:14:45.786933 294755 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I0520 11:14:45.787116 294755 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I0520 11:14:45.829719 294755 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0520 11:14:45.969534 294755 ssh_runner.go:195] Run: sudo systemctl restart docker
I0520 11:14:46.700388 294755 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0520 11:14:46.744511 294755 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0520 11:14:46.769782 294755 out.go:204] * Preparing Kubernetes v1.20.0 on Docker 26.1.2 ...
I0520 11:14:46.769877 294755 cli_runner.go:164] Run: docker network inspect old-k8s-version-879853 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0520 11:14:46.793309 294755 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0520 11:14:46.797062 294755 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0520 11:14:46.815772 294755 kubeadm.go:877] updating cluster {Name:old-k8s-version-879853 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-879853 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkin
s:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0520 11:14:46.815900 294755 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
I0520 11:14:46.815971 294755 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0520 11:14:46.857368 294755 docker.go:685] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-proxy:v1.20.0
registry.k8s.io/kube-proxy:v1.20.0
k8s.gcr.io/kube-apiserver:v1.20.0
registry.k8s.io/kube-apiserver:v1.20.0
k8s.gcr.io/kube-controller-manager:v1.20.0
registry.k8s.io/kube-controller-manager:v1.20.0
k8s.gcr.io/kube-scheduler:v1.20.0
registry.k8s.io/kube-scheduler:v1.20.0
k8s.gcr.io/etcd:3.4.13-0
registry.k8s.io/etcd:3.4.13-0
k8s.gcr.io/coredns:1.7.0
registry.k8s.io/coredns:1.7.0
k8s.gcr.io/pause:3.2
registry.k8s.io/pause:3.2
gcr.io/k8s-minikube/busybox:1.28.4-glibc
-- /stdout --
I0520 11:14:46.857394 294755 docker.go:615] Images already preloaded, skipping extraction
I0520 11:14:46.857460 294755 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0520 11:14:46.883373 294755 docker.go:685] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-proxy:v1.20.0
registry.k8s.io/kube-proxy:v1.20.0
k8s.gcr.io/kube-apiserver:v1.20.0
registry.k8s.io/kube-apiserver:v1.20.0
k8s.gcr.io/kube-controller-manager:v1.20.0
registry.k8s.io/kube-controller-manager:v1.20.0
k8s.gcr.io/kube-scheduler:v1.20.0
registry.k8s.io/kube-scheduler:v1.20.0
k8s.gcr.io/etcd:3.4.13-0
registry.k8s.io/etcd:3.4.13-0
k8s.gcr.io/coredns:1.7.0
registry.k8s.io/coredns:1.7.0
k8s.gcr.io/pause:3.2
registry.k8s.io/pause:3.2
gcr.io/k8s-minikube/busybox:1.28.4-glibc
-- /stdout --
I0520 11:14:46.883401 294755 cache_images.go:84] Images are preloaded, skipping loading
I0520 11:14:46.883411 294755 kubeadm.go:928] updating node { 192.168.85.2 8443 v1.20.0 docker true true} ...
I0520 11:14:46.883528 294755 kubeadm.go:940] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-879853 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-879853 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0520 11:14:46.883604 294755 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0520 11:14:46.976756 294755 cni.go:84] Creating CNI manager for ""
I0520 11:14:46.976787 294755 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
I0520 11:14:46.976796 294755 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0520 11:14:46.976813 294755 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-879853 NodeName:old-k8s-version-879853 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticP
odPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0520 11:14:46.976958 294755 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-879853"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0520 11:14:46.977034 294755 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0520 11:14:46.998422 294755 binaries.go:44] Found k8s binaries, skipping transfer
I0520 11:14:46.998496 294755 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0520 11:14:47.015899 294755 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (348 bytes)
I0520 11:14:47.051894 294755 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0520 11:14:47.091437 294755 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2118 bytes)
I0520 11:14:47.124301 294755 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0520 11:14:47.132155 294755 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0520 11:14:47.148456 294755 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0520 11:14:47.286490 294755 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0520 11:14:47.309153 294755 certs.go:68] Setting up /home/jenkins/minikube-integration/18925-2151/.minikube/profiles/old-k8s-version-879853 for IP: 192.168.85.2
I0520 11:14:47.309172 294755 certs.go:194] generating shared ca certs ...
I0520 11:14:47.309188 294755 certs.go:226] acquiring lock for ca certs: {Name:mka753a63b3bd30b9859f448573f70a0fd066da5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:14:47.309324 294755 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18925-2151/.minikube/ca.key
I0520 11:14:47.309377 294755 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18925-2151/.minikube/proxy-client-ca.key
I0520 11:14:47.309385 294755 certs.go:256] generating profile certs ...
I0520 11:14:47.309483 294755 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18925-2151/.minikube/profiles/old-k8s-version-879853/client.key
I0520 11:14:47.309548 294755 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/18925-2151/.minikube/profiles/old-k8s-version-879853/apiserver.key.7f7d5629
I0520 11:14:47.309586 294755 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18925-2151/.minikube/profiles/old-k8s-version-879853/proxy-client.key
I0520 11:14:47.309688 294755 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-2151/.minikube/certs/7512.pem (1338 bytes)
W0520 11:14:47.309716 294755 certs.go:480] ignoring /home/jenkins/minikube-integration/18925-2151/.minikube/certs/7512_empty.pem, impossibly tiny 0 bytes
I0520 11:14:47.309724 294755 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-2151/.minikube/certs/ca-key.pem (1679 bytes)
I0520 11:14:47.309751 294755 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-2151/.minikube/certs/ca.pem (1078 bytes)
I0520 11:14:47.309774 294755 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-2151/.minikube/certs/cert.pem (1123 bytes)
I0520 11:14:47.309796 294755 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-2151/.minikube/certs/key.pem (1675 bytes)
I0520 11:14:47.309836 294755 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-2151/.minikube/files/etc/ssl/certs/75122.pem (1708 bytes)
I0520 11:14:47.310532 294755 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-2151/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0520 11:14:47.363005 294755 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-2151/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0520 11:14:47.411364 294755 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-2151/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0520 11:14:47.455231 294755 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-2151/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0520 11:14:47.533426 294755 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-2151/.minikube/profiles/old-k8s-version-879853/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0520 11:14:47.585383 294755 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-2151/.minikube/profiles/old-k8s-version-879853/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0520 11:14:47.641601 294755 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-2151/.minikube/profiles/old-k8s-version-879853/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0520 11:14:47.704397 294755 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-2151/.minikube/profiles/old-k8s-version-879853/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0520 11:14:47.770490 294755 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-2151/.minikube/certs/7512.pem --> /usr/share/ca-certificates/7512.pem (1338 bytes)
I0520 11:14:47.851530 294755 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-2151/.minikube/files/etc/ssl/certs/75122.pem --> /usr/share/ca-certificates/75122.pem (1708 bytes)
I0520 11:14:47.903002 294755 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-2151/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0520 11:14:47.938693 294755 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0520 11:14:47.975427 294755 ssh_runner.go:195] Run: openssl version
I0520 11:14:47.981806 294755 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/75122.pem && ln -fs /usr/share/ca-certificates/75122.pem /etc/ssl/certs/75122.pem"
I0520 11:14:47.995316 294755 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/75122.pem
I0520 11:14:47.998925 294755 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 May 20 10:26 /usr/share/ca-certificates/75122.pem
I0520 11:14:47.999019 294755 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/75122.pem
I0520 11:14:48.008535 294755 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/75122.pem /etc/ssl/certs/3ec20f2e.0"
I0520 11:14:48.019265 294755 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0520 11:14:48.032213 294755 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0520 11:14:48.038525 294755 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 May 20 10:20 /usr/share/ca-certificates/minikubeCA.pem
I0520 11:14:48.038632 294755 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0520 11:14:48.049728 294755 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0520 11:14:48.061130 294755 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7512.pem && ln -fs /usr/share/ca-certificates/7512.pem /etc/ssl/certs/7512.pem"
I0520 11:14:48.078853 294755 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7512.pem
I0520 11:14:48.083143 294755 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 May 20 10:26 /usr/share/ca-certificates/7512.pem
I0520 11:14:48.083240 294755 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7512.pem
I0520 11:14:48.091991 294755 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/7512.pem /etc/ssl/certs/51391683.0"
I0520 11:14:48.105368 294755 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0520 11:14:48.111031 294755 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0520 11:14:48.123896 294755 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0520 11:14:48.134275 294755 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0520 11:14:48.147798 294755 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0520 11:14:48.165906 294755 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0520 11:14:48.178133 294755 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0520 11:14:48.189809 294755 kubeadm.go:391] StartCluster: {Name:old-k8s-version-879853 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-879853 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/
minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0520 11:14:48.189974 294755 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0520 11:14:48.214594 294755 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0520 11:14:48.227973 294755 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0520 11:14:48.227996 294755 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0520 11:14:48.228023 294755 kubeadm.go:587] restartPrimaryControlPlane start ...
I0520 11:14:48.228074 294755 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0520 11:14:48.239039 294755 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0520 11:14:48.239546 294755 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-879853" does not appear in /home/jenkins/minikube-integration/18925-2151/kubeconfig
I0520 11:14:48.239682 294755 kubeconfig.go:62] /home/jenkins/minikube-integration/18925-2151/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-879853" cluster setting kubeconfig missing "old-k8s-version-879853" context setting]
I0520 11:14:48.239990 294755 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18925-2151/kubeconfig: {Name:mk3d714476b7ca0e67bf2a31cd3b93dbb70011b5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:14:48.241517 294755 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0520 11:14:48.257175 294755 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.85.2
I0520 11:14:48.257218 294755 kubeadm.go:591] duration metric: took 29.188949ms to restartPrimaryControlPlane
I0520 11:14:48.257228 294755 kubeadm.go:393] duration metric: took 67.429992ms to StartCluster
I0520 11:14:48.257244 294755 settings.go:142] acquiring lock: {Name:mkf178671fce68e287b32051308c404994baee58 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:14:48.257313 294755 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/18925-2151/kubeconfig
I0520 11:14:48.257977 294755 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18925-2151/kubeconfig: {Name:mk3d714476b7ca0e67bf2a31cd3b93dbb70011b5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:14:48.258183 294755 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0520 11:14:48.261002 294755 out.go:177] * Verifying Kubernetes components...
I0520 11:14:48.258535 294755 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0520 11:14:48.258588 294755 config.go:182] Loaded profile config "old-k8s-version-879853": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0
I0520 11:14:48.262789 294755 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0520 11:14:48.262908 294755 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-879853"
I0520 11:14:48.262937 294755 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-879853"
W0520 11:14:48.262948 294755 addons.go:243] addon storage-provisioner should already be in state true
I0520 11:14:48.262980 294755 host.go:66] Checking if "old-k8s-version-879853" exists ...
I0520 11:14:48.263058 294755 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-879853"
I0520 11:14:48.263088 294755 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-879853"
I0520 11:14:48.263379 294755 cli_runner.go:164] Run: docker container inspect old-k8s-version-879853 --format={{.State.Status}}
I0520 11:14:48.263891 294755 cli_runner.go:164] Run: docker container inspect old-k8s-version-879853 --format={{.State.Status}}
I0520 11:14:48.264116 294755 addons.go:69] Setting dashboard=true in profile "old-k8s-version-879853"
I0520 11:14:48.264141 294755 addons.go:234] Setting addon dashboard=true in "old-k8s-version-879853"
W0520 11:14:48.264148 294755 addons.go:243] addon dashboard should already be in state true
I0520 11:14:48.264172 294755 host.go:66] Checking if "old-k8s-version-879853" exists ...
I0520 11:14:48.264534 294755 cli_runner.go:164] Run: docker container inspect old-k8s-version-879853 --format={{.State.Status}}
I0520 11:14:48.264778 294755 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-879853"
I0520 11:14:48.264805 294755 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-879853"
W0520 11:14:48.264811 294755 addons.go:243] addon metrics-server should already be in state true
I0520 11:14:48.264852 294755 host.go:66] Checking if "old-k8s-version-879853" exists ...
I0520 11:14:48.265321 294755 cli_runner.go:164] Run: docker container inspect old-k8s-version-879853 --format={{.State.Status}}
I0520 11:14:48.334005 294755 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-879853"
W0520 11:14:48.334031 294755 addons.go:243] addon default-storageclass should already be in state true
I0520 11:14:48.334056 294755 host.go:66] Checking if "old-k8s-version-879853" exists ...
I0520 11:14:48.334442 294755 cli_runner.go:164] Run: docker container inspect old-k8s-version-879853 --format={{.State.Status}}
I0520 11:14:48.342419 294755 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0520 11:14:48.347026 294755 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0520 11:14:48.350537 294755 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0520 11:14:48.350550 294755 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0520 11:14:48.347059 294755 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0520 11:14:48.354202 294755 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0520 11:14:48.354224 294755 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0520 11:14:48.354300 294755 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-879853
I0520 11:14:48.352271 294755 addons.go:426] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0520 11:14:48.357139 294755 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0520 11:14:48.357227 294755 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-879853
I0520 11:14:48.352285 294755 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0520 11:14:48.369115 294755 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-879853
I0520 11:14:48.384221 294755 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33083 SSHKeyPath:/home/jenkins/minikube-integration/18925-2151/.minikube/machines/old-k8s-version-879853/id_rsa Username:docker}
I0520 11:14:48.409650 294755 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0520 11:14:48.409670 294755 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0520 11:14:48.409744 294755 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-879853
I0520 11:14:48.421154 294755 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33083 SSHKeyPath:/home/jenkins/minikube-integration/18925-2151/.minikube/machines/old-k8s-version-879853/id_rsa Username:docker}
I0520 11:14:48.436077 294755 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33083 SSHKeyPath:/home/jenkins/minikube-integration/18925-2151/.minikube/machines/old-k8s-version-879853/id_rsa Username:docker}
I0520 11:14:48.453191 294755 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33083 SSHKeyPath:/home/jenkins/minikube-integration/18925-2151/.minikube/machines/old-k8s-version-879853/id_rsa Username:docker}
I0520 11:14:48.504077 294755 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0520 11:14:48.548903 294755 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-879853" to be "Ready" ...
I0520 11:14:48.614190 294755 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0520 11:14:48.614261 294755 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0520 11:14:48.659649 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0520 11:14:48.668221 294755 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0520 11:14:48.668246 294755 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0520 11:14:48.694863 294755 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0520 11:14:48.694890 294755 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0520 11:14:48.726695 294755 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0520 11:14:48.726723 294755 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0520 11:14:48.781273 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0520 11:14:48.830858 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0520 11:14:48.840164 294755 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0520 11:14:48.840192 294755 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
W0520 11:14:48.925792 294755 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:48.925830 294755 retry.go:31] will retry after 308.975377ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:48.975700 294755 addons.go:426] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0520 11:14:48.975747 294755 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0520 11:14:49.086878 294755 addons.go:426] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0520 11:14:49.086904 294755 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
W0520 11:14:49.126899 294755 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:49.126936 294755 retry.go:31] will retry after 329.731046ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 11:14:49.154115 294755 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:49.154149 294755 retry.go:31] will retry after 153.299281ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:49.156834 294755 addons.go:426] installing /etc/kubernetes/addons/dashboard-role.yaml
I0520 11:14:49.156861 294755 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0520 11:14:49.183827 294755 addons.go:426] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0520 11:14:49.183853 294755 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0520 11:14:49.219376 294755 addons.go:426] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0520 11:14:49.219417 294755 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0520 11:14:49.235716 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0520 11:14:49.251906 294755 addons.go:426] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0520 11:14:49.251931 294755 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0520 11:14:49.308186 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0520 11:14:49.344011 294755 addons.go:426] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0520 11:14:49.344039 294755 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0520 11:14:49.404734 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0520 11:14:49.457086 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0520 11:14:49.534697 294755 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:49.534732 294755 retry.go:31] will retry after 412.874952ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 11:14:49.715513 294755 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:49.715547 294755 retry.go:31] will retry after 509.636972ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 11:14:49.738577 294755 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:49.738613 294755 retry.go:31] will retry after 353.505529ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 11:14:49.738662 294755 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:49.738680 294755 retry.go:31] will retry after 214.552777ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:49.948123 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0520 11:14:49.954408 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0520 11:14:50.093066 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0520 11:14:50.169258 294755 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:50.169295 294755 retry.go:31] will retry after 434.334095ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 11:14:50.185590 294755 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:50.185624 294755 retry.go:31] will retry after 821.79813ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:50.225956 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0520 11:14:50.302518 294755 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:50.302551 294755 retry.go:31] will retry after 378.237404ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 11:14:50.379564 294755 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:50.379598 294755 retry.go:31] will retry after 416.67486ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:50.550248 294755 node_ready.go:53] error getting node "old-k8s-version-879853": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-879853": dial tcp 192.168.85.2:8443: connect: connection refused
I0520 11:14:50.604519 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0520 11:14:50.681771 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0520 11:14:50.731279 294755 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:50.731314 294755 retry.go:31] will retry after 1.198494969s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:50.796616 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0520 11:14:50.803871 294755 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:50.803907 294755 retry.go:31] will retry after 769.835859ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 11:14:50.901489 294755 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:50.901522 294755 retry.go:31] will retry after 610.187241ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:51.007882 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0520 11:14:51.116137 294755 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:51.116173 294755 retry.go:31] will retry after 1.048904201s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:51.512795 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0520 11:14:51.574798 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0520 11:14:51.689453 294755 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:51.689489 294755 retry.go:31] will retry after 1.357849644s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 11:14:51.789124 294755 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:51.789157 294755 retry.go:31] will retry after 1.078582453s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:51.930382 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0520 11:14:52.165350 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0520 11:14:52.313779 294755 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:52.313857 294755 retry.go:31] will retry after 1.219367878s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 11:14:52.558355 294755 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:52.558440 294755 retry.go:31] will retry after 1.880649029s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:52.867963 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0520 11:14:53.047811 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0520 11:14:53.050455 294755 node_ready.go:53] error getting node "old-k8s-version-879853": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-879853": dial tcp 192.168.85.2:8443: connect: connection refused
W0520 11:14:53.145248 294755 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:53.145396 294755 retry.go:31] will retry after 1.543297853s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:14:53.534437 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0520 11:14:54.439323 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0520 11:14:54.689277 294755 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0520 11:15:01.974363 294755 node_ready.go:49] node "old-k8s-version-879853" has status "Ready":"True"
I0520 11:15:01.974443 294755 node_ready.go:38] duration metric: took 13.425456199s for node "old-k8s-version-879853" to be "Ready" ...
I0520 11:15:01.974471 294755 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0520 11:15:02.136374 294755 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-6l85w" in "kube-system" namespace to be "Ready" ...
I0520 11:15:02.387308 294755 pod_ready.go:92] pod "coredns-74ff55c5b-6l85w" in "kube-system" namespace has status "Ready":"True"
I0520 11:15:02.387337 294755 pod_ready.go:81] duration metric: took 250.925989ms for pod "coredns-74ff55c5b-6l85w" in "kube-system" namespace to be "Ready" ...
I0520 11:15:02.387355 294755 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-879853" in "kube-system" namespace to be "Ready" ...
I0520 11:15:02.461839 294755 pod_ready.go:92] pod "etcd-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"True"
I0520 11:15:02.461868 294755 pod_ready.go:81] duration metric: took 74.503218ms for pod "etcd-old-k8s-version-879853" in "kube-system" namespace to be "Ready" ...
I0520 11:15:02.461890 294755 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-879853" in "kube-system" namespace to be "Ready" ...
I0520 11:15:03.873965 294755 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (10.826051544s)
I0520 11:15:03.874011 294755 addons.go:470] Verifying addon metrics-server=true in "old-k8s-version-879853"
I0520 11:15:03.874073 294755 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (10.33952515s)
I0520 11:15:03.874108 294755 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (9.434687595s)
I0520 11:15:04.350851 294755 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (9.661467998s)
I0520 11:15:04.353265 294755 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-879853 addons enable metrics-server
I0520 11:15:04.356986 294755 out.go:177] * Enabled addons: metrics-server, storage-provisioner, default-storageclass, dashboard
I0520 11:15:04.359564 294755 addons.go:505] duration metric: took 16.101011285s for enable addons: enabled=[metrics-server storage-provisioner default-storageclass dashboard]
I0520 11:15:04.468439 294755 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:06.468726 294755 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:08.968415 294755 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:10.470039 294755 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"True"
I0520 11:15:10.470066 294755 pod_ready.go:81] duration metric: took 8.008169224s for pod "kube-apiserver-old-k8s-version-879853" in "kube-system" namespace to be "Ready" ...
I0520 11:15:10.470081 294755 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace to be "Ready" ...
I0520 11:15:12.477454 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:14.976467 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:16.976698 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:19.476582 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:21.480582 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:24.033019 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:26.477279 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:28.976687 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:30.977039 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:33.478150 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:35.975834 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:37.976315 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:39.976461 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:41.987233 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:44.476731 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:46.477040 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:48.480557 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:50.976599 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:53.476474 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:55.477704 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:15:57.976846 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:00.477339 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:02.978469 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:05.476651 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:07.478611 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:09.976431 294755 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:11.476771 294755 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"True"
I0520 11:16:11.476793 294755 pod_ready.go:81] duration metric: took 1m1.006704556s for pod "kube-controller-manager-old-k8s-version-879853" in "kube-system" namespace to be "Ready" ...
I0520 11:16:11.476805 294755 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-2q9x5" in "kube-system" namespace to be "Ready" ...
I0520 11:16:11.481811 294755 pod_ready.go:92] pod "kube-proxy-2q9x5" in "kube-system" namespace has status "Ready":"True"
I0520 11:16:11.481899 294755 pod_ready.go:81] duration metric: took 5.086025ms for pod "kube-proxy-2q9x5" in "kube-system" namespace to be "Ready" ...
I0520 11:16:11.481925 294755 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-879853" in "kube-system" namespace to be "Ready" ...
I0520 11:16:13.488164 294755 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:15.988397 294755 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:17.988589 294755 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:20.489534 294755 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:22.490060 294755 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:24.995217 294755 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:27.490021 294755 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:28.489192 294755 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-879853" in "kube-system" namespace has status "Ready":"True"
I0520 11:16:28.489216 294755 pod_ready.go:81] duration metric: took 17.007271303s for pod "kube-scheduler-old-k8s-version-879853" in "kube-system" namespace to be "Ready" ...
I0520 11:16:28.489228 294755 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace to be "Ready" ...
I0520 11:16:30.495430 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:32.995592 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:34.996017 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:37.497013 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:39.498302 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:41.995921 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:44.498218 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:46.995687 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:49.496242 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:51.995169 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:53.995865 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:56.495754 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:16:58.497968 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:00.996752 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:03.498161 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:05.996439 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:08.496339 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:10.995517 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:12.996073 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:15.495606 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:17.495997 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:19.997165 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:22.495117 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:24.495743 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:26.496364 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:29.001717 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:31.496207 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:33.995980 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:36.495640 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:38.497133 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:40.995996 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:43.495580 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:45.995233 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:47.995681 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:50.495571 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:52.994726 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:54.995108 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:56.995252 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:17:58.996143 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:01.497842 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:03.995642 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:06.495345 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:08.495501 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:10.995892 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:13.061686 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:15.500917 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:17.501354 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:19.995724 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:21.995993 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:24.495949 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:26.498096 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:28.995223 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:30.995313 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:32.995540 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:34.995987 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:37.496428 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:39.995383 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:41.995875 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:43.995964 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:46.495826 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:48.995194 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:50.996018 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:53.495780 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:55.496397 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:57.995423 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:18:59.995833 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:01.996017 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:03.996344 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:05.997376 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:08.495788 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:10.995882 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:13.498460 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:15.994678 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:17.995305 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:19.996412 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:22.496151 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:24.998582 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:27.495478 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:29.496118 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:31.995335 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:34.000398 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:36.495592 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:38.496021 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:40.995696 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:43.495106 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:45.495475 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:47.495534 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:49.496076 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:51.995248 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:54.017406 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:56.495920 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:19:58.995888 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:20:00.996070 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:20:03.496253 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:20:05.995460 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:20:07.996020 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:20:10.496880 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:20:12.995169 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:20:14.995588 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:20:16.995958 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:20:19.497850 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:20:21.995197 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:20:23.995754 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:20:25.996122 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:20:28.496567 294755 pod_ready.go:102] pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace has status "Ready":"False"
I0520 11:20:28.496601 294755 pod_ready.go:81] duration metric: took 4m0.007365062s for pod "metrics-server-9975d5f86-24f8f" in "kube-system" namespace to be "Ready" ...
E0520 11:20:28.496612 294755 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0520 11:20:28.496620 294755 pod_ready.go:38] duration metric: took 5m26.522082822s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0520 11:20:28.496639 294755 api_server.go:52] waiting for apiserver process to appear ...
I0520 11:20:28.496720 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0520 11:20:28.514066 294755 logs.go:276] 2 containers: [40bd562563eb ac483fa044f2]
I0520 11:20:28.514149 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0520 11:20:28.534721 294755 logs.go:276] 2 containers: [730cfcbb3b45 55da4e11e773]
I0520 11:20:28.534812 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0520 11:20:28.560414 294755 logs.go:276] 2 containers: [005cb5179890 ae2339caab7b]
I0520 11:20:28.560501 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0520 11:20:28.576816 294755 logs.go:276] 2 containers: [e881ad64ded6 d7bf0c086e3a]
I0520 11:20:28.576962 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0520 11:20:28.598222 294755 logs.go:276] 2 containers: [d282e88b488b b1eddd083512]
I0520 11:20:28.598348 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0520 11:20:28.619563 294755 logs.go:276] 2 containers: [c8021e0d3603 33738d35cca5]
I0520 11:20:28.619674 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0520 11:20:28.635999 294755 logs.go:276] 0 containers: []
W0520 11:20:28.636059 294755 logs.go:278] No container was found matching "kindnet"
I0520 11:20:28.636141 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0520 11:20:28.654503 294755 logs.go:276] 1 containers: [1963b29e2abd]
I0520 11:20:28.654587 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0520 11:20:28.682586 294755 logs.go:276] 2 containers: [2b538e03219d 7d536cdf43d4]
I0520 11:20:28.682632 294755 logs.go:123] Gathering logs for kube-apiserver [ac483fa044f2] ...
I0520 11:20:28.682644 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ac483fa044f2"
I0520 11:20:28.767604 294755 logs.go:123] Gathering logs for kube-scheduler [e881ad64ded6] ...
I0520 11:20:28.767638 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e881ad64ded6"
I0520 11:20:28.791207 294755 logs.go:123] Gathering logs for kube-proxy [d282e88b488b] ...
I0520 11:20:28.791236 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d282e88b488b"
I0520 11:20:28.813274 294755 logs.go:123] Gathering logs for kube-apiserver [40bd562563eb] ...
I0520 11:20:28.813303 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 40bd562563eb"
I0520 11:20:28.858057 294755 logs.go:123] Gathering logs for coredns [005cb5179890] ...
I0520 11:20:28.858090 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 005cb5179890"
I0520 11:20:28.879290 294755 logs.go:123] Gathering logs for kube-proxy [b1eddd083512] ...
I0520 11:20:28.879324 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1eddd083512"
I0520 11:20:28.902011 294755 logs.go:123] Gathering logs for kube-controller-manager [c8021e0d3603] ...
I0520 11:20:28.902039 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c8021e0d3603"
I0520 11:20:28.977340 294755 logs.go:123] Gathering logs for kubernetes-dashboard [1963b29e2abd] ...
I0520 11:20:28.977380 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1963b29e2abd"
I0520 11:20:29.006214 294755 logs.go:123] Gathering logs for container status ...
I0520 11:20:29.006243 294755 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0520 11:20:29.079308 294755 logs.go:123] Gathering logs for dmesg ...
I0520 11:20:29.079342 294755 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0520 11:20:29.098885 294755 logs.go:123] Gathering logs for describe nodes ...
I0520 11:20:29.098917 294755 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0520 11:20:29.281599 294755 logs.go:123] Gathering logs for coredns [ae2339caab7b] ...
I0520 11:20:29.281628 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae2339caab7b"
I0520 11:20:29.307349 294755 logs.go:123] Gathering logs for kube-scheduler [d7bf0c086e3a] ...
I0520 11:20:29.307375 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d7bf0c086e3a"
I0520 11:20:29.346554 294755 logs.go:123] Gathering logs for kube-controller-manager [33738d35cca5] ...
I0520 11:20:29.346582 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 33738d35cca5"
I0520 11:20:29.394397 294755 logs.go:123] Gathering logs for kubelet ...
I0520 11:20:29.394426 294755 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0520 11:20:29.455360 294755 logs.go:138] Found kubelet problem: May 20 11:15:01 old-k8s-version-879853 kubelet[1232]: E0520 11:15:01.784714 1232 reflector.go:138] object-"kube-system"/"coredns-token-k8wk7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-k8wk7" is forbidden: User "system:node:old-k8s-version-879853" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-879853' and this object
W0520 11:20:29.456626 294755 logs.go:138] Found kubelet problem: May 20 11:15:01 old-k8s-version-879853 kubelet[1232]: E0520 11:15:01.784913 1232 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-879853" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-879853' and this object
W0520 11:20:29.456914 294755 logs.go:138] Found kubelet problem: May 20 11:15:01 old-k8s-version-879853 kubelet[1232]: E0520 11:15:01.785143 1232 reflector.go:138] object-"kube-system"/"storage-provisioner-token-8x5hz": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-8x5hz" is forbidden: User "system:node:old-k8s-version-879853" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-879853' and this object
W0520 11:20:29.457218 294755 logs.go:138] Found kubelet problem: May 20 11:15:01 old-k8s-version-879853 kubelet[1232]: E0520 11:15:01.785319 1232 reflector.go:138] object-"kube-system"/"metrics-server-token-4g8dg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-4g8dg" is forbidden: User "system:node:old-k8s-version-879853" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-879853' and this object
W0520 11:20:29.457435 294755 logs.go:138] Found kubelet problem: May 20 11:15:01 old-k8s-version-879853 kubelet[1232]: E0520 11:15:01.785509 1232 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-879853" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-879853' and this object
W0520 11:20:29.457665 294755 logs.go:138] Found kubelet problem: May 20 11:15:01 old-k8s-version-879853 kubelet[1232]: E0520 11:15:01.785712 1232 reflector.go:138] object-"kube-system"/"kube-proxy-token-4lffw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-4lffw" is forbidden: User "system:node:old-k8s-version-879853" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-879853' and this object
W0520 11:20:29.457885 294755 logs.go:138] Found kubelet problem: May 20 11:15:01 old-k8s-version-879853 kubelet[1232]: E0520 11:15:01.785913 1232 reflector.go:138] object-"default"/"default-token-44xhs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-44xhs" is forbidden: User "system:node:old-k8s-version-879853" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-879853' and this object
W0520 11:20:29.464100 294755 logs.go:138] Found kubelet problem: May 20 11:15:03 old-k8s-version-879853 kubelet[1232]: E0520 11:15:03.901214 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0520 11:20:29.464767 294755 logs.go:138] Found kubelet problem: May 20 11:15:04 old-k8s-version-879853 kubelet[1232]: E0520 11:15:04.328349 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.467914 294755 logs.go:138] Found kubelet problem: May 20 11:15:15 old-k8s-version-879853 kubelet[1232]: E0520 11:15:15.273676 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0520 11:20:29.472627 294755 logs.go:138] Found kubelet problem: May 20 11:15:22 old-k8s-version-879853 kubelet[1232]: E0520 11:15:22.024884 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0520 11:20:29.473022 294755 logs.go:138] Found kubelet problem: May 20 11:15:22 old-k8s-version-879853 kubelet[1232]: E0520 11:15:22.730051 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.473397 294755 logs.go:138] Found kubelet problem: May 20 11:15:28 old-k8s-version-879853 kubelet[1232]: E0520 11:15:28.228108 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.476024 294755 logs.go:138] Found kubelet problem: May 20 11:15:34 old-k8s-version-879853 kubelet[1232]: E0520 11:15:34.744287 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0520 11:20:29.476475 294755 logs.go:138] Found kubelet problem: May 20 11:15:34 old-k8s-version-879853 kubelet[1232]: E0520 11:15:34.859501 1232 pod_workers.go:191] Error syncing pod b1d644d9-1159-48f3-95ed-e9f20098fc95 ("storage-provisioner_kube-system(b1d644d9-1159-48f3-95ed-e9f20098fc95)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(b1d644d9-1159-48f3-95ed-e9f20098fc95)"
W0520 11:20:29.478582 294755 logs.go:138] Found kubelet problem: May 20 11:15:39 old-k8s-version-879853 kubelet[1232]: E0520 11:15:39.300402 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0520 11:20:29.479258 294755 logs.go:138] Found kubelet problem: May 20 11:15:49 old-k8s-version-879853 kubelet[1232]: E0520 11:15:49.228221 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.479447 294755 logs.go:138] Found kubelet problem: May 20 11:15:51 old-k8s-version-879853 kubelet[1232]: E0520 11:15:51.266478 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.481714 294755 logs.go:138] Found kubelet problem: May 20 11:16:01 old-k8s-version-879853 kubelet[1232]: E0520 11:16:01.699755 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0520 11:20:29.481905 294755 logs.go:138] Found kubelet problem: May 20 11:16:03 old-k8s-version-879853 kubelet[1232]: E0520 11:16:03.235985 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.482106 294755 logs.go:138] Found kubelet problem: May 20 11:16:14 old-k8s-version-879853 kubelet[1232]: E0520 11:16:14.227928 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.482294 294755 logs.go:138] Found kubelet problem: May 20 11:16:15 old-k8s-version-879853 kubelet[1232]: E0520 11:16:15.228541 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.484386 294755 logs.go:138] Found kubelet problem: May 20 11:16:27 old-k8s-version-879853 kubelet[1232]: E0520 11:16:27.259598 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0520 11:20:29.484587 294755 logs.go:138] Found kubelet problem: May 20 11:16:29 old-k8s-version-879853 kubelet[1232]: E0520 11:16:29.239845 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.484774 294755 logs.go:138] Found kubelet problem: May 20 11:16:39 old-k8s-version-879853 kubelet[1232]: E0520 11:16:39.229695 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.487096 294755 logs.go:138] Found kubelet problem: May 20 11:16:42 old-k8s-version-879853 kubelet[1232]: E0520 11:16:42.700115 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0520 11:20:29.487291 294755 logs.go:138] Found kubelet problem: May 20 11:16:51 old-k8s-version-879853 kubelet[1232]: E0520 11:16:51.246627 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.487498 294755 logs.go:138] Found kubelet problem: May 20 11:16:54 old-k8s-version-879853 kubelet[1232]: E0520 11:16:54.228244 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.487700 294755 logs.go:138] Found kubelet problem: May 20 11:17:06 old-k8s-version-879853 kubelet[1232]: E0520 11:17:06.228973 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.487903 294755 logs.go:138] Found kubelet problem: May 20 11:17:06 old-k8s-version-879853 kubelet[1232]: E0520 11:17:06.229350 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.488103 294755 logs.go:138] Found kubelet problem: May 20 11:17:20 old-k8s-version-879853 kubelet[1232]: E0520 11:17:20.228064 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.488291 294755 logs.go:138] Found kubelet problem: May 20 11:17:21 old-k8s-version-879853 kubelet[1232]: E0520 11:17:21.228613 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.488482 294755 logs.go:138] Found kubelet problem: May 20 11:17:32 old-k8s-version-879853 kubelet[1232]: E0520 11:17:32.228111 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.488693 294755 logs.go:138] Found kubelet problem: May 20 11:17:34 old-k8s-version-879853 kubelet[1232]: E0520 11:17:34.243800 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.488880 294755 logs.go:138] Found kubelet problem: May 20 11:17:46 old-k8s-version-879853 kubelet[1232]: E0520 11:17:46.228054 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.489086 294755 logs.go:138] Found kubelet problem: May 20 11:17:48 old-k8s-version-879853 kubelet[1232]: E0520 11:17:48.228327 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.489289 294755 logs.go:138] Found kubelet problem: May 20 11:18:00 old-k8s-version-879853 kubelet[1232]: E0520 11:18:00.229869 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.491404 294755 logs.go:138] Found kubelet problem: May 20 11:18:00 old-k8s-version-879853 kubelet[1232]: E0520 11:18:00.274754 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0520 11:20:29.493704 294755 logs.go:138] Found kubelet problem: May 20 11:18:11 old-k8s-version-879853 kubelet[1232]: E0520 11:18:11.688233 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0520 11:20:29.493898 294755 logs.go:138] Found kubelet problem: May 20 11:18:15 old-k8s-version-879853 kubelet[1232]: E0520 11:18:15.228362 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.494099 294755 logs.go:138] Found kubelet problem: May 20 11:18:23 old-k8s-version-879853 kubelet[1232]: E0520 11:18:23.238275 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.494287 294755 logs.go:138] Found kubelet problem: May 20 11:18:26 old-k8s-version-879853 kubelet[1232]: E0520 11:18:26.228357 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.494489 294755 logs.go:138] Found kubelet problem: May 20 11:18:34 old-k8s-version-879853 kubelet[1232]: E0520 11:18:34.227935 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.494675 294755 logs.go:138] Found kubelet problem: May 20 11:18:40 old-k8s-version-879853 kubelet[1232]: E0520 11:18:40.228209 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.494877 294755 logs.go:138] Found kubelet problem: May 20 11:18:49 old-k8s-version-879853 kubelet[1232]: E0520 11:18:49.235833 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.495063 294755 logs.go:138] Found kubelet problem: May 20 11:18:51 old-k8s-version-879853 kubelet[1232]: E0520 11:18:51.228282 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.495264 294755 logs.go:138] Found kubelet problem: May 20 11:19:03 old-k8s-version-879853 kubelet[1232]: E0520 11:19:03.230228 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.495454 294755 logs.go:138] Found kubelet problem: May 20 11:19:06 old-k8s-version-879853 kubelet[1232]: E0520 11:19:06.228367 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.495654 294755 logs.go:138] Found kubelet problem: May 20 11:19:15 old-k8s-version-879853 kubelet[1232]: E0520 11:19:15.232306 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.495843 294755 logs.go:138] Found kubelet problem: May 20 11:19:19 old-k8s-version-879853 kubelet[1232]: E0520 11:19:19.228241 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.496043 294755 logs.go:138] Found kubelet problem: May 20 11:19:26 old-k8s-version-879853 kubelet[1232]: E0520 11:19:26.228031 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.496232 294755 logs.go:138] Found kubelet problem: May 20 11:19:30 old-k8s-version-879853 kubelet[1232]: E0520 11:19:30.228171 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.496434 294755 logs.go:138] Found kubelet problem: May 20 11:19:40 old-k8s-version-879853 kubelet[1232]: E0520 11:19:40.228690 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.496622 294755 logs.go:138] Found kubelet problem: May 20 11:19:41 old-k8s-version-879853 kubelet[1232]: E0520 11:19:41.228364 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.496825 294755 logs.go:138] Found kubelet problem: May 20 11:19:53 old-k8s-version-879853 kubelet[1232]: E0520 11:19:53.236437 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.497013 294755 logs.go:138] Found kubelet problem: May 20 11:19:56 old-k8s-version-879853 kubelet[1232]: E0520 11:19:56.228010 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.497220 294755 logs.go:138] Found kubelet problem: May 20 11:20:08 old-k8s-version-879853 kubelet[1232]: E0520 11:20:08.228563 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.497413 294755 logs.go:138] Found kubelet problem: May 20 11:20:08 old-k8s-version-879853 kubelet[1232]: E0520 11:20:08.229095 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.497613 294755 logs.go:138] Found kubelet problem: May 20 11:20:21 old-k8s-version-879853 kubelet[1232]: E0520 11:20:21.228588 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.497806 294755 logs.go:138] Found kubelet problem: May 20 11:20:23 old-k8s-version-879853 kubelet[1232]: E0520 11:20:23.230344 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0520 11:20:29.497816 294755 logs.go:123] Gathering logs for etcd [55da4e11e773] ...
I0520 11:20:29.497830 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55da4e11e773"
I0520 11:20:29.526500 294755 logs.go:123] Gathering logs for storage-provisioner [2b538e03219d] ...
I0520 11:20:29.526531 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2b538e03219d"
I0520 11:20:29.550334 294755 logs.go:123] Gathering logs for storage-provisioner [7d536cdf43d4] ...
I0520 11:20:29.550365 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7d536cdf43d4"
I0520 11:20:29.571229 294755 logs.go:123] Gathering logs for Docker ...
I0520 11:20:29.571255 294755 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0520 11:20:29.599827 294755 logs.go:123] Gathering logs for etcd [730cfcbb3b45] ...
I0520 11:20:29.599866 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 730cfcbb3b45"
I0520 11:20:29.629989 294755 out.go:304] Setting ErrFile to fd 2...
I0520 11:20:29.630023 294755 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0520 11:20:29.630098 294755 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0520 11:20:29.630108 294755 out.go:239] May 20 11:19:56 old-k8s-version-879853 kubelet[1232]: E0520 11:19:56.228010 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:19:56 old-k8s-version-879853 kubelet[1232]: E0520 11:19:56.228010 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.630117 294755 out.go:239] May 20 11:20:08 old-k8s-version-879853 kubelet[1232]: E0520 11:20:08.228563 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
May 20 11:20:08 old-k8s-version-879853 kubelet[1232]: E0520 11:20:08.228563 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.630142 294755 out.go:239] May 20 11:20:08 old-k8s-version-879853 kubelet[1232]: E0520 11:20:08.229095 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:20:08 old-k8s-version-879853 kubelet[1232]: E0520 11:20:08.229095 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.630150 294755 out.go:239] May 20 11:20:21 old-k8s-version-879853 kubelet[1232]: E0520 11:20:21.228588 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
May 20 11:20:21 old-k8s-version-879853 kubelet[1232]: E0520 11:20:21.228588 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:29.630160 294755 out.go:239] May 20 11:20:23 old-k8s-version-879853 kubelet[1232]: E0520 11:20:23.230344 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:20:23 old-k8s-version-879853 kubelet[1232]: E0520 11:20:23.230344 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0520 11:20:29.630166 294755 out.go:304] Setting ErrFile to fd 2...
I0520 11:20:29.630177 294755 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0520 11:20:39.631205 294755 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0520 11:20:39.646682 294755 api_server.go:72] duration metric: took 5m51.388454699s to wait for apiserver process to appear ...
I0520 11:20:39.646717 294755 api_server.go:88] waiting for apiserver healthz status ...
I0520 11:20:39.646814 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0520 11:20:39.681446 294755 logs.go:276] 2 containers: [40bd562563eb ac483fa044f2]
I0520 11:20:39.681529 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0520 11:20:39.715894 294755 logs.go:276] 2 containers: [730cfcbb3b45 55da4e11e773]
I0520 11:20:39.715965 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0520 11:20:39.737234 294755 logs.go:276] 2 containers: [005cb5179890 ae2339caab7b]
I0520 11:20:39.737312 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0520 11:20:39.759250 294755 logs.go:276] 2 containers: [e881ad64ded6 d7bf0c086e3a]
I0520 11:20:39.759327 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0520 11:20:39.783251 294755 logs.go:276] 2 containers: [d282e88b488b b1eddd083512]
I0520 11:20:39.783338 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0520 11:20:39.804712 294755 logs.go:276] 2 containers: [c8021e0d3603 33738d35cca5]
I0520 11:20:39.804798 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0520 11:20:39.828938 294755 logs.go:276] 0 containers: []
W0520 11:20:39.828962 294755 logs.go:278] No container was found matching "kindnet"
I0520 11:20:39.829022 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0520 11:20:39.848394 294755 logs.go:276] 1 containers: [1963b29e2abd]
I0520 11:20:39.848472 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0520 11:20:39.872029 294755 logs.go:276] 2 containers: [2b538e03219d 7d536cdf43d4]
I0520 11:20:39.872065 294755 logs.go:123] Gathering logs for etcd [55da4e11e773] ...
I0520 11:20:39.872078 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55da4e11e773"
I0520 11:20:39.900184 294755 logs.go:123] Gathering logs for kube-scheduler [d7bf0c086e3a] ...
I0520 11:20:39.900222 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d7bf0c086e3a"
I0520 11:20:39.940252 294755 logs.go:123] Gathering logs for describe nodes ...
I0520 11:20:39.940281 294755 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0520 11:20:40.136266 294755 logs.go:123] Gathering logs for kube-apiserver [40bd562563eb] ...
I0520 11:20:40.136296 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 40bd562563eb"
I0520 11:20:40.199886 294755 logs.go:123] Gathering logs for kube-apiserver [ac483fa044f2] ...
I0520 11:20:40.199922 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ac483fa044f2"
I0520 11:20:40.291446 294755 logs.go:123] Gathering logs for etcd [730cfcbb3b45] ...
I0520 11:20:40.291524 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 730cfcbb3b45"
I0520 11:20:40.324901 294755 logs.go:123] Gathering logs for coredns [005cb5179890] ...
I0520 11:20:40.324983 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 005cb5179890"
I0520 11:20:40.355094 294755 logs.go:123] Gathering logs for kube-proxy [d282e88b488b] ...
I0520 11:20:40.355120 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d282e88b488b"
I0520 11:20:40.388428 294755 logs.go:123] Gathering logs for kube-proxy [b1eddd083512] ...
I0520 11:20:40.388455 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1eddd083512"
I0520 11:20:40.418991 294755 logs.go:123] Gathering logs for kubernetes-dashboard [1963b29e2abd] ...
I0520 11:20:40.419015 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1963b29e2abd"
I0520 11:20:40.446676 294755 logs.go:123] Gathering logs for kubelet ...
I0520 11:20:40.446703 294755 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0520 11:20:40.506686 294755 logs.go:138] Found kubelet problem: May 20 11:15:01 old-k8s-version-879853 kubelet[1232]: E0520 11:15:01.784714 1232 reflector.go:138] object-"kube-system"/"coredns-token-k8wk7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-k8wk7" is forbidden: User "system:node:old-k8s-version-879853" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-879853' and this object
W0520 11:20:40.506930 294755 logs.go:138] Found kubelet problem: May 20 11:15:01 old-k8s-version-879853 kubelet[1232]: E0520 11:15:01.784913 1232 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-879853" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-879853' and this object
W0520 11:20:40.507190 294755 logs.go:138] Found kubelet problem: May 20 11:15:01 old-k8s-version-879853 kubelet[1232]: E0520 11:15:01.785143 1232 reflector.go:138] object-"kube-system"/"storage-provisioner-token-8x5hz": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-8x5hz" is forbidden: User "system:node:old-k8s-version-879853" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-879853' and this object
W0520 11:20:40.507460 294755 logs.go:138] Found kubelet problem: May 20 11:15:01 old-k8s-version-879853 kubelet[1232]: E0520 11:15:01.785319 1232 reflector.go:138] object-"kube-system"/"metrics-server-token-4g8dg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-4g8dg" is forbidden: User "system:node:old-k8s-version-879853" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-879853' and this object
W0520 11:20:40.507746 294755 logs.go:138] Found kubelet problem: May 20 11:15:01 old-k8s-version-879853 kubelet[1232]: E0520 11:15:01.785509 1232 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-879853" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-879853' and this object
W0520 11:20:40.507993 294755 logs.go:138] Found kubelet problem: May 20 11:15:01 old-k8s-version-879853 kubelet[1232]: E0520 11:15:01.785712 1232 reflector.go:138] object-"kube-system"/"kube-proxy-token-4lffw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-4lffw" is forbidden: User "system:node:old-k8s-version-879853" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-879853' and this object
W0520 11:20:40.508251 294755 logs.go:138] Found kubelet problem: May 20 11:15:01 old-k8s-version-879853 kubelet[1232]: E0520 11:15:01.785913 1232 reflector.go:138] object-"default"/"default-token-44xhs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-44xhs" is forbidden: User "system:node:old-k8s-version-879853" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-879853' and this object
W0520 11:20:40.514695 294755 logs.go:138] Found kubelet problem: May 20 11:15:03 old-k8s-version-879853 kubelet[1232]: E0520 11:15:03.901214 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0520 11:20:40.515477 294755 logs.go:138] Found kubelet problem: May 20 11:15:04 old-k8s-version-879853 kubelet[1232]: E0520 11:15:04.328349 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.518645 294755 logs.go:138] Found kubelet problem: May 20 11:15:15 old-k8s-version-879853 kubelet[1232]: E0520 11:15:15.273676 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0520 11:20:40.523468 294755 logs.go:138] Found kubelet problem: May 20 11:15:22 old-k8s-version-879853 kubelet[1232]: E0520 11:15:22.024884 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0520 11:20:40.523930 294755 logs.go:138] Found kubelet problem: May 20 11:15:22 old-k8s-version-879853 kubelet[1232]: E0520 11:15:22.730051 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.524327 294755 logs.go:138] Found kubelet problem: May 20 11:15:28 old-k8s-version-879853 kubelet[1232]: E0520 11:15:28.228108 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.529134 294755 logs.go:138] Found kubelet problem: May 20 11:15:34 old-k8s-version-879853 kubelet[1232]: E0520 11:15:34.744287 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0520 11:20:40.529709 294755 logs.go:138] Found kubelet problem: May 20 11:15:34 old-k8s-version-879853 kubelet[1232]: E0520 11:15:34.859501 1232 pod_workers.go:191] Error syncing pod b1d644d9-1159-48f3-95ed-e9f20098fc95 ("storage-provisioner_kube-system(b1d644d9-1159-48f3-95ed-e9f20098fc95)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(b1d644d9-1159-48f3-95ed-e9f20098fc95)"
W0520 11:20:40.531951 294755 logs.go:138] Found kubelet problem: May 20 11:15:39 old-k8s-version-879853 kubelet[1232]: E0520 11:15:39.300402 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0520 11:20:40.532631 294755 logs.go:138] Found kubelet problem: May 20 11:15:49 old-k8s-version-879853 kubelet[1232]: E0520 11:15:49.228221 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.532816 294755 logs.go:138] Found kubelet problem: May 20 11:15:51 old-k8s-version-879853 kubelet[1232]: E0520 11:15:51.266478 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.535296 294755 logs.go:138] Found kubelet problem: May 20 11:16:01 old-k8s-version-879853 kubelet[1232]: E0520 11:16:01.699755 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0520 11:20:40.535494 294755 logs.go:138] Found kubelet problem: May 20 11:16:03 old-k8s-version-879853 kubelet[1232]: E0520 11:16:03.235985 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.535692 294755 logs.go:138] Found kubelet problem: May 20 11:16:14 old-k8s-version-879853 kubelet[1232]: E0520 11:16:14.227928 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.535875 294755 logs.go:138] Found kubelet problem: May 20 11:16:15 old-k8s-version-879853 kubelet[1232]: E0520 11:16:15.228541 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.538290 294755 logs.go:138] Found kubelet problem: May 20 11:16:27 old-k8s-version-879853 kubelet[1232]: E0520 11:16:27.259598 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0520 11:20:40.538542 294755 logs.go:138] Found kubelet problem: May 20 11:16:29 old-k8s-version-879853 kubelet[1232]: E0520 11:16:29.239845 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.538762 294755 logs.go:138] Found kubelet problem: May 20 11:16:39 old-k8s-version-879853 kubelet[1232]: E0520 11:16:39.229695 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.541076 294755 logs.go:138] Found kubelet problem: May 20 11:16:42 old-k8s-version-879853 kubelet[1232]: E0520 11:16:42.700115 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0520 11:20:40.541296 294755 logs.go:138] Found kubelet problem: May 20 11:16:51 old-k8s-version-879853 kubelet[1232]: E0520 11:16:51.246627 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.541529 294755 logs.go:138] Found kubelet problem: May 20 11:16:54 old-k8s-version-879853 kubelet[1232]: E0520 11:16:54.228244 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.541751 294755 logs.go:138] Found kubelet problem: May 20 11:17:06 old-k8s-version-879853 kubelet[1232]: E0520 11:17:06.228973 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.542010 294755 logs.go:138] Found kubelet problem: May 20 11:17:06 old-k8s-version-879853 kubelet[1232]: E0520 11:17:06.229350 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.542236 294755 logs.go:138] Found kubelet problem: May 20 11:17:20 old-k8s-version-879853 kubelet[1232]: E0520 11:17:20.228064 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.542446 294755 logs.go:138] Found kubelet problem: May 20 11:17:21 old-k8s-version-879853 kubelet[1232]: E0520 11:17:21.228613 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.542656 294755 logs.go:138] Found kubelet problem: May 20 11:17:32 old-k8s-version-879853 kubelet[1232]: E0520 11:17:32.228111 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.542881 294755 logs.go:138] Found kubelet problem: May 20 11:17:34 old-k8s-version-879853 kubelet[1232]: E0520 11:17:34.243800 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.543091 294755 logs.go:138] Found kubelet problem: May 20 11:17:46 old-k8s-version-879853 kubelet[1232]: E0520 11:17:46.228054 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.543315 294755 logs.go:138] Found kubelet problem: May 20 11:17:48 old-k8s-version-879853 kubelet[1232]: E0520 11:17:48.228327 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.543539 294755 logs.go:138] Found kubelet problem: May 20 11:18:00 old-k8s-version-879853 kubelet[1232]: E0520 11:18:00.229869 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.545695 294755 logs.go:138] Found kubelet problem: May 20 11:18:00 old-k8s-version-879853 kubelet[1232]: E0520 11:18:00.274754 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0520 11:20:40.548194 294755 logs.go:138] Found kubelet problem: May 20 11:18:11 old-k8s-version-879853 kubelet[1232]: E0520 11:18:11.688233 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0520 11:20:40.548446 294755 logs.go:138] Found kubelet problem: May 20 11:18:15 old-k8s-version-879853 kubelet[1232]: E0520 11:18:15.228362 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.548678 294755 logs.go:138] Found kubelet problem: May 20 11:18:23 old-k8s-version-879853 kubelet[1232]: E0520 11:18:23.238275 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.548892 294755 logs.go:138] Found kubelet problem: May 20 11:18:26 old-k8s-version-879853 kubelet[1232]: E0520 11:18:26.228357 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.549140 294755 logs.go:138] Found kubelet problem: May 20 11:18:34 old-k8s-version-879853 kubelet[1232]: E0520 11:18:34.227935 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.549355 294755 logs.go:138] Found kubelet problem: May 20 11:18:40 old-k8s-version-879853 kubelet[1232]: E0520 11:18:40.228209 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.549599 294755 logs.go:138] Found kubelet problem: May 20 11:18:49 old-k8s-version-879853 kubelet[1232]: E0520 11:18:49.235833 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.549810 294755 logs.go:138] Found kubelet problem: May 20 11:18:51 old-k8s-version-879853 kubelet[1232]: E0520 11:18:51.228282 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.550043 294755 logs.go:138] Found kubelet problem: May 20 11:19:03 old-k8s-version-879853 kubelet[1232]: E0520 11:19:03.230228 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.550286 294755 logs.go:138] Found kubelet problem: May 20 11:19:06 old-k8s-version-879853 kubelet[1232]: E0520 11:19:06.228367 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.550514 294755 logs.go:138] Found kubelet problem: May 20 11:19:15 old-k8s-version-879853 kubelet[1232]: E0520 11:19:15.232306 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.550729 294755 logs.go:138] Found kubelet problem: May 20 11:19:19 old-k8s-version-879853 kubelet[1232]: E0520 11:19:19.228241 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.550957 294755 logs.go:138] Found kubelet problem: May 20 11:19:26 old-k8s-version-879853 kubelet[1232]: E0520 11:19:26.228031 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.551289 294755 logs.go:138] Found kubelet problem: May 20 11:19:30 old-k8s-version-879853 kubelet[1232]: E0520 11:19:30.228171 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.551527 294755 logs.go:138] Found kubelet problem: May 20 11:19:40 old-k8s-version-879853 kubelet[1232]: E0520 11:19:40.228690 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.551738 294755 logs.go:138] Found kubelet problem: May 20 11:19:41 old-k8s-version-879853 kubelet[1232]: E0520 11:19:41.228364 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.551963 294755 logs.go:138] Found kubelet problem: May 20 11:19:53 old-k8s-version-879853 kubelet[1232]: E0520 11:19:53.236437 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.552217 294755 logs.go:138] Found kubelet problem: May 20 11:19:56 old-k8s-version-879853 kubelet[1232]: E0520 11:19:56.228010 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.552510 294755 logs.go:138] Found kubelet problem: May 20 11:20:08 old-k8s-version-879853 kubelet[1232]: E0520 11:20:08.228563 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.552730 294755 logs.go:138] Found kubelet problem: May 20 11:20:08 old-k8s-version-879853 kubelet[1232]: E0520 11:20:08.229095 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.552958 294755 logs.go:138] Found kubelet problem: May 20 11:20:21 old-k8s-version-879853 kubelet[1232]: E0520 11:20:21.228588 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.553181 294755 logs.go:138] Found kubelet problem: May 20 11:20:23 old-k8s-version-879853 kubelet[1232]: E0520 11:20:23.230344 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.553410 294755 logs.go:138] Found kubelet problem: May 20 11:20:32 old-k8s-version-879853 kubelet[1232]: E0520 11:20:32.228101 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.553628 294755 logs.go:138] Found kubelet problem: May 20 11:20:38 old-k8s-version-879853 kubelet[1232]: E0520 11:20:38.228264 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0520 11:20:40.553657 294755 logs.go:123] Gathering logs for container status ...
I0520 11:20:40.553689 294755 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0520 11:20:40.647578 294755 logs.go:123] Gathering logs for storage-provisioner [7d536cdf43d4] ...
I0520 11:20:40.647718 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7d536cdf43d4"
I0520 11:20:40.701383 294755 logs.go:123] Gathering logs for storage-provisioner [2b538e03219d] ...
I0520 11:20:40.701409 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2b538e03219d"
I0520 11:20:40.737898 294755 logs.go:123] Gathering logs for coredns [ae2339caab7b] ...
I0520 11:20:40.737935 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae2339caab7b"
I0520 11:20:40.769964 294755 logs.go:123] Gathering logs for kube-scheduler [e881ad64ded6] ...
I0520 11:20:40.770002 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e881ad64ded6"
I0520 11:20:40.795119 294755 logs.go:123] Gathering logs for kube-controller-manager [c8021e0d3603] ...
I0520 11:20:40.795148 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c8021e0d3603"
I0520 11:20:40.846418 294755 logs.go:123] Gathering logs for kube-controller-manager [33738d35cca5] ...
I0520 11:20:40.846450 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 33738d35cca5"
I0520 11:20:40.909951 294755 logs.go:123] Gathering logs for Docker ...
I0520 11:20:40.909980 294755 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0520 11:20:40.960750 294755 logs.go:123] Gathering logs for dmesg ...
I0520 11:20:40.960794 294755 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0520 11:20:41.000040 294755 out.go:304] Setting ErrFile to fd 2...
I0520 11:20:41.000121 294755 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0520 11:20:41.000202 294755 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0520 11:20:41.000243 294755 out.go:239] May 20 11:20:08 old-k8s-version-879853 kubelet[1232]: E0520 11:20:08.229095 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:20:08 old-k8s-version-879853 kubelet[1232]: E0520 11:20:08.229095 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:41.000276 294755 out.go:239] May 20 11:20:21 old-k8s-version-879853 kubelet[1232]: E0520 11:20:21.228588 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
May 20 11:20:21 old-k8s-version-879853 kubelet[1232]: E0520 11:20:21.228588 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:41.000327 294755 out.go:239] May 20 11:20:23 old-k8s-version-879853 kubelet[1232]: E0520 11:20:23.230344 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:20:23 old-k8s-version-879853 kubelet[1232]: E0520 11:20:23.230344 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:41.000363 294755 out.go:239] May 20 11:20:32 old-k8s-version-879853 kubelet[1232]: E0520 11:20:32.228101 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
May 20 11:20:32 old-k8s-version-879853 kubelet[1232]: E0520 11:20:32.228101 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:41.000408 294755 out.go:239] May 20 11:20:38 old-k8s-version-879853 kubelet[1232]: E0520 11:20:38.228264 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:20:38 old-k8s-version-879853 kubelet[1232]: E0520 11:20:38.228264 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0520 11:20:41.000448 294755 out.go:304] Setting ErrFile to fd 2...
I0520 11:20:41.000472 294755 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0520 11:20:51.000820 294755 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0520 11:20:51.013646 294755 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0520 11:20:51.016178 294755 out.go:177]
W0520 11:20:51.017929 294755 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0520 11:20:51.017985 294755 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0520 11:20:51.018012 294755 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0520 11:20:51.018017 294755 out.go:239] *
*
W0520 11:20:51.018917 294755 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0520 11:20:51.021916 294755 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-879853 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=docker --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-879853
helpers_test.go:235: (dbg) docker inspect old-k8s-version-879853:
-- stdout --
[
{
"Id": "fc7eeb36ac68b441ad6611b11c80a506159d575ccc8ec9815b80f4bac177c99d",
"Created": "2024-05-20T11:11:56.336888091Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 294950,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-05-20T11:14:38.755172694Z",
"FinishedAt": "2024-05-20T11:14:37.589470136Z"
},
"Image": "sha256:56620e18f2c2c9a0448fc43c42f840334bd2baea497ff8deae66477dd0dbfecf",
"ResolvConfPath": "/var/lib/docker/containers/fc7eeb36ac68b441ad6611b11c80a506159d575ccc8ec9815b80f4bac177c99d/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/fc7eeb36ac68b441ad6611b11c80a506159d575ccc8ec9815b80f4bac177c99d/hostname",
"HostsPath": "/var/lib/docker/containers/fc7eeb36ac68b441ad6611b11c80a506159d575ccc8ec9815b80f4bac177c99d/hosts",
"LogPath": "/var/lib/docker/containers/fc7eeb36ac68b441ad6611b11c80a506159d575ccc8ec9815b80f4bac177c99d/fc7eeb36ac68b441ad6611b11c80a506159d575ccc8ec9815b80f4bac177c99d-json.log",
"Name": "/old-k8s-version-879853",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-879853:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-879853",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/239981cb71a7ea03c9f41feb446de0d5a1f93e9aecc598d3fecfdf56be27afbe-init/diff:/var/lib/docker/overlay2/5223768ff4f8d0789b9175fc3fdf07e45fc06ea6efae7d6f7831e460b38e1113/diff",
"MergedDir": "/var/lib/docker/overlay2/239981cb71a7ea03c9f41feb446de0d5a1f93e9aecc598d3fecfdf56be27afbe/merged",
"UpperDir": "/var/lib/docker/overlay2/239981cb71a7ea03c9f41feb446de0d5a1f93e9aecc598d3fecfdf56be27afbe/diff",
"WorkDir": "/var/lib/docker/overlay2/239981cb71a7ea03c9f41feb446de0d5a1f93e9aecc598d3fecfdf56be27afbe/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-879853",
"Source": "/var/lib/docker/volumes/old-k8s-version-879853/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-879853",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-879853",
"name.minikube.sigs.k8s.io": "old-k8s-version-879853",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "6350ea3633f04bc420bace9763ac79eb3063a1ca4ad788a326edec9ec86a8927",
"SandboxKey": "/var/run/docker/netns/6350ea3633f0",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33083"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33082"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33079"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33081"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33080"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-879853": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:55:02",
"NetworkID": "bcbc67b107a43206a670d234c4dbb1efc28e72c3091a0ee9bf5d5da105a081e5",
"EndpointID": "93aba0ad1ffdcaa7d01e9bc6e34be94baaae8e4fd60e1a4527c34fe5af0d649d",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DriverOpts": null,
"DNSNames": [
"old-k8s-version-879853",
"fc7eeb36ac68"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-879853 -n old-k8s-version-879853
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-879853 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-879853 logs -n 25: (1.630326405s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| ssh | docker-flags-803587 ssh | docker-flags-803587 | jenkins | v1.33.1 | 20 May 24 11:11 UTC | 20 May 24 11:11 UTC |
| | sudo systemctl show docker | | | | | |
| | --property=Environment | | | | | |
| | --no-pager | | | | | |
| ssh | docker-flags-803587 ssh | docker-flags-803587 | jenkins | v1.33.1 | 20 May 24 11:11 UTC | 20 May 24 11:11 UTC |
| | sudo systemctl show docker | | | | | |
| | --property=ExecStart | | | | | |
| | --no-pager | | | | | |
| delete | -p docker-flags-803587 | docker-flags-803587 | jenkins | v1.33.1 | 20 May 24 11:11 UTC | 20 May 24 11:11 UTC |
| start | -p cert-options-156777 | cert-options-156777 | jenkins | v1.33.1 | 20 May 24 11:11 UTC | 20 May 24 11:11 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| ssh | cert-options-156777 ssh | cert-options-156777 | jenkins | v1.33.1 | 20 May 24 11:11 UTC | 20 May 24 11:11 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-156777 -- sudo | cert-options-156777 | jenkins | v1.33.1 | 20 May 24 11:11 UTC | 20 May 24 11:11 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-156777 | cert-options-156777 | jenkins | v1.33.1 | 20 May 24 11:11 UTC | 20 May 24 11:11 UTC |
| start | -p old-k8s-version-879853 | old-k8s-version-879853 | jenkins | v1.33.1 | 20 May 24 11:11 UTC | 20 May 24 11:14 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-748987 | cert-expiration-748987 | jenkins | v1.33.1 | 20 May 24 11:13 UTC | 20 May 24 11:14 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| delete | -p cert-expiration-748987 | cert-expiration-748987 | jenkins | v1.33.1 | 20 May 24 11:14 UTC | 20 May 24 11:14 UTC |
| start | -p | default-k8s-diff-port-753976 | jenkins | v1.33.1 | 20 May 24 11:14 UTC | 20 May 24 11:15 UTC |
| | default-k8s-diff-port-753976 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --kubernetes-version=v1.30.1 | | | | | |
| addons | enable metrics-server -p old-k8s-version-879853 | old-k8s-version-879853 | jenkins | v1.33.1 | 20 May 24 11:14 UTC | 20 May 24 11:14 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-879853 | old-k8s-version-879853 | jenkins | v1.33.1 | 20 May 24 11:14 UTC | 20 May 24 11:14 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-879853 | old-k8s-version-879853 | jenkins | v1.33.1 | 20 May 24 11:14 UTC | 20 May 24 11:14 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-879853 | old-k8s-version-879853 | jenkins | v1.33.1 | 20 May 24 11:14 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p default-k8s-diff-port-753976 | default-k8s-diff-port-753976 | jenkins | v1.33.1 | 20 May 24 11:15 UTC | 20 May 24 11:15 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p | default-k8s-diff-port-753976 | jenkins | v1.33.1 | 20 May 24 11:15 UTC | 20 May 24 11:15 UTC |
| | default-k8s-diff-port-753976 | | | | | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p default-k8s-diff-port-753976 | default-k8s-diff-port-753976 | jenkins | v1.33.1 | 20 May 24 11:15 UTC | 20 May 24 11:15 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p | default-k8s-diff-port-753976 | jenkins | v1.33.1 | 20 May 24 11:15 UTC | 20 May 24 11:20 UTC |
| | default-k8s-diff-port-753976 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --kubernetes-version=v1.30.1 | | | | | |
| image | default-k8s-diff-port-753976 | default-k8s-diff-port-753976 | jenkins | v1.33.1 | 20 May 24 11:20 UTC | 20 May 24 11:20 UTC |
| | image list --format=json | | | | | |
| pause | -p | default-k8s-diff-port-753976 | jenkins | v1.33.1 | 20 May 24 11:20 UTC | 20 May 24 11:20 UTC |
| | default-k8s-diff-port-753976 | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p | default-k8s-diff-port-753976 | jenkins | v1.33.1 | 20 May 24 11:20 UTC | 20 May 24 11:20 UTC |
| | default-k8s-diff-port-753976 | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p | default-k8s-diff-port-753976 | jenkins | v1.33.1 | 20 May 24 11:20 UTC | 20 May 24 11:20 UTC |
| | default-k8s-diff-port-753976 | | | | | |
| delete | -p | default-k8s-diff-port-753976 | jenkins | v1.33.1 | 20 May 24 11:20 UTC | 20 May 24 11:20 UTC |
| | default-k8s-diff-port-753976 | | | | | |
| start | -p embed-certs-601362 | embed-certs-601362 | jenkins | v1.33.1 | 20 May 24 11:20 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --kubernetes-version=v1.30.1 | | | | | |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/05/20 11:20:40
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.22.3 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0520 11:20:40.153648 309055 out.go:291] Setting OutFile to fd 1 ...
I0520 11:20:40.153806 309055 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0520 11:20:40.153811 309055 out.go:304] Setting ErrFile to fd 2...
I0520 11:20:40.153816 309055 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0520 11:20:40.154144 309055 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18925-2151/.minikube/bin
I0520 11:20:40.154596 309055 out.go:298] Setting JSON to false
I0520 11:20:40.155660 309055 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":3761,"bootTime":1716200280,"procs":227,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1061-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0520 11:20:40.155734 309055 start.go:139] virtualization:
I0520 11:20:40.158350 309055 out.go:177] * [embed-certs-601362] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0520 11:20:40.160782 309055 out.go:177] - MINIKUBE_LOCATION=18925
I0520 11:20:40.162359 309055 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0520 11:20:40.160965 309055 notify.go:220] Checking for updates...
I0520 11:20:40.168835 309055 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18925-2151/kubeconfig
I0520 11:20:40.170874 309055 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18925-2151/.minikube
I0520 11:20:40.172800 309055 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0520 11:20:40.174637 309055 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0520 11:20:40.177661 309055 config.go:182] Loaded profile config "old-k8s-version-879853": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0
I0520 11:20:40.177764 309055 driver.go:392] Setting default libvirt URI to qemu:///system
I0520 11:20:40.209128 309055 docker.go:122] docker version: linux-26.1.3:Docker Engine - Community
I0520 11:20:40.209248 309055 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0520 11:20:40.311483 309055 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:33 OomKillDisable:true NGoroutines:52 SystemTime:2024-05-20 11:20:40.300880776 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1061-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214966272 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:26.1.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.0]] Warnings:<nil>}}
I0520 11:20:40.311587 309055 docker.go:295] overlay module found
I0520 11:20:40.313927 309055 out.go:177] * Using the docker driver based on user configuration
I0520 11:20:40.315817 309055 start.go:297] selected driver: docker
I0520 11:20:40.315832 309055 start.go:901] validating driver "docker" against <nil>
I0520 11:20:40.315846 309055 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0520 11:20:40.316477 309055 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0520 11:20:40.410643 309055 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:33 OomKillDisable:true NGoroutines:52 SystemTime:2024-05-20 11:20:40.398677384 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1061-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214966272 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:26.1.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.0]] Warnings:<nil>}}
I0520 11:20:40.410810 309055 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0520 11:20:40.411029 309055 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0520 11:20:40.413829 309055 out.go:177] * Using Docker driver with root privileges
I0520 11:20:40.416048 309055 cni.go:84] Creating CNI manager for ""
I0520 11:20:40.416086 309055 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0520 11:20:40.416104 309055 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0520 11:20:40.416180 309055 start.go:340] cluster config:
{Name:embed-certs-601362 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:embed-certs-601362 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSH
AuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0520 11:20:40.419114 309055 out.go:177] * Starting "embed-certs-601362" primary control-plane node in "embed-certs-601362" cluster
I0520 11:20:40.421377 309055 cache.go:121] Beginning downloading kic base image for docker with docker
I0520 11:20:40.423047 309055 out.go:177] * Pulling base image v0.0.44-1715707529-18887 ...
I0520 11:20:40.424851 309055 preload.go:132] Checking if preload exists for k8s version v1.30.1 and runtime docker
I0520 11:20:40.424891 309055 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18925-2151/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.1-docker-overlay2-arm64.tar.lz4
I0520 11:20:40.424941 309055 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a in local docker daemon
I0520 11:20:40.425135 309055 cache.go:56] Caching tarball of preloaded images
I0520 11:20:40.425220 309055 preload.go:173] Found /home/jenkins/minikube-integration/18925-2151/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download
I0520 11:20:40.425231 309055 cache.go:59] Finished verifying existence of preloaded tar for v1.30.1 on docker
I0520 11:20:40.425335 309055 profile.go:143] Saving config to /home/jenkins/minikube-integration/18925-2151/.minikube/profiles/embed-certs-601362/config.json ...
I0520 11:20:40.425353 309055 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18925-2151/.minikube/profiles/embed-certs-601362/config.json: {Name:mk59d7a98675dbb2e5abdd5803478d7bc1e01456 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:20:40.440270 309055 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a in local docker daemon, skipping pull
I0520 11:20:40.440297 309055 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a exists in daemon, skipping load
I0520 11:20:40.440314 309055 cache.go:194] Successfully downloaded all kic artifacts
I0520 11:20:40.440357 309055 start.go:360] acquireMachinesLock for embed-certs-601362: {Name:mkc5652e69c99cb8c4d760ae0aff56e086dc8450 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0520 11:20:40.440478 309055 start.go:364] duration metric: took 103.541µs to acquireMachinesLock for "embed-certs-601362"
I0520 11:20:40.440502 309055 start.go:93] Provisioning new machine with config: &{Name:embed-certs-601362 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:embed-certs-601362 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:f
alse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:docker ControlPlane:true Worker:true}
I0520 11:20:40.440577 309055 start.go:125] createHost starting for "" (driver="docker")
I0520 11:20:39.631205 294755 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0520 11:20:39.646682 294755 api_server.go:72] duration metric: took 5m51.388454699s to wait for apiserver process to appear ...
I0520 11:20:39.646717 294755 api_server.go:88] waiting for apiserver healthz status ...
I0520 11:20:39.646814 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0520 11:20:39.681446 294755 logs.go:276] 2 containers: [40bd562563eb ac483fa044f2]
I0520 11:20:39.681529 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0520 11:20:39.715894 294755 logs.go:276] 2 containers: [730cfcbb3b45 55da4e11e773]
I0520 11:20:39.715965 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0520 11:20:39.737234 294755 logs.go:276] 2 containers: [005cb5179890 ae2339caab7b]
I0520 11:20:39.737312 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0520 11:20:39.759250 294755 logs.go:276] 2 containers: [e881ad64ded6 d7bf0c086e3a]
I0520 11:20:39.759327 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0520 11:20:39.783251 294755 logs.go:276] 2 containers: [d282e88b488b b1eddd083512]
I0520 11:20:39.783338 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0520 11:20:39.804712 294755 logs.go:276] 2 containers: [c8021e0d3603 33738d35cca5]
I0520 11:20:39.804798 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0520 11:20:39.828938 294755 logs.go:276] 0 containers: []
W0520 11:20:39.828962 294755 logs.go:278] No container was found matching "kindnet"
I0520 11:20:39.829022 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0520 11:20:39.848394 294755 logs.go:276] 1 containers: [1963b29e2abd]
I0520 11:20:39.848472 294755 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0520 11:20:39.872029 294755 logs.go:276] 2 containers: [2b538e03219d 7d536cdf43d4]
I0520 11:20:39.872065 294755 logs.go:123] Gathering logs for etcd [55da4e11e773] ...
I0520 11:20:39.872078 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 55da4e11e773"
I0520 11:20:39.900184 294755 logs.go:123] Gathering logs for kube-scheduler [d7bf0c086e3a] ...
I0520 11:20:39.900222 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d7bf0c086e3a"
I0520 11:20:39.940252 294755 logs.go:123] Gathering logs for describe nodes ...
I0520 11:20:39.940281 294755 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0520 11:20:40.136266 294755 logs.go:123] Gathering logs for kube-apiserver [40bd562563eb] ...
I0520 11:20:40.136296 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 40bd562563eb"
I0520 11:20:40.199886 294755 logs.go:123] Gathering logs for kube-apiserver [ac483fa044f2] ...
I0520 11:20:40.199922 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ac483fa044f2"
I0520 11:20:40.291446 294755 logs.go:123] Gathering logs for etcd [730cfcbb3b45] ...
I0520 11:20:40.291524 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 730cfcbb3b45"
I0520 11:20:40.324901 294755 logs.go:123] Gathering logs for coredns [005cb5179890] ...
I0520 11:20:40.324983 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 005cb5179890"
I0520 11:20:40.355094 294755 logs.go:123] Gathering logs for kube-proxy [d282e88b488b] ...
I0520 11:20:40.355120 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d282e88b488b"
I0520 11:20:40.388428 294755 logs.go:123] Gathering logs for kube-proxy [b1eddd083512] ...
I0520 11:20:40.388455 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b1eddd083512"
I0520 11:20:40.418991 294755 logs.go:123] Gathering logs for kubernetes-dashboard [1963b29e2abd] ...
I0520 11:20:40.419015 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1963b29e2abd"
I0520 11:20:40.446676 294755 logs.go:123] Gathering logs for kubelet ...
I0520 11:20:40.446703 294755 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0520 11:20:40.506686 294755 logs.go:138] Found kubelet problem: May 20 11:15:01 old-k8s-version-879853 kubelet[1232]: E0520 11:15:01.784714 1232 reflector.go:138] object-"kube-system"/"coredns-token-k8wk7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-k8wk7" is forbidden: User "system:node:old-k8s-version-879853" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-879853' and this object
W0520 11:20:40.506930 294755 logs.go:138] Found kubelet problem: May 20 11:15:01 old-k8s-version-879853 kubelet[1232]: E0520 11:15:01.784913 1232 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-879853" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-879853' and this object
W0520 11:20:40.507190 294755 logs.go:138] Found kubelet problem: May 20 11:15:01 old-k8s-version-879853 kubelet[1232]: E0520 11:15:01.785143 1232 reflector.go:138] object-"kube-system"/"storage-provisioner-token-8x5hz": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-8x5hz" is forbidden: User "system:node:old-k8s-version-879853" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-879853' and this object
W0520 11:20:40.507460 294755 logs.go:138] Found kubelet problem: May 20 11:15:01 old-k8s-version-879853 kubelet[1232]: E0520 11:15:01.785319 1232 reflector.go:138] object-"kube-system"/"metrics-server-token-4g8dg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-4g8dg" is forbidden: User "system:node:old-k8s-version-879853" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-879853' and this object
W0520 11:20:40.507746 294755 logs.go:138] Found kubelet problem: May 20 11:15:01 old-k8s-version-879853 kubelet[1232]: E0520 11:15:01.785509 1232 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-879853" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-879853' and this object
W0520 11:20:40.507993 294755 logs.go:138] Found kubelet problem: May 20 11:15:01 old-k8s-version-879853 kubelet[1232]: E0520 11:15:01.785712 1232 reflector.go:138] object-"kube-system"/"kube-proxy-token-4lffw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-4lffw" is forbidden: User "system:node:old-k8s-version-879853" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-879853' and this object
W0520 11:20:40.508251 294755 logs.go:138] Found kubelet problem: May 20 11:15:01 old-k8s-version-879853 kubelet[1232]: E0520 11:15:01.785913 1232 reflector.go:138] object-"default"/"default-token-44xhs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-44xhs" is forbidden: User "system:node:old-k8s-version-879853" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-879853' and this object
W0520 11:20:40.514695 294755 logs.go:138] Found kubelet problem: May 20 11:15:03 old-k8s-version-879853 kubelet[1232]: E0520 11:15:03.901214 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0520 11:20:40.515477 294755 logs.go:138] Found kubelet problem: May 20 11:15:04 old-k8s-version-879853 kubelet[1232]: E0520 11:15:04.328349 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.518645 294755 logs.go:138] Found kubelet problem: May 20 11:15:15 old-k8s-version-879853 kubelet[1232]: E0520 11:15:15.273676 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0520 11:20:40.523468 294755 logs.go:138] Found kubelet problem: May 20 11:15:22 old-k8s-version-879853 kubelet[1232]: E0520 11:15:22.024884 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0520 11:20:40.523930 294755 logs.go:138] Found kubelet problem: May 20 11:15:22 old-k8s-version-879853 kubelet[1232]: E0520 11:15:22.730051 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.524327 294755 logs.go:138] Found kubelet problem: May 20 11:15:28 old-k8s-version-879853 kubelet[1232]: E0520 11:15:28.228108 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.529134 294755 logs.go:138] Found kubelet problem: May 20 11:15:34 old-k8s-version-879853 kubelet[1232]: E0520 11:15:34.744287 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0520 11:20:40.529709 294755 logs.go:138] Found kubelet problem: May 20 11:15:34 old-k8s-version-879853 kubelet[1232]: E0520 11:15:34.859501 1232 pod_workers.go:191] Error syncing pod b1d644d9-1159-48f3-95ed-e9f20098fc95 ("storage-provisioner_kube-system(b1d644d9-1159-48f3-95ed-e9f20098fc95)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(b1d644d9-1159-48f3-95ed-e9f20098fc95)"
W0520 11:20:40.531951 294755 logs.go:138] Found kubelet problem: May 20 11:15:39 old-k8s-version-879853 kubelet[1232]: E0520 11:15:39.300402 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0520 11:20:40.532631 294755 logs.go:138] Found kubelet problem: May 20 11:15:49 old-k8s-version-879853 kubelet[1232]: E0520 11:15:49.228221 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.532816 294755 logs.go:138] Found kubelet problem: May 20 11:15:51 old-k8s-version-879853 kubelet[1232]: E0520 11:15:51.266478 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.535296 294755 logs.go:138] Found kubelet problem: May 20 11:16:01 old-k8s-version-879853 kubelet[1232]: E0520 11:16:01.699755 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0520 11:20:40.535494 294755 logs.go:138] Found kubelet problem: May 20 11:16:03 old-k8s-version-879853 kubelet[1232]: E0520 11:16:03.235985 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.535692 294755 logs.go:138] Found kubelet problem: May 20 11:16:14 old-k8s-version-879853 kubelet[1232]: E0520 11:16:14.227928 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.535875 294755 logs.go:138] Found kubelet problem: May 20 11:16:15 old-k8s-version-879853 kubelet[1232]: E0520 11:16:15.228541 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.538290 294755 logs.go:138] Found kubelet problem: May 20 11:16:27 old-k8s-version-879853 kubelet[1232]: E0520 11:16:27.259598 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0520 11:20:40.538542 294755 logs.go:138] Found kubelet problem: May 20 11:16:29 old-k8s-version-879853 kubelet[1232]: E0520 11:16:29.239845 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.538762 294755 logs.go:138] Found kubelet problem: May 20 11:16:39 old-k8s-version-879853 kubelet[1232]: E0520 11:16:39.229695 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.541076 294755 logs.go:138] Found kubelet problem: May 20 11:16:42 old-k8s-version-879853 kubelet[1232]: E0520 11:16:42.700115 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0520 11:20:40.541296 294755 logs.go:138] Found kubelet problem: May 20 11:16:51 old-k8s-version-879853 kubelet[1232]: E0520 11:16:51.246627 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.541529 294755 logs.go:138] Found kubelet problem: May 20 11:16:54 old-k8s-version-879853 kubelet[1232]: E0520 11:16:54.228244 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.541751 294755 logs.go:138] Found kubelet problem: May 20 11:17:06 old-k8s-version-879853 kubelet[1232]: E0520 11:17:06.228973 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.542010 294755 logs.go:138] Found kubelet problem: May 20 11:17:06 old-k8s-version-879853 kubelet[1232]: E0520 11:17:06.229350 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.542236 294755 logs.go:138] Found kubelet problem: May 20 11:17:20 old-k8s-version-879853 kubelet[1232]: E0520 11:17:20.228064 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.542446 294755 logs.go:138] Found kubelet problem: May 20 11:17:21 old-k8s-version-879853 kubelet[1232]: E0520 11:17:21.228613 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.542656 294755 logs.go:138] Found kubelet problem: May 20 11:17:32 old-k8s-version-879853 kubelet[1232]: E0520 11:17:32.228111 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.542881 294755 logs.go:138] Found kubelet problem: May 20 11:17:34 old-k8s-version-879853 kubelet[1232]: E0520 11:17:34.243800 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.543091 294755 logs.go:138] Found kubelet problem: May 20 11:17:46 old-k8s-version-879853 kubelet[1232]: E0520 11:17:46.228054 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.543315 294755 logs.go:138] Found kubelet problem: May 20 11:17:48 old-k8s-version-879853 kubelet[1232]: E0520 11:17:48.228327 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.543539 294755 logs.go:138] Found kubelet problem: May 20 11:18:00 old-k8s-version-879853 kubelet[1232]: E0520 11:18:00.229869 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.545695 294755 logs.go:138] Found kubelet problem: May 20 11:18:00 old-k8s-version-879853 kubelet[1232]: E0520 11:18:00.274754 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0520 11:20:40.548194 294755 logs.go:138] Found kubelet problem: May 20 11:18:11 old-k8s-version-879853 kubelet[1232]: E0520 11:18:11.688233 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0520 11:20:40.548446 294755 logs.go:138] Found kubelet problem: May 20 11:18:15 old-k8s-version-879853 kubelet[1232]: E0520 11:18:15.228362 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.548678 294755 logs.go:138] Found kubelet problem: May 20 11:18:23 old-k8s-version-879853 kubelet[1232]: E0520 11:18:23.238275 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.548892 294755 logs.go:138] Found kubelet problem: May 20 11:18:26 old-k8s-version-879853 kubelet[1232]: E0520 11:18:26.228357 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.549140 294755 logs.go:138] Found kubelet problem: May 20 11:18:34 old-k8s-version-879853 kubelet[1232]: E0520 11:18:34.227935 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.549355 294755 logs.go:138] Found kubelet problem: May 20 11:18:40 old-k8s-version-879853 kubelet[1232]: E0520 11:18:40.228209 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.549599 294755 logs.go:138] Found kubelet problem: May 20 11:18:49 old-k8s-version-879853 kubelet[1232]: E0520 11:18:49.235833 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.549810 294755 logs.go:138] Found kubelet problem: May 20 11:18:51 old-k8s-version-879853 kubelet[1232]: E0520 11:18:51.228282 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.550043 294755 logs.go:138] Found kubelet problem: May 20 11:19:03 old-k8s-version-879853 kubelet[1232]: E0520 11:19:03.230228 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.550286 294755 logs.go:138] Found kubelet problem: May 20 11:19:06 old-k8s-version-879853 kubelet[1232]: E0520 11:19:06.228367 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.550514 294755 logs.go:138] Found kubelet problem: May 20 11:19:15 old-k8s-version-879853 kubelet[1232]: E0520 11:19:15.232306 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.550729 294755 logs.go:138] Found kubelet problem: May 20 11:19:19 old-k8s-version-879853 kubelet[1232]: E0520 11:19:19.228241 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.550957 294755 logs.go:138] Found kubelet problem: May 20 11:19:26 old-k8s-version-879853 kubelet[1232]: E0520 11:19:26.228031 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.551289 294755 logs.go:138] Found kubelet problem: May 20 11:19:30 old-k8s-version-879853 kubelet[1232]: E0520 11:19:30.228171 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.551527 294755 logs.go:138] Found kubelet problem: May 20 11:19:40 old-k8s-version-879853 kubelet[1232]: E0520 11:19:40.228690 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.551738 294755 logs.go:138] Found kubelet problem: May 20 11:19:41 old-k8s-version-879853 kubelet[1232]: E0520 11:19:41.228364 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.551963 294755 logs.go:138] Found kubelet problem: May 20 11:19:53 old-k8s-version-879853 kubelet[1232]: E0520 11:19:53.236437 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.552217 294755 logs.go:138] Found kubelet problem: May 20 11:19:56 old-k8s-version-879853 kubelet[1232]: E0520 11:19:56.228010 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.552510 294755 logs.go:138] Found kubelet problem: May 20 11:20:08 old-k8s-version-879853 kubelet[1232]: E0520 11:20:08.228563 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.552730 294755 logs.go:138] Found kubelet problem: May 20 11:20:08 old-k8s-version-879853 kubelet[1232]: E0520 11:20:08.229095 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.552958 294755 logs.go:138] Found kubelet problem: May 20 11:20:21 old-k8s-version-879853 kubelet[1232]: E0520 11:20:21.228588 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.553181 294755 logs.go:138] Found kubelet problem: May 20 11:20:23 old-k8s-version-879853 kubelet[1232]: E0520 11:20:23.230344 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.553410 294755 logs.go:138] Found kubelet problem: May 20 11:20:32 old-k8s-version-879853 kubelet[1232]: E0520 11:20:32.228101 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:40.553628 294755 logs.go:138] Found kubelet problem: May 20 11:20:38 old-k8s-version-879853 kubelet[1232]: E0520 11:20:38.228264 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0520 11:20:40.553657 294755 logs.go:123] Gathering logs for container status ...
I0520 11:20:40.553689 294755 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0520 11:20:40.647578 294755 logs.go:123] Gathering logs for storage-provisioner [7d536cdf43d4] ...
I0520 11:20:40.647718 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7d536cdf43d4"
I0520 11:20:40.701383 294755 logs.go:123] Gathering logs for storage-provisioner [2b538e03219d] ...
I0520 11:20:40.701409 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2b538e03219d"
I0520 11:20:40.737898 294755 logs.go:123] Gathering logs for coredns [ae2339caab7b] ...
I0520 11:20:40.737935 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae2339caab7b"
I0520 11:20:40.769964 294755 logs.go:123] Gathering logs for kube-scheduler [e881ad64ded6] ...
I0520 11:20:40.770002 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e881ad64ded6"
I0520 11:20:40.795119 294755 logs.go:123] Gathering logs for kube-controller-manager [c8021e0d3603] ...
I0520 11:20:40.795148 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c8021e0d3603"
I0520 11:20:40.846418 294755 logs.go:123] Gathering logs for kube-controller-manager [33738d35cca5] ...
I0520 11:20:40.846450 294755 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 33738d35cca5"
I0520 11:20:40.909951 294755 logs.go:123] Gathering logs for Docker ...
I0520 11:20:40.909980 294755 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0520 11:20:40.960750 294755 logs.go:123] Gathering logs for dmesg ...
I0520 11:20:40.960794 294755 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0520 11:20:41.000040 294755 out.go:304] Setting ErrFile to fd 2...
I0520 11:20:41.000121 294755 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0520 11:20:41.000202 294755 out.go:239] X Problems detected in kubelet:
W0520 11:20:41.000243 294755 out.go:239] May 20 11:20:08 old-k8s-version-879853 kubelet[1232]: E0520 11:20:08.229095 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:41.000276 294755 out.go:239] May 20 11:20:21 old-k8s-version-879853 kubelet[1232]: E0520 11:20:21.228588 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:41.000327 294755 out.go:239] May 20 11:20:23 old-k8s-version-879853 kubelet[1232]: E0520 11:20:23.230344 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:20:41.000363 294755 out.go:239] May 20 11:20:32 old-k8s-version-879853 kubelet[1232]: E0520 11:20:32.228101 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0520 11:20:41.000408 294755 out.go:239] May 20 11:20:38 old-k8s-version-879853 kubelet[1232]: E0520 11:20:38.228264 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0520 11:20:41.000448 294755 out.go:304] Setting ErrFile to fd 2...
I0520 11:20:41.000472 294755 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0520 11:20:40.443330 309055 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0520 11:20:40.443681 309055 start.go:159] libmachine.API.Create for "embed-certs-601362" (driver="docker")
I0520 11:20:40.443709 309055 client.go:168] LocalClient.Create starting
I0520 11:20:40.443771 309055 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18925-2151/.minikube/certs/ca.pem
I0520 11:20:40.443804 309055 main.go:141] libmachine: Decoding PEM data...
I0520 11:20:40.443821 309055 main.go:141] libmachine: Parsing certificate...
I0520 11:20:40.443885 309055 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18925-2151/.minikube/certs/cert.pem
I0520 11:20:40.443903 309055 main.go:141] libmachine: Decoding PEM data...
I0520 11:20:40.443913 309055 main.go:141] libmachine: Parsing certificate...
I0520 11:20:40.444379 309055 cli_runner.go:164] Run: docker network inspect embed-certs-601362 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0520 11:20:40.477764 309055 cli_runner.go:211] docker network inspect embed-certs-601362 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0520 11:20:40.477869 309055 network_create.go:281] running [docker network inspect embed-certs-601362] to gather additional debugging logs...
I0520 11:20:40.477890 309055 cli_runner.go:164] Run: docker network inspect embed-certs-601362
W0520 11:20:40.502245 309055 cli_runner.go:211] docker network inspect embed-certs-601362 returned with exit code 1
I0520 11:20:40.502275 309055 network_create.go:284] error running [docker network inspect embed-certs-601362]: docker network inspect embed-certs-601362: exit status 1
stdout:
[]
stderr:
Error response from daemon: network embed-certs-601362 not found
I0520 11:20:40.502289 309055 network_create.go:286] output of [docker network inspect embed-certs-601362]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network embed-certs-601362 not found
** /stderr **
I0520 11:20:40.502387 309055 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0520 11:20:40.532469 309055 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-2901dbd6a710 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:5c:c2:d9:d2} reservation:<nil>}
I0520 11:20:40.533157 309055 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-c8b83b019e12 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:8a:de:6c:91} reservation:<nil>}
I0520 11:20:40.534276 309055 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-723ab3c1b5fc IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:85:35:1a:94} reservation:<nil>}
I0520 11:20:40.535017 309055 network.go:206] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x400177a0c0}
I0520 11:20:40.535053 309055 network_create.go:124] attempt to create docker network embed-certs-601362 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I0520 11:20:40.535161 309055 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-601362 embed-certs-601362
I0520 11:20:40.615747 309055 network_create.go:108] docker network embed-certs-601362 192.168.76.0/24 created
I0520 11:20:40.615798 309055 kic.go:121] calculated static IP "192.168.76.2" for the "embed-certs-601362" container
I0520 11:20:40.615914 309055 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0520 11:20:40.629732 309055 cli_runner.go:164] Run: docker volume create embed-certs-601362 --label name.minikube.sigs.k8s.io=embed-certs-601362 --label created_by.minikube.sigs.k8s.io=true
I0520 11:20:40.651315 309055 oci.go:103] Successfully created a docker volume embed-certs-601362
I0520 11:20:40.651402 309055 cli_runner.go:164] Run: docker run --rm --name embed-certs-601362-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-601362 --entrypoint /usr/bin/test -v embed-certs-601362:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a -d /var/lib
I0520 11:20:41.317597 309055 oci.go:107] Successfully prepared a docker volume embed-certs-601362
I0520 11:20:41.317654 309055 preload.go:132] Checking if preload exists for k8s version v1.30.1 and runtime docker
I0520 11:20:41.317674 309055 kic.go:194] Starting extracting preloaded images to volume ...
I0520 11:20:41.317763 309055 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/18925-2151/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.1-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-601362:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a -I lz4 -xf /preloaded.tar -C /extractDir
I0520 11:20:45.384241 309055 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/18925-2151/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.1-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-601362:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a -I lz4 -xf /preloaded.tar -C /extractDir: (4.066440085s)
I0520 11:20:45.384272 309055 kic.go:203] duration metric: took 4.066594875s to extract preloaded images to volume ...
W0520 11:20:45.384418 309055 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0520 11:20:45.384549 309055 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0520 11:20:45.456712 309055 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-601362 --name embed-certs-601362 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-601362 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-601362 --network embed-certs-601362 --ip 192.168.76.2 --volume embed-certs-601362:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a
I0520 11:20:45.817540 309055 cli_runner.go:164] Run: docker container inspect embed-certs-601362 --format={{.State.Running}}
I0520 11:20:45.837536 309055 cli_runner.go:164] Run: docker container inspect embed-certs-601362 --format={{.State.Status}}
I0520 11:20:45.869256 309055 cli_runner.go:164] Run: docker exec embed-certs-601362 stat /var/lib/dpkg/alternatives/iptables
I0520 11:20:45.933633 309055 oci.go:144] the created container "embed-certs-601362" has a running status.
I0520 11:20:45.933665 309055 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/18925-2151/.minikube/machines/embed-certs-601362/id_rsa...
I0520 11:20:46.804897 309055 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/18925-2151/.minikube/machines/embed-certs-601362/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0520 11:20:46.839841 309055 cli_runner.go:164] Run: docker container inspect embed-certs-601362 --format={{.State.Status}}
I0520 11:20:46.862971 309055 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0520 11:20:46.862993 309055 kic_runner.go:114] Args: [docker exec --privileged embed-certs-601362 chown docker:docker /home/docker/.ssh/authorized_keys]
I0520 11:20:46.956880 309055 cli_runner.go:164] Run: docker container inspect embed-certs-601362 --format={{.State.Status}}
I0520 11:20:46.975131 309055 machine.go:94] provisionDockerMachine start ...
I0520 11:20:46.975312 309055 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-601362
I0520 11:20:46.997158 309055 main.go:141] libmachine: Using SSH client type: native
I0520 11:20:46.997559 309055 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 33093 <nil> <nil>}
I0520 11:20:46.997575 309055 main.go:141] libmachine: About to run SSH command:
hostname
I0520 11:20:47.140819 309055 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-601362
I0520 11:20:47.140841 309055 ubuntu.go:169] provisioning hostname "embed-certs-601362"
I0520 11:20:47.140905 309055 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-601362
I0520 11:20:47.160198 309055 main.go:141] libmachine: Using SSH client type: native
I0520 11:20:47.160443 309055 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 33093 <nil> <nil>}
I0520 11:20:47.160456 309055 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-601362 && echo "embed-certs-601362" | sudo tee /etc/hostname
I0520 11:20:47.311658 309055 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-601362
I0520 11:20:47.311736 309055 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-601362
I0520 11:20:47.328611 309055 main.go:141] libmachine: Using SSH client type: native
I0520 11:20:47.328859 309055 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 33093 <nil> <nil>}
I0520 11:20:47.328877 309055 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-601362' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-601362/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-601362' | sudo tee -a /etc/hosts;
fi
fi
I0520 11:20:47.457785 309055 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0520 11:20:47.457812 309055 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18925-2151/.minikube CaCertPath:/home/jenkins/minikube-integration/18925-2151/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18925-2151/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18925-2151/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18925-2151/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18925-2151/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18925-2151/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18925-2151/.minikube}
I0520 11:20:47.457834 309055 ubuntu.go:177] setting up certificates
I0520 11:20:47.457848 309055 provision.go:84] configureAuth start
I0520 11:20:47.457931 309055 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-601362
I0520 11:20:47.476162 309055 provision.go:143] copyHostCerts
I0520 11:20:47.476231 309055 exec_runner.go:144] found /home/jenkins/minikube-integration/18925-2151/.minikube/ca.pem, removing ...
I0520 11:20:47.476245 309055 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18925-2151/.minikube/ca.pem
I0520 11:20:47.476331 309055 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18925-2151/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18925-2151/.minikube/ca.pem (1078 bytes)
I0520 11:20:47.476428 309055 exec_runner.go:144] found /home/jenkins/minikube-integration/18925-2151/.minikube/cert.pem, removing ...
I0520 11:20:47.476439 309055 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18925-2151/.minikube/cert.pem
I0520 11:20:47.476467 309055 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18925-2151/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18925-2151/.minikube/cert.pem (1123 bytes)
I0520 11:20:47.476522 309055 exec_runner.go:144] found /home/jenkins/minikube-integration/18925-2151/.minikube/key.pem, removing ...
I0520 11:20:47.476533 309055 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18925-2151/.minikube/key.pem
I0520 11:20:47.476574 309055 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18925-2151/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18925-2151/.minikube/key.pem (1675 bytes)
I0520 11:20:47.476666 309055 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18925-2151/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18925-2151/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18925-2151/.minikube/certs/ca-key.pem org=jenkins.embed-certs-601362 san=[127.0.0.1 192.168.76.2 embed-certs-601362 localhost minikube]
I0520 11:20:47.821154 309055 provision.go:177] copyRemoteCerts
I0520 11:20:47.821222 309055 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0520 11:20:47.821266 309055 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-601362
I0520 11:20:47.837649 309055 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33093 SSHKeyPath:/home/jenkins/minikube-integration/18925-2151/.minikube/machines/embed-certs-601362/id_rsa Username:docker}
I0520 11:20:47.930328 309055 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-2151/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0520 11:20:47.955011 309055 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-2151/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0520 11:20:47.981548 309055 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-2151/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0520 11:20:48.007229 309055 provision.go:87] duration metric: took 549.363417ms to configureAuth
I0520 11:20:48.007255 309055 ubuntu.go:193] setting minikube options for container-runtime
I0520 11:20:48.007451 309055 config.go:182] Loaded profile config "embed-certs-601362": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.30.1
I0520 11:20:48.007532 309055 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-601362
I0520 11:20:48.034961 309055 main.go:141] libmachine: Using SSH client type: native
I0520 11:20:48.035240 309055 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 33093 <nil> <nil>}
I0520 11:20:48.035250 309055 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0520 11:20:48.166456 309055 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0520 11:20:48.166488 309055 ubuntu.go:71] root file system type: overlay
I0520 11:20:48.166610 309055 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
I0520 11:20:48.166680 309055 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-601362
I0520 11:20:48.183723 309055 main.go:141] libmachine: Using SSH client type: native
I0520 11:20:48.183957 309055 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 33093 <nil> <nil>}
I0520 11:20:48.184037 309055 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0520 11:20:48.320500 309055 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0520 11:20:48.320586 309055 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-601362
I0520 11:20:48.338865 309055 main.go:141] libmachine: Using SSH client type: native
I0520 11:20:48.339117 309055 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 33093 <nil> <nil>}
I0520 11:20:48.339140 309055 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0520 11:20:49.100567 309055 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2024-05-08 13:59:39.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2024-05-20 11:20:48.316831329 +0000
@@ -1,46 +1,49 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service time-set.target
-Wants=network-online.target containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
+Wants=network-online.target
Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutStartSec=0
-RestartSec=2
-Restart=always
+Restart=on-failure
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
+LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0520 11:20:49.100598 309055 machine.go:97] duration metric: took 2.125448335s to provisionDockerMachine
I0520 11:20:49.100611 309055 client.go:171] duration metric: took 8.656895785s to LocalClient.Create
I0520 11:20:49.100624 309055 start.go:167] duration metric: took 8.656944434s to libmachine.API.Create "embed-certs-601362"
I0520 11:20:49.100632 309055 start.go:293] postStartSetup for "embed-certs-601362" (driver="docker")
I0520 11:20:49.100642 309055 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0520 11:20:49.100708 309055 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0520 11:20:49.100757 309055 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-601362
I0520 11:20:49.117475 309055 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33093 SSHKeyPath:/home/jenkins/minikube-integration/18925-2151/.minikube/machines/embed-certs-601362/id_rsa Username:docker}
I0520 11:20:49.213895 309055 ssh_runner.go:195] Run: cat /etc/os-release
I0520 11:20:49.217002 309055 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0520 11:20:49.217075 309055 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0520 11:20:49.217095 309055 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0520 11:20:49.217105 309055 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0520 11:20:49.217115 309055 filesync.go:126] Scanning /home/jenkins/minikube-integration/18925-2151/.minikube/addons for local assets ...
I0520 11:20:49.217182 309055 filesync.go:126] Scanning /home/jenkins/minikube-integration/18925-2151/.minikube/files for local assets ...
I0520 11:20:49.217276 309055 filesync.go:149] local asset: /home/jenkins/minikube-integration/18925-2151/.minikube/files/etc/ssl/certs/75122.pem -> 75122.pem in /etc/ssl/certs
I0520 11:20:49.217383 309055 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0520 11:20:49.225611 309055 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-2151/.minikube/files/etc/ssl/certs/75122.pem --> /etc/ssl/certs/75122.pem (1708 bytes)
I0520 11:20:49.258734 309055 start.go:296] duration metric: took 158.088628ms for postStartSetup
I0520 11:20:49.259135 309055 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-601362
I0520 11:20:49.276711 309055 profile.go:143] Saving config to /home/jenkins/minikube-integration/18925-2151/.minikube/profiles/embed-certs-601362/config.json ...
I0520 11:20:49.276981 309055 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0520 11:20:49.277026 309055 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-601362
I0520 11:20:49.292638 309055 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33093 SSHKeyPath:/home/jenkins/minikube-integration/18925-2151/.minikube/machines/embed-certs-601362/id_rsa Username:docker}
I0520 11:20:49.381678 309055 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0520 11:20:49.385884 309055 start.go:128] duration metric: took 8.945290949s to createHost
I0520 11:20:49.385918 309055 start.go:83] releasing machines lock for "embed-certs-601362", held for 8.945432365s
I0520 11:20:49.386017 309055 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-601362
I0520 11:20:49.401318 309055 ssh_runner.go:195] Run: cat /version.json
I0520 11:20:49.401374 309055 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-601362
I0520 11:20:49.401606 309055 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0520 11:20:49.401652 309055 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-601362
I0520 11:20:49.421628 309055 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33093 SSHKeyPath:/home/jenkins/minikube-integration/18925-2151/.minikube/machines/embed-certs-601362/id_rsa Username:docker}
I0520 11:20:49.431817 309055 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33093 SSHKeyPath:/home/jenkins/minikube-integration/18925-2151/.minikube/machines/embed-certs-601362/id_rsa Username:docker}
I0520 11:20:49.516573 309055 ssh_runner.go:195] Run: systemctl --version
I0520 11:20:49.636672 309055 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0520 11:20:49.641217 309055 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0520 11:20:49.667269 309055 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0520 11:20:49.667343 309055 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0520 11:20:49.701658 309055 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0520 11:20:49.701683 309055 start.go:494] detecting cgroup driver to use...
I0520 11:20:49.701713 309055 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0520 11:20:49.701809 309055 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0520 11:20:49.719763 309055 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0520 11:20:49.729951 309055 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0520 11:20:49.740021 309055 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0520 11:20:49.740104 309055 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0520 11:20:49.750071 309055 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0520 11:20:49.759858 309055 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0520 11:20:49.770082 309055 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0520 11:20:49.785768 309055 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0520 11:20:49.796375 309055 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0520 11:20:49.808022 309055 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0520 11:20:49.819510 309055 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0520 11:20:49.829298 309055 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0520 11:20:49.837695 309055 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0520 11:20:49.845644 309055 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0520 11:20:49.930727 309055 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0520 11:20:50.048408 309055 start.go:494] detecting cgroup driver to use...
I0520 11:20:50.048509 309055 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0520 11:20:50.048592 309055 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0520 11:20:50.069012 309055 cruntime.go:279] skipping containerd shutdown because we are bound to it
I0520 11:20:50.069157 309055 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0520 11:20:50.081717 309055 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0520 11:20:50.099160 309055 ssh_runner.go:195] Run: which cri-dockerd
I0520 11:20:50.105761 309055 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0520 11:20:50.116603 309055 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
I0520 11:20:50.143649 309055 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0520 11:20:51.000820 294755 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0520 11:20:51.013646 294755 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0520 11:20:51.016178 294755 out.go:177]
W0520 11:20:51.017929 294755 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0520 11:20:51.017985 294755 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0520 11:20:51.018012 294755 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0520 11:20:51.018017 294755 out.go:239] *
W0520 11:20:51.018917 294755 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0520 11:20:51.021916 294755 out.go:177]
I0520 11:20:50.249174 309055 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0520 11:20:50.360456 309055 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I0520 11:20:50.360579 309055 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I0520 11:20:50.384808 309055 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0520 11:20:50.477756 309055 ssh_runner.go:195] Run: sudo systemctl restart docker
I0520 11:20:50.755472 309055 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket
I0520 11:20:50.768071 309055 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I0520 11:20:50.780311 309055 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I0520 11:20:50.872962 309055 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0520 11:20:50.959836 309055 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0520 11:20:51.103773 309055 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I0520 11:20:51.123102 309055 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I0520 11:20:51.136492 309055 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0520 11:20:51.306137 309055 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service
I0520 11:20:51.455971 309055 start.go:541] Will wait 60s for socket path /var/run/cri-dockerd.sock
I0520 11:20:51.456047 309055 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
I0520 11:20:51.463125 309055 start.go:562] Will wait 60s for crictl version
I0520 11:20:51.463193 309055 ssh_runner.go:195] Run: which crictl
I0520 11:20:51.473880 309055 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0520 11:20:51.516688 309055 start.go:578] Version: 0.1.0
RuntimeName: docker
RuntimeVersion: 26.1.2
RuntimeApiVersion: v1
I0520 11:20:51.516760 309055 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0520 11:20:51.545343 309055 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
==> Docker <==
May 20 11:20:29 old-k8s-version-879853 dockerd[991]: 2024/05/20 11:20:29 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
May 20 11:20:29 old-k8s-version-879853 dockerd[991]: 2024/05/20 11:20:29 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
May 20 11:20:29 old-k8s-version-879853 dockerd[991]: 2024/05/20 11:20:29 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
May 20 11:20:29 old-k8s-version-879853 dockerd[991]: 2024/05/20 11:20:29 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
May 20 11:20:29 old-k8s-version-879853 dockerd[991]: 2024/05/20 11:20:29 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
May 20 11:20:29 old-k8s-version-879853 dockerd[991]: 2024/05/20 11:20:29 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
May 20 11:20:29 old-k8s-version-879853 dockerd[991]: 2024/05/20 11:20:29 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
May 20 11:20:39 old-k8s-version-879853 dockerd[991]: 2024/05/20 11:20:39 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
May 20 11:20:39 old-k8s-version-879853 dockerd[991]: 2024/05/20 11:20:39 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
May 20 11:20:40 old-k8s-version-879853 dockerd[991]: 2024/05/20 11:20:40 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
May 20 11:20:40 old-k8s-version-879853 dockerd[991]: 2024/05/20 11:20:40 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
May 20 11:20:40 old-k8s-version-879853 dockerd[991]: 2024/05/20 11:20:40 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
May 20 11:20:40 old-k8s-version-879853 dockerd[991]: 2024/05/20 11:20:40 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
May 20 11:20:40 old-k8s-version-879853 dockerd[991]: 2024/05/20 11:20:40 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
May 20 11:20:40 old-k8s-version-879853 dockerd[991]: 2024/05/20 11:20:40 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
May 20 11:20:40 old-k8s-version-879853 dockerd[991]: 2024/05/20 11:20:40 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
May 20 11:20:40 old-k8s-version-879853 dockerd[991]: 2024/05/20 11:20:40 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
May 20 11:20:40 old-k8s-version-879853 dockerd[991]: 2024/05/20 11:20:40 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
May 20 11:20:40 old-k8s-version-879853 dockerd[991]: 2024/05/20 11:20:40 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
May 20 11:20:40 old-k8s-version-879853 dockerd[991]: 2024/05/20 11:20:40 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
May 20 11:20:40 old-k8s-version-879853 dockerd[991]: 2024/05/20 11:20:40 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
May 20 11:20:40 old-k8s-version-879853 dockerd[991]: 2024/05/20 11:20:40 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
May 20 11:20:49 old-k8s-version-879853 dockerd[991]: time="2024-05-20T11:20:49.260886084Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" spanID=bf187498522a74c4 traceID=abd9e4211329dbe1d79fb0f45903836b
May 20 11:20:49 old-k8s-version-879853 dockerd[991]: time="2024-05-20T11:20:49.261087078Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" spanID=bf187498522a74c4 traceID=abd9e4211329dbe1d79fb0f45903836b
May 20 11:20:49 old-k8s-version-879853 dockerd[991]: time="2024-05-20T11:20:49.263771988Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" spanID=bf187498522a74c4 traceID=abd9e4211329dbe1d79fb0f45903836b
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
2b538e03219d7 ba04bb24b9575 5 minutes ago Running storage-provisioner 2 661d10d638eed storage-provisioner
1963b29e2abd2 kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93 5 minutes ago Running kubernetes-dashboard 0 b978f147b3700 kubernetes-dashboard-cd95d586-mkd7n
005cb51798905 db91994f4ee8f 5 minutes ago Running coredns 1 575ec894219cb coredns-74ff55c5b-6l85w
d282e88b488b5 25a5233254979 5 minutes ago Running kube-proxy 1 83cc61951d8e0 kube-proxy-2q9x5
7d536cdf43d4f ba04bb24b9575 5 minutes ago Exited storage-provisioner 1 661d10d638eed storage-provisioner
3109b2c5ae746 1611cd07b61d5 5 minutes ago Running busybox 1 a9fd113bd2fe2 busybox
e881ad64ded62 e7605f88f17d6 6 minutes ago Running kube-scheduler 1 292d9ea71ee49 kube-scheduler-old-k8s-version-879853
40bd562563ebf 2c08bbbc02d3a 6 minutes ago Running kube-apiserver 1 3dff459b24b70 kube-apiserver-old-k8s-version-879853
c8021e0d3603d 1df8a2b116bd1 6 minutes ago Running kube-controller-manager 1 8648a39426383 kube-controller-manager-old-k8s-version-879853
730cfcbb3b453 05b738aa1bc63 6 minutes ago Running etcd 1 c7adfce7dfc2f etcd-old-k8s-version-879853
86980f96cf04f gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e 6 minutes ago Exited busybox 0 bd3efe6fff048 busybox
b1eddd083512b 25a5233254979 8 minutes ago Exited kube-proxy 0 2284ca278a1e6 kube-proxy-2q9x5
ae2339caab7b8 db91994f4ee8f 8 minutes ago Exited coredns 0 685014cbcbdf7 coredns-74ff55c5b-6l85w
d7bf0c086e3a8 e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 9d1d813c83d5f kube-scheduler-old-k8s-version-879853
55da4e11e7737 05b738aa1bc63 8 minutes ago Exited etcd 0 34b36be3cd554 etcd-old-k8s-version-879853
33738d35cca5e 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 93f35d35bce0c kube-controller-manager-old-k8s-version-879853
ac483fa044f27 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 c38da4f33c260 kube-apiserver-old-k8s-version-879853
==> coredns [005cb5179890] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:59153 - 37346 "HINFO IN 3509878255759386750.1471500059673684815. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.019744504s
==> coredns [ae2339caab7b] <==
I0520 11:13:21.719705 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-05-20 11:12:51.719063768 +0000 UTC m=+0.020439956) (total time: 30.000530645s):
Trace[2019727887]: [30.000530645s] [30.000530645s] END
E0520 11:13:21.719737 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0520 11:13:21.721835 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-05-20 11:12:51.721464965 +0000 UTC m=+0.022841161) (total time: 30.000347335s):
Trace[939984059]: [30.000347335s] [30.000347335s] END
E0520 11:13:21.721853 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0520 11:13:21.722121 1 trace.go:116] Trace[1474941318]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-05-20 11:12:51.721814545 +0000 UTC m=+0.023190733) (total time: 30.000292869s):
Trace[1474941318]: [30.000292869s] [30.000292869s] END
E0520 11:13:21.722134 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
.:53
[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] Reloading
[INFO] plugin/health: Going into lameduck mode for 5s
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
[INFO] Reloading complete
[INFO] 127.0.0.1:53542 - 38693 "HINFO IN 655767211909321781.6161317165832143289. udp 56 false 512" NXDOMAIN qr,rd,ra 56 0.011629173s
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
==> describe nodes <==
Name: old-k8s-version-879853
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-879853
kubernetes.io/os=linux
minikube.k8s.io/commit=1b01766f8cca110acded3a48649b81463b982c91
minikube.k8s.io/name=old-k8s-version-879853
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_05_20T11_12_34_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 20 May 2024 11:12:31 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-879853
AcquireTime: <unset>
RenewTime: Mon, 20 May 2024 11:20:44 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 20 May 2024 11:15:53 +0000 Mon, 20 May 2024 11:12:23 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 20 May 2024 11:15:53 +0000 Mon, 20 May 2024 11:12:23 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 20 May 2024 11:15:53 +0000 Mon, 20 May 2024 11:12:23 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 20 May 2024 11:15:53 +0000 Mon, 20 May 2024 11:12:48 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.85.2
Hostname: old-k8s-version-879853
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022428Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022428Ki
pods: 110
System Info:
Machine ID: 3c16ac2350684e0195b62451ab80a213
System UUID: 9c2e95d2-65a3-4d25-ba19-11ba3032fb11
Boot ID: 360c613b-7d2d-4efb-a784-5066f036d5dd
Kernel Version: 5.15.0-1061-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: docker://26.1.2
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m37s
kube-system coredns-74ff55c5b-6l85w 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m2s
kube-system etcd-old-k8s-version-879853 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m14s
kube-system kube-apiserver-old-k8s-version-879853 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m14s
kube-system kube-controller-manager-old-k8s-version-879853 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m14s
kube-system kube-proxy-2q9x5 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m2s
kube-system kube-scheduler-old-k8s-version-879853 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m14s
kube-system metrics-server-9975d5f86-24f8f 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m25s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-cznvg 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m32s
kubernetes-dashboard kubernetes-dashboard-cd95d586-mkd7n 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m32s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (42%!)(MISSING) 0 (0%!)(MISSING)
memory 370Mi (4%!)(MISSING) 170Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m30s (x5 over 8m30s) kubelet Node old-k8s-version-879853 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m30s (x4 over 8m30s) kubelet Node old-k8s-version-879853 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m30s (x4 over 8m30s) kubelet Node old-k8s-version-879853 status is now: NodeHasSufficientPID
Normal Starting 8m14s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m14s kubelet Node old-k8s-version-879853 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m14s kubelet Node old-k8s-version-879853 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m14s kubelet Node old-k8s-version-879853 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m14s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m4s kubelet Node old-k8s-version-879853 status is now: NodeReady
Normal Starting 8m kube-proxy Starting kube-proxy.
Normal Starting 6m1s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 6m1s (x8 over 6m1s) kubelet Node old-k8s-version-879853 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m1s (x8 over 6m1s) kubelet Node old-k8s-version-879853 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m1s (x7 over 6m1s) kubelet Node old-k8s-version-879853 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 6m1s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m48s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.000755] FS-Cache: N-cookie c=0000000c [p=00000003 fl=2 nc=0 na=1]
[ +0.000937] FS-Cache: N-cookie d=000000006dbb735b{9p.inode} n=00000000dae70b24
[ +0.001054] FS-Cache: N-key=[8] '8d385c0100000000'
[ +0.003021] FS-Cache: Duplicate cookie detected
[ +0.000676] FS-Cache: O-cookie c=00000006 [p=00000003 fl=226 nc=0 na=1]
[ +0.001000] FS-Cache: O-cookie d=000000006dbb735b{9p.inode} n=00000000123da853
[ +0.001116] FS-Cache: O-key=[8] '8d385c0100000000'
[ +0.000707] FS-Cache: N-cookie c=0000000d [p=00000003 fl=2 nc=0 na=1]
[ +0.000950] FS-Cache: N-cookie d=000000006dbb735b{9p.inode} n=00000000de49adbd
[ +0.001032] FS-Cache: N-key=[8] '8d385c0100000000'
[ +2.409710] FS-Cache: Duplicate cookie detected
[ +0.000748] FS-Cache: O-cookie c=00000004 [p=00000003 fl=226 nc=0 na=1]
[ +0.000964] FS-Cache: O-cookie d=000000006dbb735b{9p.inode} n=0000000067772ff7
[ +0.001052] FS-Cache: O-key=[8] '8c385c0100000000'
[ +0.000759] FS-Cache: N-cookie c=0000000f [p=00000003 fl=2 nc=0 na=1]
[ +0.000941] FS-Cache: N-cookie d=000000006dbb735b{9p.inode} n=000000001e2817e2
[ +0.001113] FS-Cache: N-key=[8] '8c385c0100000000'
[ +0.250072] FS-Cache: Duplicate cookie detected
[ +0.000744] FS-Cache: O-cookie c=00000009 [p=00000003 fl=226 nc=0 na=1]
[ +0.001009] FS-Cache: O-cookie d=000000006dbb735b{9p.inode} n=000000004e27c347
[ +0.001053] FS-Cache: O-key=[8] '95385c0100000000'
[ +0.000697] FS-Cache: N-cookie c=00000010 [p=00000003 fl=2 nc=0 na=1]
[ +0.001009] FS-Cache: N-cookie d=000000006dbb735b{9p.inode} n=00000000dae70b24
[ +0.001043] FS-Cache: N-key=[8] '95385c0100000000'
[May20 11:04] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
==> etcd [55da4e11e773] <==
raft2024/05/20 11:12:23 INFO: 9f0758e1c58a86ed became leader at term 2
raft2024/05/20 11:12:23 INFO: raft.node: 9f0758e1c58a86ed elected leader 9f0758e1c58a86ed at term 2
2024-05-20 11:12:23.523592 I | etcdserver: published {Name:old-k8s-version-879853 ClientURLs:[https://192.168.85.2:2379]} to cluster 68eaea490fab4e05
2024-05-20 11:12:23.523857 I | embed: ready to serve client requests
2024-05-20 11:12:23.525886 I | embed: serving client requests on 127.0.0.1:2379
2024-05-20 11:12:23.526102 I | etcdserver: setting up the initial cluster version to 3.4
2024-05-20 11:12:23.526497 I | embed: ready to serve client requests
2024-05-20 11:12:23.531390 I | embed: serving client requests on 192.168.85.2:2379
2024-05-20 11:12:23.549149 N | etcdserver/membership: set the initial cluster version to 3.4
2024-05-20 11:12:23.550174 I | etcdserver/api: enabled capabilities for version 3.4
2024-05-20 11:12:39.700542 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:12:41.716510 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:12:51.719872 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:13:01.716535 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:13:11.716506 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:13:21.716493 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:13:31.716452 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:13:41.716490 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:13:51.716528 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:14:01.716613 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:14:11.725698 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:14:21.716461 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:14:27.191166 N | pkg/osutil: received terminated signal, shutting down...
WARNING: 2024/05/20 11:14:27 grpc: addrConn.createTransport failed to connect to {127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
2024-05-20 11:14:27.241313 I | etcdserver: skipped leadership transfer for single voting member cluster
==> etcd [730cfcbb3b45] <==
2024-05-20 11:16:42.888062 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:16:52.888178 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:17:02.887940 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:17:12.888122 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:17:22.887952 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:17:32.888047 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:17:42.887914 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:17:52.887926 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:18:02.888080 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:18:12.887970 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:18:22.887976 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:18:32.887985 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:18:42.888080 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:18:52.888110 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:19:02.887915 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:19:12.887843 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:19:22.887955 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:19:32.888125 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:19:42.888020 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:19:52.888107 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:20:02.888018 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:20:12.887975 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:20:22.887956 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:20:32.888112 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:20:42.888120 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
11:20:52 up 1:02, 0 users, load average: 1.75, 2.19, 2.71
Linux old-k8s-version-879853 5.15.0-1061-aws #67~20.04.1-Ubuntu SMP Wed Apr 17 15:09:05 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kube-apiserver [40bd562563eb] <==
I0520 11:17:28.990192 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0520 11:17:28.990201 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0520 11:18:01.492930 1 client.go:360] parsed scheme: "passthrough"
I0520 11:18:01.492977 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0520 11:18:01.492986 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0520 11:18:05.273775 1 handler_proxy.go:102] no RequestInfo found in the context
E0520 11:18:05.273858 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0520 11:18:05.273867 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0520 11:18:42.645188 1 client.go:360] parsed scheme: "passthrough"
I0520 11:18:42.645232 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0520 11:18:42.645240 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0520 11:19:27.622769 1 client.go:360] parsed scheme: "passthrough"
I0520 11:19:27.622816 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0520 11:19:27.622826 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0520 11:19:58.182162 1 client.go:360] parsed scheme: "passthrough"
I0520 11:19:58.182224 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0520 11:19:58.182233 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0520 11:20:03.010307 1 handler_proxy.go:102] no RequestInfo found in the context
E0520 11:20:03.010562 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0520 11:20:03.010580 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0520 11:20:39.143116 1 client.go:360] parsed scheme: "passthrough"
I0520 11:20:39.143459 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0520 11:20:39.143616 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [ac483fa044f2] <==
W0520 11:14:27.230875 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.230918 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.230957 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.230991 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.231039 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.231075 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.231108 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.231142 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.231191 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.231261 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.231300 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.231361 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.231404 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.231450 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.231490 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.232254 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.232305 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.232353 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.232406 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.232478 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.232525 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.232583 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.232635 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.232707 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0520 11:14:27.232760 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
==> kube-controller-manager [33738d35cca5] <==
I0520 11:12:50.541689 1 disruption.go:339] Sending events to api server.
I0520 11:12:50.553562 1 shared_informer.go:247] Caches are synced for resource quota
I0520 11:12:50.565303 1 shared_informer.go:247] Caches are synced for resource quota
I0520 11:12:50.727230 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0520 11:12:50.927453 1 shared_informer.go:247] Caches are synced for garbage collector
I0520 11:12:51.013445 1 shared_informer.go:247] Caches are synced for garbage collector
I0520 11:12:51.013505 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0520 11:12:52.430393 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0520 11:12:52.439699 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-zgmvp"
I0520 11:14:25.868431 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
E0520 11:14:26.136345 1 clusterroleaggregation_controller.go:181] view failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "view": the object has been modified; please apply your changes to the latest version and try again
E0520 11:14:26.161595 1 clusterroleaggregation_controller.go:181] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
I0520 11:14:27.085323 1 event.go:291] "Event occurred" object="kube-system/metrics-server-9975d5f86" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: metrics-server-9975d5f86-24f8f"
W0520 11:14:27.140776 1 endpointslice_controller.go:284] Error syncing endpoint slices for service "kube-system/metrics-server", retrying. Error: failed to update metrics-server-svcvc EndpointSlice for Service kube-system/metrics-server: Put "https://192.168.85.2:8443/apis/discovery.k8s.io/v1beta1/namespaces/kube-system/endpointslices/metrics-server-svcvc": unexpected EOF
E0520 11:14:27.141148 1 event.go:273] Unable to write event: '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"metrics-server-9975d5f86.17d12e2472cf155d", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"metrics-server-9975d5f86", UID:"3539e37f-b0e4-4041-bac3-1997139a51f6", APIVersion:"apps/v1", ResourceVersion:"558", FieldPath:""}, Reason:"SuccessfulCreate", Message:"Created pod: metrics-server-9975d5f86-24f8f", Source:v1.EventSource{Component:"replicaset-controller", Host:
""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc18aea04c50d175d, ext:123840308426, loc:(*time.Location)(0x632eb80)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc18aea04c50d175d, ext:123840308426, loc:(*time.Location)(0x632eb80)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'Post "https://192.168.85.2:8443/api/v1/namespaces/kube-system/events": unexpected EOF'(may retry after sleeping)
I0520 11:14:27.141491 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Service" apiVersion="v1" type="Warning" reason="FailedToUpdateEndpointSlices" message="Error updating Endpoint Slices for Service kube-system/metrics-server: failed to update metrics-server-svcvc EndpointSlice for Service kube-system/metrics-server: Put \"https://192.168.85.2:8443/apis/discovery.k8s.io/v1beta1/namespaces/kube-system/endpointslices/metrics-server-svcvc\": unexpected EOF"
E0520 11:14:27.142142 1 event.go:273] Unable to write event: '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"metrics-server.17d12e247625d139", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Service", Namespace:"kube-system", Name:"metrics-server", UID:"d8b0438a-3bfc-4c1a-b845-beb3404b7835", APIVersion:"v1", ResourceVersion:"576", FieldPath:""}, Reason:"FailedToUpdateEndpointSlices", Message:"Error updating Endpoint Slices for Service kube-system/metrics-server: failed to update metrics-server-svcvc EndpointSlice f
or Service kube-system/metrics-server: Put \"https://192.168.85.2:8443/apis/discovery.k8s.io/v1beta1/namespaces/kube-system/endpointslices/metrics-server-svcvc\": unexpected EOF", Source:v1.EventSource{Component:"endpoint-slice-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc18aea04c863d339, ext:123896324270, loc:(*time.Location)(0x632eb80)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc18aea04c863d339, ext:123896324270, loc:(*time.Location)(0x632eb80)}}, Count:1, Type:"Warning", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'Post "https://192.168.85.2:8443/api/v1/namespaces/kube-system/events": dial tcp 192.168.85.2:8443: connect: connection refused'(may retry after sleeping)
E0520 11:14:27.142494 1 replica_set.go:532] sync "kube-system/metrics-server-9975d5f86" failed with Get "https://192.168.85.2:8443/apis/apps/v1/namespaces/kube-system/replicasets/metrics-server-9975d5f86": dial tcp 192.168.85.2:8443: connect: connection refused
E0520 11:14:27.155237 1 replica_set.go:532] sync "kube-system/metrics-server-9975d5f86" failed with Get "https://192.168.85.2:8443/apis/apps/v1/namespaces/kube-system/replicasets/metrics-server-9975d5f86": dial tcp 192.168.85.2:8443: connect: connection refused
E0520 11:14:27.155953 1 replica_set.go:532] sync "kube-system/metrics-server-9975d5f86" failed with Get "https://192.168.85.2:8443/apis/apps/v1/namespaces/kube-system/replicasets/metrics-server-9975d5f86": dial tcp 192.168.85.2:8443: connect: connection refused
E0520 11:14:27.159174 1 replica_set.go:532] sync "kube-system/metrics-server-9975d5f86" failed with Get "https://192.168.85.2:8443/apis/apps/v1/namespaces/kube-system/replicasets/metrics-server-9975d5f86": dial tcp 192.168.85.2:8443: connect: connection refused
E0520 11:14:27.170229 1 replica_set.go:532] sync "kube-system/metrics-server-9975d5f86" failed with Get "https://192.168.85.2:8443/apis/apps/v1/namespaces/kube-system/replicasets/metrics-server-9975d5f86": dial tcp 192.168.85.2:8443: connect: connection refused
E0520 11:14:27.259208 1 replica_set.go:532] sync "kube-system/metrics-server-9975d5f86" failed with Get "https://192.168.85.2:8443/apis/apps/v1/namespaces/kube-system/replicasets/metrics-server-9975d5f86": dial tcp 192.168.85.2:8443: connect: connection refused
W0520 11:14:27.286436 1 endpointslice_controller.go:284] Error syncing endpoint slices for service "kube-system/metrics-server", retrying. Error: failed to update metrics-server-svcvc EndpointSlice for Service kube-system/metrics-server: Put "https://192.168.85.2:8443/apis/discovery.k8s.io/v1beta1/namespaces/kube-system/endpointslices/metrics-server-svcvc": dial tcp 192.168.85.2:8443: connect: connection refused
I0520 11:14:27.286526 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Service" apiVersion="v1" type="Warning" reason="FailedToUpdateEndpointSlices" message="Error updating Endpoint Slices for Service kube-system/metrics-server: failed to update metrics-server-svcvc EndpointSlice for Service kube-system/metrics-server: Put \"https://192.168.85.2:8443/apis/discovery.k8s.io/v1beta1/namespaces/kube-system/endpointslices/metrics-server-svcvc\": dial tcp 192.168.85.2:8443: connect: connection refused"
==> kube-controller-manager [c8021e0d3603] <==
W0520 11:16:27.986769 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 11:16:52.278452 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 11:16:59.637355 1 request.go:655] Throttling request took 1.0484012s, request: GET:https://192.168.85.2:8443/apis/authorization.k8s.io/v1beta1?timeout=32s
W0520 11:17:00.489986 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 11:17:22.780454 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 11:17:32.140708 1 request.go:655] Throttling request took 1.048214645s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0520 11:17:32.992172 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 11:17:53.325929 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 11:18:04.643669 1 request.go:655] Throttling request took 1.048489133s, request: GET:https://192.168.85.2:8443/apis/rbac.authorization.k8s.io/v1?timeout=32s
W0520 11:18:05.495676 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 11:18:23.827770 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 11:18:37.146086 1 request.go:655] Throttling request took 1.048284575s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0520 11:18:37.997375 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 11:18:54.329667 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 11:19:09.647978 1 request.go:655] Throttling request took 1.048511282s, request: GET:https://192.168.85.2:8443/apis/policy/v1beta1?timeout=32s
W0520 11:19:10.499226 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 11:19:24.831480 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 11:19:42.149570 1 request.go:655] Throttling request took 1.048282123s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0520 11:19:43.001044 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 11:19:55.333377 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 11:20:14.651439 1 request.go:655] Throttling request took 1.048442976s, request: GET:https://192.168.85.2:8443/apis/authentication.k8s.io/v1?timeout=32s
W0520 11:20:15.502809 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 11:20:25.835129 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 11:20:47.153313 1 request.go:655] Throttling request took 1.048090296s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0520 11:20:48.005042 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-proxy [b1eddd083512] <==
I0520 11:12:52.100942 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0520 11:12:52.101042 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0520 11:12:52.130479 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0520 11:12:52.130569 1 server_others.go:185] Using iptables Proxier.
I0520 11:12:52.130785 1 server.go:650] Version: v1.20.0
I0520 11:12:52.131283 1 config.go:315] Starting service config controller
I0520 11:12:52.131292 1 shared_informer.go:240] Waiting for caches to sync for service config
I0520 11:12:52.133186 1 config.go:224] Starting endpoint slice config controller
I0520 11:12:52.133197 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0520 11:12:52.231783 1 shared_informer.go:247] Caches are synced for service config
I0520 11:12:52.233366 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-proxy [d282e88b488b] <==
I0520 11:15:04.896967 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0520 11:15:04.897088 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0520 11:15:04.920418 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0520 11:15:04.920513 1 server_others.go:185] Using iptables Proxier.
I0520 11:15:04.920742 1 server.go:650] Version: v1.20.0
I0520 11:15:04.921594 1 config.go:315] Starting service config controller
I0520 11:15:04.921611 1 shared_informer.go:240] Waiting for caches to sync for service config
I0520 11:15:04.921629 1 config.go:224] Starting endpoint slice config controller
I0520 11:15:04.921632 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0520 11:15:05.021782 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0520 11:15:05.021882 1 shared_informer.go:247] Caches are synced for service config
==> kube-scheduler [d7bf0c086e3a] <==
W0520 11:12:31.769085 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0520 11:12:31.769133 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0520 11:12:31.769166 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0520 11:12:31.899408 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0520 11:12:31.899444 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0520 11:12:31.900399 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0520 11:12:31.900661 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0520 11:12:31.914052 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0520 11:12:31.914149 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0520 11:12:31.914227 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0520 11:12:31.914291 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0520 11:12:31.914481 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0520 11:12:31.917267 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0520 11:12:31.917277 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0520 11:12:31.917354 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0520 11:12:31.917456 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0520 11:12:31.917528 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0520 11:12:31.917587 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0520 11:12:31.921376 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0520 11:12:32.729541 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0520 11:12:32.838669 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0520 11:12:32.846000 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0520 11:12:32.915942 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
I0520 11:12:33.501160 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
E0520 11:14:27.167523 1 event.go:273] Unable to write event: '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"metrics-server-9975d5f86-24f8f.17d12e2475c1226d", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"kube-system", Name:"metrics-server-9975d5f86-24f8f", UID:"04742115-71c0-4684-a740-4ad06dbbab20", APIVersion:"v1", ResourceVersion:"581", FieldPath:""}, Reason:"Scheduled", Message:"Successfully assigned kube-system/metrics-server-9975d5f86-24f8f to old-k8s-version-879853", Source:v1.EventSource{
Component:"default-scheduler", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc18aea04c7ff246d, ext:123790874037, loc:(*time.Location)(0x25fc580)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc18aea04c7ff246d, ext:123790874037, loc:(*time.Location)(0x25fc580)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'Post "https://192.168.85.2:8443/api/v1/namespaces/kube-system/events": dial tcp 192.168.85.2:8443: connect: connection refused'(may retry after sleeping)
==> kube-scheduler [e881ad64ded6] <==
I0520 11:14:56.255795 1 serving.go:331] Generated self-signed cert in-memory
W0520 11:15:01.838998 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0520 11:15:01.839794 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0520 11:15:01.839843 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0520 11:15:01.839849 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0520 11:15:02.071621 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0520 11:15:02.071659 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0520 11:15:02.082492 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0520 11:15:02.082579 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0520 11:15:02.178645 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
May 20 11:18:34 old-k8s-version-879853 kubelet[1232]: E0520 11:18:34.227935 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
May 20 11:18:40 old-k8s-version-879853 kubelet[1232]: E0520 11:18:40.228209 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:18:49 old-k8s-version-879853 kubelet[1232]: E0520 11:18:49.235833 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
May 20 11:18:51 old-k8s-version-879853 kubelet[1232]: E0520 11:18:51.228282 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:19:03 old-k8s-version-879853 kubelet[1232]: E0520 11:19:03.230228 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
May 20 11:19:06 old-k8s-version-879853 kubelet[1232]: E0520 11:19:06.228367 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:19:15 old-k8s-version-879853 kubelet[1232]: E0520 11:19:15.232306 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
May 20 11:19:19 old-k8s-version-879853 kubelet[1232]: E0520 11:19:19.228241 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:19:26 old-k8s-version-879853 kubelet[1232]: E0520 11:19:26.228031 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
May 20 11:19:30 old-k8s-version-879853 kubelet[1232]: E0520 11:19:30.228171 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:19:40 old-k8s-version-879853 kubelet[1232]: E0520 11:19:40.228690 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
May 20 11:19:41 old-k8s-version-879853 kubelet[1232]: E0520 11:19:41.228364 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:19:53 old-k8s-version-879853 kubelet[1232]: E0520 11:19:53.236437 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
May 20 11:19:56 old-k8s-version-879853 kubelet[1232]: E0520 11:19:56.228010 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:20:08 old-k8s-version-879853 kubelet[1232]: E0520 11:20:08.228563 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
May 20 11:20:08 old-k8s-version-879853 kubelet[1232]: E0520 11:20:08.229095 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:20:21 old-k8s-version-879853 kubelet[1232]: E0520 11:20:21.228588 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
May 20 11:20:23 old-k8s-version-879853 kubelet[1232]: E0520 11:20:23.230344 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:20:32 old-k8s-version-879853 kubelet[1232]: E0520 11:20:32.228101 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
May 20 11:20:38 old-k8s-version-879853 kubelet[1232]: E0520 11:20:38.228264 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:20:43 old-k8s-version-879853 kubelet[1232]: E0520 11:20:43.227932 1232 pod_workers.go:191] Error syncing pod 04e06e00-c9c2-4076-8e12-8abaee177786 ("dashboard-metrics-scraper-8d5bb5db8-cznvg_kubernetes-dashboard(04e06e00-c9c2-4076-8e12-8abaee177786)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
May 20 11:20:49 old-k8s-version-879853 kubelet[1232]: E0520 11:20:49.264362 1232 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host
May 20 11:20:49 old-k8s-version-879853 kubelet[1232]: E0520 11:20:49.264399 1232 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host
May 20 11:20:49 old-k8s-version-879853 kubelet[1232]: E0520 11:20:49.264627 1232 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-4g8dg,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exe
c:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-24f8f_kube-system(047421
15-71c0-4684-a740-4ad06dbbab20): ErrImagePull: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host
May 20 11:20:49 old-k8s-version-879853 kubelet[1232]: E0520 11:20:49.264688 1232 pod_workers.go:191] Error syncing pod 04742115-71c0-4684-a740-4ad06dbbab20 ("metrics-server-9975d5f86-24f8f_kube-system(04742115-71c0-4684-a740-4ad06dbbab20)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
==> kubernetes-dashboard [1963b29e2abd] <==
2024/05/20 11:15:27 Using namespace: kubernetes-dashboard
2024/05/20 11:15:27 Using in-cluster config to connect to apiserver
2024/05/20 11:15:27 Using secret token for csrf signing
2024/05/20 11:15:27 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/05/20 11:15:27 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/05/20 11:15:27 Successful initial request to the apiserver, version: v1.20.0
2024/05/20 11:15:27 Generating JWE encryption key
2024/05/20 11:15:27 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/05/20 11:15:27 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/05/20 11:15:28 Initializing JWE encryption key from synchronized object
2024/05/20 11:15:28 Creating in-cluster Sidecar client
2024/05/20 11:15:28 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 11:15:28 Serving insecurely on HTTP port: 9090
2024/05/20 11:15:58 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 11:16:28 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 11:16:58 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 11:17:28 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 11:17:58 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 11:18:28 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 11:18:58 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 11:19:28 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 11:19:58 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 11:20:28 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 11:15:27 Starting overwatch
==> storage-provisioner [2b538e03219d] <==
I0520 11:15:45.557633 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0520 11:15:45.610748 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0520 11:15:45.617295 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0520 11:16:03.119575 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0520 11:16:03.119929 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-879853_d5228072-6e8a-4918-997b-565dfc9b87aa!
I0520 11:16:03.120121 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"99ea0f77-785b-44cb-b1c7-db2ab174a995", APIVersion:"v1", ResourceVersion:"804", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-879853_d5228072-6e8a-4918-997b-565dfc9b87aa became leader
I0520 11:16:03.220997 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-879853_d5228072-6e8a-4918-997b-565dfc9b87aa!
==> storage-provisioner [7d536cdf43d4] <==
I0520 11:15:04.582624 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0520 11:15:34.584674 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-879853 -n old-k8s-version-879853
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-879853 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-24f8f dashboard-metrics-scraper-8d5bb5db8-cznvg
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-879853 describe pod metrics-server-9975d5f86-24f8f dashboard-metrics-scraper-8d5bb5db8-cznvg
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-879853 describe pod metrics-server-9975d5f86-24f8f dashboard-metrics-scraper-8d5bb5db8-cznvg: exit status 1 (101.597997ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-24f8f" not found
Error from server (NotFound): pods "dashboard-metrics-scraper-8d5bb5db8-cznvg" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-879853 describe pod metrics-server-9975d5f86-24f8f dashboard-metrics-scraper-8d5bb5db8-cznvg: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (376.06s)