=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-696386 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=docker --kubernetes-version=v1.20.0
E0701 11:15:17.095207 7496 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19162-2194/.minikube/profiles/functional-692658/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-696386 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=docker --kubernetes-version=v1.20.0: exit status 102 (6m18.134703784s)
-- stdout --
* [old-k8s-version-696386] minikube v1.33.1 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=19162
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19162-2194/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19162-2194/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.30.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.2
* Using the docker driver based on existing profile
* Starting "old-k8s-version-696386" primary control-plane node in "old-k8s-version-696386" cluster
* Pulling base image v0.0.44-1719413016-19142 ...
* Restarting existing docker container for "old-k8s-version-696386" ...
* Preparing Kubernetes v1.20.0 on Docker 27.0.1 ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-696386 addons enable metrics-server
* Enabled addons: metrics-server, dashboard, default-storageclass, storage-provisioner
-- /stdout --
** stderr **
I0701 11:15:06.063337 315046 out.go:291] Setting OutFile to fd 1 ...
I0701 11:15:06.063613 315046 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0701 11:15:06.063657 315046 out.go:304] Setting ErrFile to fd 2...
I0701 11:15:06.063677 315046 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0701 11:15:06.063984 315046 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19162-2194/.minikube/bin
I0701 11:15:06.064537 315046 out.go:298] Setting JSON to false
I0701 11:15:06.066031 315046 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":3447,"bootTime":1719829059,"procs":224,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1063-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
I0701 11:15:06.066147 315046 start.go:139] virtualization:
I0701 11:15:06.069611 315046 out.go:177] * [old-k8s-version-696386] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0701 11:15:06.072824 315046 notify.go:220] Checking for updates...
I0701 11:15:06.075443 315046 out.go:177] - MINIKUBE_LOCATION=19162
I0701 11:15:06.078283 315046 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0701 11:15:06.080485 315046 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19162-2194/kubeconfig
I0701 11:15:06.082910 315046 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19162-2194/.minikube
I0701 11:15:06.085914 315046 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0701 11:15:06.088390 315046 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0701 11:15:06.091384 315046 config.go:182] Loaded profile config "old-k8s-version-696386": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0
I0701 11:15:06.094647 315046 out.go:177] * Kubernetes 1.30.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.2
I0701 11:15:06.097216 315046 driver.go:392] Setting default libvirt URI to qemu:///system
I0701 11:15:06.184606 315046 docker.go:122] docker version: linux-27.0.3:Docker Engine - Community
I0701 11:15:06.184806 315046 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0701 11:15:06.281327 315046 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:68 SystemTime:2024-07-01 11:15:06.267878966 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1063-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae71819c4f5e67bb4d5ae76a6b735f29cc25774e Expected:ae71819c4f5e67bb4d5ae76a6b735f29cc25774e} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
I0701 11:15:06.281460 315046 docker.go:295] overlay module found
I0701 11:15:06.284923 315046 out.go:177] * Using the docker driver based on existing profile
I0701 11:15:06.287238 315046 start.go:297] selected driver: docker
I0701 11:15:06.287267 315046 start.go:901] validating driver "docker" against &{Name:old-k8s-version-696386 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-696386 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountSt
ring:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0701 11:15:06.287385 315046 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0701 11:15:06.287998 315046 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0701 11:15:06.382971 315046 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:68 SystemTime:2024-07-01 11:15:06.373556288 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1063-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae71819c4f5e67bb4d5ae76a6b735f29cc25774e Expected:ae71819c4f5e67bb4d5ae76a6b735f29cc25774e} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
I0701 11:15:06.383408 315046 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0701 11:15:06.383436 315046 cni.go:84] Creating CNI manager for ""
I0701 11:15:06.383449 315046 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
I0701 11:15:06.383490 315046 start.go:340] cluster config:
{Name:old-k8s-version-696386 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-696386 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountI
P: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0701 11:15:06.386268 315046 out.go:177] * Starting "old-k8s-version-696386" primary control-plane node in "old-k8s-version-696386" cluster
I0701 11:15:06.389108 315046 cache.go:121] Beginning downloading kic base image for docker with docker
I0701 11:15:06.391779 315046 out.go:177] * Pulling base image v0.0.44-1719413016-19142 ...
I0701 11:15:06.394228 315046 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
I0701 11:15:06.394288 315046 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19162-2194/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4
I0701 11:15:06.394298 315046 cache.go:56] Caching tarball of preloaded images
I0701 11:15:06.394408 315046 preload.go:173] Found /home/jenkins/minikube-integration/19162-2194/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
I0701 11:15:06.394423 315046 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
I0701 11:15:06.394538 315046 profile.go:143] Saving config to /home/jenkins/minikube-integration/19162-2194/.minikube/profiles/old-k8s-version-696386/config.json ...
I0701 11:15:06.394762 315046 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d in local docker daemon
I0701 11:15:06.424180 315046 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d in local docker daemon, skipping pull
I0701 11:15:06.424206 315046 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d exists in daemon, skipping load
I0701 11:15:06.424241 315046 cache.go:194] Successfully downloaded all kic artifacts
I0701 11:15:06.424277 315046 start.go:360] acquireMachinesLock for old-k8s-version-696386: {Name:mk76488743e8a4ec42229f77848f6924254c8736 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0701 11:15:06.424352 315046 start.go:364] duration metric: took 40.622µs to acquireMachinesLock for "old-k8s-version-696386"
I0701 11:15:06.424376 315046 start.go:96] Skipping create...Using existing machine configuration
I0701 11:15:06.424390 315046 fix.go:54] fixHost starting:
I0701 11:15:06.424672 315046 cli_runner.go:164] Run: docker container inspect old-k8s-version-696386 --format={{.State.Status}}
I0701 11:15:06.450648 315046 fix.go:112] recreateIfNeeded on old-k8s-version-696386: state=Stopped err=<nil>
W0701 11:15:06.450681 315046 fix.go:138] unexpected machine state, will restart: <nil>
I0701 11:15:06.454231 315046 out.go:177] * Restarting existing docker container for "old-k8s-version-696386" ...
I0701 11:15:06.456782 315046 cli_runner.go:164] Run: docker start old-k8s-version-696386
I0701 11:15:06.924262 315046 cli_runner.go:164] Run: docker container inspect old-k8s-version-696386 --format={{.State.Status}}
I0701 11:15:06.963429 315046 kic.go:430] container "old-k8s-version-696386" state is running.
I0701 11:15:06.963974 315046 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-696386
I0701 11:15:07.000177 315046 profile.go:143] Saving config to /home/jenkins/minikube-integration/19162-2194/.minikube/profiles/old-k8s-version-696386/config.json ...
I0701 11:15:07.000398 315046 machine.go:94] provisionDockerMachine start ...
I0701 11:15:07.000454 315046 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-696386
I0701 11:15:07.053557 315046 main.go:141] libmachine: Using SSH client type: native
I0701 11:15:07.053984 315046 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2ba0] 0x3e5400 <nil> [] 0s} 127.0.0.1 33078 <nil> <nil>}
I0701 11:15:07.053998 315046 main.go:141] libmachine: About to run SSH command:
hostname
I0701 11:15:07.055186 315046 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:42834->127.0.0.1:33078: read: connection reset by peer
I0701 11:15:10.202806 315046 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-696386
I0701 11:15:10.202830 315046 ubuntu.go:169] provisioning hostname "old-k8s-version-696386"
I0701 11:15:10.202890 315046 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-696386
I0701 11:15:10.228579 315046 main.go:141] libmachine: Using SSH client type: native
I0701 11:15:10.228886 315046 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2ba0] 0x3e5400 <nil> [] 0s} 127.0.0.1 33078 <nil> <nil>}
I0701 11:15:10.228910 315046 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-696386 && echo "old-k8s-version-696386" | sudo tee /etc/hostname
I0701 11:15:10.403683 315046 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-696386
I0701 11:15:10.403774 315046 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-696386
I0701 11:15:10.426623 315046 main.go:141] libmachine: Using SSH client type: native
I0701 11:15:10.426874 315046 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2ba0] 0x3e5400 <nil> [] 0s} 127.0.0.1 33078 <nil> <nil>}
I0701 11:15:10.426896 315046 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-696386' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-696386/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-696386' | sudo tee -a /etc/hosts;
fi
fi
I0701 11:15:10.579960 315046 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0701 11:15:10.580068 315046 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19162-2194/.minikube CaCertPath:/home/jenkins/minikube-integration/19162-2194/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19162-2194/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19162-2194/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19162-2194/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19162-2194/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19162-2194/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19162-2194/.minikube}
I0701 11:15:10.580120 315046 ubuntu.go:177] setting up certificates
I0701 11:15:10.580149 315046 provision.go:84] configureAuth start
I0701 11:15:10.580252 315046 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-696386
I0701 11:15:10.614342 315046 provision.go:143] copyHostCerts
I0701 11:15:10.614406 315046 exec_runner.go:144] found /home/jenkins/minikube-integration/19162-2194/.minikube/key.pem, removing ...
I0701 11:15:10.614414 315046 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19162-2194/.minikube/key.pem
I0701 11:15:10.615006 315046 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19162-2194/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19162-2194/.minikube/key.pem (1679 bytes)
I0701 11:15:10.615253 315046 exec_runner.go:144] found /home/jenkins/minikube-integration/19162-2194/.minikube/ca.pem, removing ...
I0701 11:15:10.615263 315046 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19162-2194/.minikube/ca.pem
I0701 11:15:10.615327 315046 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19162-2194/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19162-2194/.minikube/ca.pem (1078 bytes)
I0701 11:15:10.615433 315046 exec_runner.go:144] found /home/jenkins/minikube-integration/19162-2194/.minikube/cert.pem, removing ...
I0701 11:15:10.615443 315046 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19162-2194/.minikube/cert.pem
I0701 11:15:10.615514 315046 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19162-2194/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19162-2194/.minikube/cert.pem (1123 bytes)
I0701 11:15:10.615620 315046 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19162-2194/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19162-2194/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19162-2194/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-696386 san=[127.0.0.1 192.168.85.2 localhost minikube old-k8s-version-696386]
I0701 11:15:10.975878 315046 provision.go:177] copyRemoteCerts
I0701 11:15:10.976011 315046 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0701 11:15:10.976115 315046 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-696386
I0701 11:15:10.999835 315046 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33078 SSHKeyPath:/home/jenkins/minikube-integration/19162-2194/.minikube/machines/old-k8s-version-696386/id_rsa Username:docker}
I0701 11:15:11.106021 315046 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19162-2194/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0701 11:15:11.138619 315046 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19162-2194/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0701 11:15:11.169464 315046 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19162-2194/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0701 11:15:11.201339 315046 provision.go:87] duration metric: took 621.162036ms to configureAuth
I0701 11:15:11.201383 315046 ubuntu.go:193] setting minikube options for container-runtime
I0701 11:15:11.201633 315046 config.go:182] Loaded profile config "old-k8s-version-696386": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0
I0701 11:15:11.201702 315046 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-696386
I0701 11:15:11.219570 315046 main.go:141] libmachine: Using SSH client type: native
I0701 11:15:11.219908 315046 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2ba0] 0x3e5400 <nil> [] 0s} 127.0.0.1 33078 <nil> <nil>}
I0701 11:15:11.219930 315046 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0701 11:15:11.360294 315046 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0701 11:15:11.360366 315046 ubuntu.go:71] root file system type: overlay
I0701 11:15:11.360513 315046 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
I0701 11:15:11.360614 315046 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-696386
I0701 11:15:11.384814 315046 main.go:141] libmachine: Using SSH client type: native
I0701 11:15:11.385046 315046 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2ba0] 0x3e5400 <nil> [] 0s} 127.0.0.1 33078 <nil> <nil>}
I0701 11:15:11.385122 315046 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0701 11:15:11.541818 315046 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0701 11:15:11.541904 315046 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-696386
I0701 11:15:11.567361 315046 main.go:141] libmachine: Using SSH client type: native
I0701 11:15:11.567593 315046 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2ba0] 0x3e5400 <nil> [] 0s} 127.0.0.1 33078 <nil> <nil>}
I0701 11:15:11.567616 315046 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0701 11:15:11.723394 315046 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0701 11:15:11.723429 315046 machine.go:97] duration metric: took 4.723021329s to provisionDockerMachine
I0701 11:15:11.723446 315046 start.go:293] postStartSetup for "old-k8s-version-696386" (driver="docker")
I0701 11:15:11.723459 315046 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0701 11:15:11.723545 315046 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0701 11:15:11.723601 315046 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-696386
I0701 11:15:11.752463 315046 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33078 SSHKeyPath:/home/jenkins/minikube-integration/19162-2194/.minikube/machines/old-k8s-version-696386/id_rsa Username:docker}
I0701 11:15:11.856873 315046 ssh_runner.go:195] Run: cat /etc/os-release
I0701 11:15:11.861191 315046 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0701 11:15:11.861230 315046 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0701 11:15:11.861241 315046 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0701 11:15:11.861248 315046 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0701 11:15:11.861258 315046 filesync.go:126] Scanning /home/jenkins/minikube-integration/19162-2194/.minikube/addons for local assets ...
I0701 11:15:11.861320 315046 filesync.go:126] Scanning /home/jenkins/minikube-integration/19162-2194/.minikube/files for local assets ...
I0701 11:15:11.861406 315046 filesync.go:149] local asset: /home/jenkins/minikube-integration/19162-2194/.minikube/files/etc/ssl/certs/74962.pem -> 74962.pem in /etc/ssl/certs
I0701 11:15:11.861522 315046 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0701 11:15:11.871586 315046 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19162-2194/.minikube/files/etc/ssl/certs/74962.pem --> /etc/ssl/certs/74962.pem (1708 bytes)
I0701 11:15:11.902432 315046 start.go:296] duration metric: took 178.968527ms for postStartSetup
I0701 11:15:11.902514 315046 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0701 11:15:11.902574 315046 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-696386
I0701 11:15:11.927919 315046 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33078 SSHKeyPath:/home/jenkins/minikube-integration/19162-2194/.minikube/machines/old-k8s-version-696386/id_rsa Username:docker}
I0701 11:15:12.031846 315046 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0701 11:15:12.037817 315046 fix.go:56] duration metric: took 5.613423913s for fixHost
I0701 11:15:12.037847 315046 start.go:83] releasing machines lock for "old-k8s-version-696386", held for 5.613480601s
I0701 11:15:12.037929 315046 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-696386
I0701 11:15:12.057147 315046 ssh_runner.go:195] Run: cat /version.json
I0701 11:15:12.057198 315046 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-696386
I0701 11:15:12.057445 315046 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0701 11:15:12.057511 315046 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-696386
I0701 11:15:12.094754 315046 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33078 SSHKeyPath:/home/jenkins/minikube-integration/19162-2194/.minikube/machines/old-k8s-version-696386/id_rsa Username:docker}
I0701 11:15:12.101608 315046 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33078 SSHKeyPath:/home/jenkins/minikube-integration/19162-2194/.minikube/machines/old-k8s-version-696386/id_rsa Username:docker}
I0701 11:15:12.335190 315046 ssh_runner.go:195] Run: systemctl --version
I0701 11:15:12.340536 315046 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0701 11:15:12.345235 315046 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0701 11:15:12.365407 315046 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0701 11:15:12.365505 315046 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
I0701 11:15:12.384701 315046 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
I0701 11:15:12.404066 315046 cni.go:308] configured [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0701 11:15:12.404096 315046 start.go:494] detecting cgroup driver to use...
I0701 11:15:12.404131 315046 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0701 11:15:12.404245 315046 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0701 11:15:12.422797 315046 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0701 11:15:12.433331 315046 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0701 11:15:12.444309 315046 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0701 11:15:12.444378 315046 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0701 11:15:12.454734 315046 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0701 11:15:12.465544 315046 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0701 11:15:12.476015 315046 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0701 11:15:12.486779 315046 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0701 11:15:12.497030 315046 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0701 11:15:12.507519 315046 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0701 11:15:12.517241 315046 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0701 11:15:12.527401 315046 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0701 11:15:12.643463 315046 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0701 11:15:12.797754 315046 start.go:494] detecting cgroup driver to use...
I0701 11:15:12.797803 315046 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0701 11:15:12.797853 315046 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0701 11:15:12.837097 315046 cruntime.go:279] skipping containerd shutdown because we are bound to it
I0701 11:15:12.837212 315046 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0701 11:15:12.870559 315046 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0701 11:15:12.909901 315046 ssh_runner.go:195] Run: which cri-dockerd
I0701 11:15:12.915835 315046 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0701 11:15:12.928515 315046 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
I0701 11:15:12.957331 315046 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0701 11:15:13.115216 315046 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0701 11:15:13.265647 315046 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I0701 11:15:13.265763 315046 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I0701 11:15:13.289799 315046 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0701 11:15:13.426503 315046 ssh_runner.go:195] Run: sudo systemctl restart docker
I0701 11:15:14.337139 315046 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0701 11:15:14.377697 315046 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0701 11:15:14.415581 315046 out.go:204] * Preparing Kubernetes v1.20.0 on Docker 27.0.1 ...
I0701 11:15:14.415789 315046 cli_runner.go:164] Run: docker network inspect old-k8s-version-696386 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0701 11:15:14.457210 315046 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0701 11:15:14.463171 315046 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0701 11:15:14.474980 315046 kubeadm.go:877] updating cluster {Name:old-k8s-version-696386 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-696386 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkin
s:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0701 11:15:14.475101 315046 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
I0701 11:15:14.475160 315046 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0701 11:15:14.493241 315046 docker.go:685] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-proxy:v1.20.0
registry.k8s.io/kube-proxy:v1.20.0
k8s.gcr.io/kube-controller-manager:v1.20.0
registry.k8s.io/kube-controller-manager:v1.20.0
k8s.gcr.io/kube-apiserver:v1.20.0
registry.k8s.io/kube-apiserver:v1.20.0
k8s.gcr.io/kube-scheduler:v1.20.0
registry.k8s.io/kube-scheduler:v1.20.0
k8s.gcr.io/etcd:3.4.13-0
registry.k8s.io/etcd:3.4.13-0
k8s.gcr.io/coredns:1.7.0
registry.k8s.io/coredns:1.7.0
k8s.gcr.io/pause:3.2
registry.k8s.io/pause:3.2
gcr.io/k8s-minikube/busybox:1.28.4-glibc
-- /stdout --
I0701 11:15:14.493266 315046 docker.go:615] Images already preloaded, skipping extraction
I0701 11:15:14.493334 315046 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0701 11:15:14.512436 315046 docker.go:685] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-proxy:v1.20.0
registry.k8s.io/kube-proxy:v1.20.0
k8s.gcr.io/kube-controller-manager:v1.20.0
registry.k8s.io/kube-controller-manager:v1.20.0
k8s.gcr.io/kube-apiserver:v1.20.0
registry.k8s.io/kube-apiserver:v1.20.0
k8s.gcr.io/kube-scheduler:v1.20.0
registry.k8s.io/kube-scheduler:v1.20.0
k8s.gcr.io/etcd:3.4.13-0
registry.k8s.io/etcd:3.4.13-0
k8s.gcr.io/coredns:1.7.0
registry.k8s.io/coredns:1.7.0
k8s.gcr.io/pause:3.2
registry.k8s.io/pause:3.2
gcr.io/k8s-minikube/busybox:1.28.4-glibc
-- /stdout --
I0701 11:15:14.512463 315046 cache_images.go:84] Images are preloaded, skipping loading
I0701 11:15:14.512474 315046 kubeadm.go:928] updating node { 192.168.85.2 8443 v1.20.0 docker true true} ...
I0701 11:15:14.512584 315046 kubeadm.go:940] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-696386 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-696386 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0701 11:15:14.512658 315046 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0701 11:15:14.595049 315046 cni.go:84] Creating CNI manager for ""
I0701 11:15:14.595080 315046 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
I0701 11:15:14.595088 315046 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0701 11:15:14.595105 315046 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-696386 NodeName:old-k8s-version-696386 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticP
odPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0701 11:15:14.595345 315046 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-696386"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0701 11:15:14.595421 315046 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0701 11:15:14.606326 315046 binaries.go:44] Found k8s binaries, skipping transfer
I0701 11:15:14.606397 315046 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0701 11:15:14.616073 315046 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (348 bytes)
I0701 11:15:14.637678 315046 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0701 11:15:14.657473 315046 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2118 bytes)
I0701 11:15:14.677270 315046 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0701 11:15:14.680969 315046 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0701 11:15:14.692382 315046 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0701 11:15:14.808233 315046 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0701 11:15:14.828868 315046 certs.go:68] Setting up /home/jenkins/minikube-integration/19162-2194/.minikube/profiles/old-k8s-version-696386 for IP: 192.168.85.2
I0701 11:15:14.828893 315046 certs.go:194] generating shared ca certs ...
I0701 11:15:14.828910 315046 certs.go:226] acquiring lock for ca certs: {Name:mk190b9986027b92e10049426e9c1a50d0addb47 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0701 11:15:14.829044 315046 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19162-2194/.minikube/ca.key
I0701 11:15:14.829092 315046 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19162-2194/.minikube/proxy-client-ca.key
I0701 11:15:14.829105 315046 certs.go:256] generating profile certs ...
I0701 11:15:14.829190 315046 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19162-2194/.minikube/profiles/old-k8s-version-696386/client.key
I0701 11:15:14.829261 315046 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19162-2194/.minikube/profiles/old-k8s-version-696386/apiserver.key.45407f7f
I0701 11:15:14.829312 315046 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19162-2194/.minikube/profiles/old-k8s-version-696386/proxy-client.key
I0701 11:15:14.829442 315046 certs.go:484] found cert: /home/jenkins/minikube-integration/19162-2194/.minikube/certs/7496.pem (1338 bytes)
W0701 11:15:14.829479 315046 certs.go:480] ignoring /home/jenkins/minikube-integration/19162-2194/.minikube/certs/7496_empty.pem, impossibly tiny 0 bytes
I0701 11:15:14.829493 315046 certs.go:484] found cert: /home/jenkins/minikube-integration/19162-2194/.minikube/certs/ca-key.pem (1679 bytes)
I0701 11:15:14.829519 315046 certs.go:484] found cert: /home/jenkins/minikube-integration/19162-2194/.minikube/certs/ca.pem (1078 bytes)
I0701 11:15:14.829548 315046 certs.go:484] found cert: /home/jenkins/minikube-integration/19162-2194/.minikube/certs/cert.pem (1123 bytes)
I0701 11:15:14.829573 315046 certs.go:484] found cert: /home/jenkins/minikube-integration/19162-2194/.minikube/certs/key.pem (1679 bytes)
I0701 11:15:14.829623 315046 certs.go:484] found cert: /home/jenkins/minikube-integration/19162-2194/.minikube/files/etc/ssl/certs/74962.pem (1708 bytes)
I0701 11:15:14.830247 315046 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19162-2194/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0701 11:15:14.897609 315046 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19162-2194/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0701 11:15:14.979833 315046 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19162-2194/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0701 11:15:15.032460 315046 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19162-2194/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0701 11:15:15.081697 315046 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19162-2194/.minikube/profiles/old-k8s-version-696386/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0701 11:15:15.132698 315046 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19162-2194/.minikube/profiles/old-k8s-version-696386/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0701 11:15:15.187647 315046 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19162-2194/.minikube/profiles/old-k8s-version-696386/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0701 11:15:15.258494 315046 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19162-2194/.minikube/profiles/old-k8s-version-696386/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0701 11:15:15.283173 315046 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19162-2194/.minikube/certs/7496.pem --> /usr/share/ca-certificates/7496.pem (1338 bytes)
I0701 11:15:15.307746 315046 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19162-2194/.minikube/files/etc/ssl/certs/74962.pem --> /usr/share/ca-certificates/74962.pem (1708 bytes)
I0701 11:15:15.334025 315046 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19162-2194/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0701 11:15:15.359352 315046 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0701 11:15:15.377851 315046 ssh_runner.go:195] Run: openssl version
I0701 11:15:15.383944 315046 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/74962.pem && ln -fs /usr/share/ca-certificates/74962.pem /etc/ssl/certs/74962.pem"
I0701 11:15:15.393461 315046 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/74962.pem
I0701 11:15:15.397236 315046 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 1 10:27 /usr/share/ca-certificates/74962.pem
I0701 11:15:15.397306 315046 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/74962.pem
I0701 11:15:15.404643 315046 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/74962.pem /etc/ssl/certs/3ec20f2e.0"
I0701 11:15:15.413950 315046 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0701 11:15:15.423344 315046 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0701 11:15:15.427053 315046 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 1 10:20 /usr/share/ca-certificates/minikubeCA.pem
I0701 11:15:15.427118 315046 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0701 11:15:15.434521 315046 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0701 11:15:15.443301 315046 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7496.pem && ln -fs /usr/share/ca-certificates/7496.pem /etc/ssl/certs/7496.pem"
I0701 11:15:15.452532 315046 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7496.pem
I0701 11:15:15.456671 315046 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 1 10:27 /usr/share/ca-certificates/7496.pem
I0701 11:15:15.456737 315046 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7496.pem
I0701 11:15:15.464251 315046 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/7496.pem /etc/ssl/certs/51391683.0"
I0701 11:15:15.473262 315046 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0701 11:15:15.477177 315046 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0701 11:15:15.484562 315046 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0701 11:15:15.491839 315046 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0701 11:15:15.498848 315046 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0701 11:15:15.506009 315046 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0701 11:15:15.513269 315046 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0701 11:15:15.520654 315046 kubeadm.go:391] StartCluster: {Name:old-k8s-version-696386 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-696386 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/
minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0701 11:15:15.520806 315046 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0701 11:15:15.539605 315046 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0701 11:15:15.549395 315046 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0701 11:15:15.549420 315046 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0701 11:15:15.549459 315046 kubeadm.go:587] restartPrimaryControlPlane start ...
I0701 11:15:15.549510 315046 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0701 11:15:15.558747 315046 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0701 11:15:15.559180 315046 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-696386" does not appear in /home/jenkins/minikube-integration/19162-2194/kubeconfig
I0701 11:15:15.559397 315046 kubeconfig.go:62] /home/jenkins/minikube-integration/19162-2194/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-696386" cluster setting kubeconfig missing "old-k8s-version-696386" context setting]
I0701 11:15:15.559722 315046 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19162-2194/kubeconfig: {Name:mkf75306dbed073dd6e3a0b2f9a8268e13312c34 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0701 11:15:15.560940 315046 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0701 11:15:15.569955 315046 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.85.2
I0701 11:15:15.569990 315046 kubeadm.go:591] duration metric: took 20.524345ms to restartPrimaryControlPlane
I0701 11:15:15.569999 315046 kubeadm.go:393] duration metric: took 49.354755ms to StartCluster
I0701 11:15:15.570015 315046 settings.go:142] acquiring lock: {Name:mkf4af070445ff3e0f9e45baa2a95fced3bd4aa5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0701 11:15:15.570079 315046 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19162-2194/kubeconfig
I0701 11:15:15.570673 315046 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19162-2194/kubeconfig: {Name:mkf75306dbed073dd6e3a0b2f9a8268e13312c34 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0701 11:15:15.570866 315046 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0701 11:15:15.571205 315046 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0701 11:15:15.571316 315046 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-696386"
I0701 11:15:15.571352 315046 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-696386"
W0701 11:15:15.571358 315046 addons.go:243] addon storage-provisioner should already be in state true
I0701 11:15:15.571381 315046 host.go:66] Checking if "old-k8s-version-696386" exists ...
I0701 11:15:15.571852 315046 cli_runner.go:164] Run: docker container inspect old-k8s-version-696386 --format={{.State.Status}}
I0701 11:15:15.572186 315046 config.go:182] Loaded profile config "old-k8s-version-696386": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0
I0701 11:15:15.572264 315046 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-696386"
I0701 11:15:15.572297 315046 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-696386"
I0701 11:15:15.572541 315046 cli_runner.go:164] Run: docker container inspect old-k8s-version-696386 --format={{.State.Status}}
I0701 11:15:15.573364 315046 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-696386"
I0701 11:15:15.573398 315046 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-696386"
W0701 11:15:15.573434 315046 addons.go:243] addon metrics-server should already be in state true
I0701 11:15:15.573467 315046 host.go:66] Checking if "old-k8s-version-696386" exists ...
I0701 11:15:15.573954 315046 cli_runner.go:164] Run: docker container inspect old-k8s-version-696386 --format={{.State.Status}}
I0701 11:15:15.576010 315046 out.go:177] * Verifying Kubernetes components...
I0701 11:15:15.576100 315046 addons.go:69] Setting dashboard=true in profile "old-k8s-version-696386"
I0701 11:15:15.576132 315046 addons.go:234] Setting addon dashboard=true in "old-k8s-version-696386"
W0701 11:15:15.576143 315046 addons.go:243] addon dashboard should already be in state true
I0701 11:15:15.576178 315046 host.go:66] Checking if "old-k8s-version-696386" exists ...
I0701 11:15:15.576610 315046 cli_runner.go:164] Run: docker container inspect old-k8s-version-696386 --format={{.State.Status}}
I0701 11:15:15.579110 315046 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0701 11:15:15.626679 315046 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0701 11:15:15.630032 315046 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0701 11:15:15.630056 315046 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0701 11:15:15.630123 315046 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-696386
I0701 11:15:15.635702 315046 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0701 11:15:15.639345 315046 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0701 11:15:15.639373 315046 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0701 11:15:15.639443 315046 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-696386
I0701 11:15:15.648729 315046 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-696386"
W0701 11:15:15.648750 315046 addons.go:243] addon default-storageclass should already be in state true
I0701 11:15:15.648773 315046 host.go:66] Checking if "old-k8s-version-696386" exists ...
I0701 11:15:15.649189 315046 cli_runner.go:164] Run: docker container inspect old-k8s-version-696386 --format={{.State.Status}}
I0701 11:15:15.650380 315046 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0701 11:15:15.654725 315046 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0701 11:15:15.662750 315046 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0701 11:15:15.662792 315046 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0701 11:15:15.662867 315046 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-696386
I0701 11:15:15.684727 315046 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0701 11:15:15.684747 315046 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0701 11:15:15.684817 315046 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-696386
I0701 11:15:15.719390 315046 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33078 SSHKeyPath:/home/jenkins/minikube-integration/19162-2194/.minikube/machines/old-k8s-version-696386/id_rsa Username:docker}
I0701 11:15:15.723454 315046 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33078 SSHKeyPath:/home/jenkins/minikube-integration/19162-2194/.minikube/machines/old-k8s-version-696386/id_rsa Username:docker}
I0701 11:15:15.742902 315046 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33078 SSHKeyPath:/home/jenkins/minikube-integration/19162-2194/.minikube/machines/old-k8s-version-696386/id_rsa Username:docker}
I0701 11:15:15.750489 315046 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33078 SSHKeyPath:/home/jenkins/minikube-integration/19162-2194/.minikube/machines/old-k8s-version-696386/id_rsa Username:docker}
I0701 11:15:15.808018 315046 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0701 11:15:15.864126 315046 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-696386" to be "Ready" ...
I0701 11:15:15.929889 315046 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0701 11:15:15.929914 315046 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0701 11:15:15.961980 315046 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0701 11:15:15.962005 315046 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0701 11:15:15.988261 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0701 11:15:16.021831 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0701 11:15:16.024709 315046 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0701 11:15:16.024736 315046 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0701 11:15:16.036692 315046 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0701 11:15:16.036727 315046 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0701 11:15:16.116375 315046 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0701 11:15:16.116401 315046 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0701 11:15:16.167464 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0701 11:15:16.256302 315046 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0701 11:15:16.256331 315046 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
W0701 11:15:16.315041 315046 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:16.315077 315046 retry.go:31] will retry after 331.753064ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0701 11:15:16.373856 315046 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:16.373890 315046 retry.go:31] will retry after 179.405445ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:16.378354 315046 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0701 11:15:16.378386 315046 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
W0701 11:15:16.435722 315046 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:16.435755 315046 retry.go:31] will retry after 219.508ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:16.442829 315046 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0701 11:15:16.442858 315046 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0701 11:15:16.463318 315046 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0701 11:15:16.463346 315046 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0701 11:15:16.483977 315046 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0701 11:15:16.484003 315046 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0701 11:15:16.504599 315046 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0701 11:15:16.504625 315046 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0701 11:15:16.526481 315046 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0701 11:15:16.526511 315046 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0701 11:15:16.548174 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0701 11:15:16.554311 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0701 11:15:16.647608 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0701 11:15:16.655968 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0701 11:15:16.756032 315046 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:16.756067 315046 retry.go:31] will retry after 245.016665ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0701 11:15:16.793045 315046 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:16.793079 315046 retry.go:31] will retry after 439.945695ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0701 11:15:16.915364 315046 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:16.915393 315046 retry.go:31] will retry after 472.547238ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0701 11:15:16.915418 315046 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:16.915437 315046 retry.go:31] will retry after 198.950991ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:17.001512 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0701 11:15:17.114905 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0701 11:15:17.210192 315046 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:17.210243 315046 retry.go:31] will retry after 342.792341ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:17.233679 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0701 11:15:17.330005 315046 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:17.330037 315046 retry.go:31] will retry after 300.909372ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:17.388339 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0701 11:15:17.543172 315046 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:17.543392 315046 retry.go:31] will retry after 576.205632ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:17.554660 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0701 11:15:17.631618 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0701 11:15:17.837081 315046 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:17.837110 315046 retry.go:31] will retry after 376.465821ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0701 11:15:17.837114 315046 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:17.837133 315046 retry.go:31] will retry after 284.962072ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0701 11:15:17.837164 315046 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:17.837172 315046 retry.go:31] will retry after 835.907014ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:17.864586 315046 node_ready.go:53] error getting node "old-k8s-version-696386": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-696386": dial tcp 192.168.85.2:8443: connect: connection refused
I0701 11:15:18.119841 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0701 11:15:18.123156 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0701 11:15:18.213720 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0701 11:15:18.334352 315046 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:18.334383 315046 retry.go:31] will retry after 927.388639ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0701 11:15:18.334454 315046 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:18.334466 315046 retry.go:31] will retry after 986.787273ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0701 11:15:18.344663 315046 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:18.344700 315046 retry.go:31] will retry after 934.231215ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:18.673338 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0701 11:15:18.798033 315046 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:18.798084 315046 retry.go:31] will retry after 1.763377808s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:19.261956 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0701 11:15:19.279741 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0701 11:15:19.322112 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0701 11:15:19.618596 315046 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:19.618633 315046 retry.go:31] will retry after 1.260137975s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0701 11:15:19.672145 315046 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:19.672179 315046 retry.go:31] will retry after 1.751667161s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0701 11:15:19.674195 315046 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:19.674229 315046 retry.go:31] will retry after 1.845393623s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:19.864952 315046 node_ready.go:53] error getting node "old-k8s-version-696386": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-696386": dial tcp 192.168.85.2:8443: connect: connection refused
I0701 11:15:20.562062 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0701 11:15:20.847414 315046 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:20.847444 315046 retry.go:31] will retry after 1.094813291s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:20.879260 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0701 11:15:21.369753 315046 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:21.369782 315046 retry.go:31] will retry after 2.6011301s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0701 11:15:21.424084 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0701 11:15:21.520422 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0701 11:15:21.942664 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0701 11:15:23.971670 315046 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0701 11:15:31.737650 315046 node_ready.go:49] node "old-k8s-version-696386" has status "Ready":"True"
I0701 11:15:31.737680 315046 node_ready.go:38] duration metric: took 15.873516383s for node "old-k8s-version-696386" to be "Ready" ...
I0701 11:15:31.737690 315046 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0701 11:15:32.129051 315046 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-chqgj" in "kube-system" namespace to be "Ready" ...
I0701 11:15:34.187021 315046 pod_ready.go:102] pod "coredns-74ff55c5b-chqgj" in "kube-system" namespace has status "Ready":"False"
I0701 11:15:35.147774 315046 pod_ready.go:97] error getting pod "coredns-74ff55c5b-chqgj" in "kube-system" namespace (skipping!): pods "coredns-74ff55c5b-chqgj" not found
I0701 11:15:35.147852 315046 pod_ready.go:81] duration metric: took 3.018712878s for pod "coredns-74ff55c5b-chqgj" in "kube-system" namespace to be "Ready" ...
E0701 11:15:35.147878 315046 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-74ff55c5b-chqgj" in "kube-system" namespace (skipping!): pods "coredns-74ff55c5b-chqgj" not found
I0701 11:15:35.147922 315046 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-sbfhj" in "kube-system" namespace to be "Ready" ...
I0701 11:15:35.161028 315046 pod_ready.go:92] pod "coredns-74ff55c5b-sbfhj" in "kube-system" namespace has status "Ready":"True"
I0701 11:15:35.161104 315046 pod_ready.go:81] duration metric: took 13.154851ms for pod "coredns-74ff55c5b-sbfhj" in "kube-system" namespace to be "Ready" ...
I0701 11:15:35.161133 315046 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-696386" in "kube-system" namespace to be "Ready" ...
I0701 11:15:36.268430 315046 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (14.844312204s)
I0701 11:15:36.268641 315046 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (14.325949601s)
I0701 11:15:36.268909 315046 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-696386"
I0701 11:15:36.268670 315046 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (14.748123493s)
I0701 11:15:36.272237 315046 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-696386 addons enable metrics-server
I0701 11:15:36.415641 315046 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (12.443937694s)
I0701 11:15:36.418123 315046 out.go:177] * Enabled addons: metrics-server, dashboard, default-storageclass, storage-provisioner
I0701 11:15:36.419859 315046 addons.go:510] duration metric: took 20.848649739s for enable addons: enabled=[metrics-server dashboard default-storageclass storage-provisioner]
I0701 11:15:37.168228 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:15:39.668929 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:15:41.741585 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:15:44.167499 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:15:46.168416 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:15:48.172490 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:15:50.667951 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:15:52.689880 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:15:55.175053 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:15:57.675059 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:00.301350 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:02.670367 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:05.169281 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:07.667406 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:09.668289 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:11.676316 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:14.168426 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:16.168680 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:18.673466 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:21.168515 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:23.169235 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:25.667027 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:27.668059 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:30.168805 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:32.263395 315046 pod_ready.go:102] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:33.675735 315046 pod_ready.go:92] pod "etcd-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"True"
I0701 11:16:33.675756 315046 pod_ready.go:81] duration metric: took 58.514603377s for pod "etcd-old-k8s-version-696386" in "kube-system" namespace to be "Ready" ...
I0701 11:16:33.675770 315046 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-696386" in "kube-system" namespace to be "Ready" ...
I0701 11:16:33.685448 315046 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"True"
I0701 11:16:33.685522 315046 pod_ready.go:81] duration metric: took 9.743353ms for pod "kube-apiserver-old-k8s-version-696386" in "kube-system" namespace to be "Ready" ...
I0701 11:16:33.685550 315046 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-696386" in "kube-system" namespace to be "Ready" ...
I0701 11:16:33.696233 315046 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"True"
I0701 11:16:33.696298 315046 pod_ready.go:81] duration metric: took 10.726644ms for pod "kube-controller-manager-old-k8s-version-696386" in "kube-system" namespace to be "Ready" ...
I0701 11:16:33.696337 315046 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-hmgpt" in "kube-system" namespace to be "Ready" ...
I0701 11:16:33.704682 315046 pod_ready.go:92] pod "kube-proxy-hmgpt" in "kube-system" namespace has status "Ready":"True"
I0701 11:16:33.704704 315046 pod_ready.go:81] duration metric: took 8.33229ms for pod "kube-proxy-hmgpt" in "kube-system" namespace to be "Ready" ...
I0701 11:16:33.704715 315046 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-696386" in "kube-system" namespace to be "Ready" ...
I0701 11:16:35.710905 315046 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:37.710988 315046 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:40.212895 315046 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:42.711758 315046 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:45.214694 315046 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:47.711173 315046 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:49.711449 315046 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:52.212392 315046 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:54.710393 315046 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:56.712885 315046 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:16:59.212171 315046 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:01.213366 315046 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:01.711403 315046 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-696386" in "kube-system" namespace has status "Ready":"True"
I0701 11:17:01.711439 315046 pod_ready.go:81] duration metric: took 28.006716286s for pod "kube-scheduler-old-k8s-version-696386" in "kube-system" namespace to be "Ready" ...
I0701 11:17:01.711452 315046 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace to be "Ready" ...
I0701 11:17:03.718391 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:05.732565 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:08.225563 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:10.717051 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:12.717536 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:15.217780 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:17.218139 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:19.718611 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:22.217506 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:24.718212 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:27.217884 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:29.717290 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:31.717847 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:34.218596 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:36.717879 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:39.217494 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:41.218130 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:43.218507 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:45.227565 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:47.717270 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:50.217173 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:52.217615 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:54.218574 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:56.718051 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:17:58.719105 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:01.218003 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:03.717535 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:05.718242 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:08.223618 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:10.717985 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:13.217424 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:15.221137 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:17.717205 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:19.717421 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:21.717933 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:24.217505 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:26.218456 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:28.219041 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:30.718018 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:33.276162 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:35.719029 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:38.226142 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:40.717591 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:42.718483 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:45.222346 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:47.717600 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:49.718998 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:51.724845 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:54.218028 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:56.218101 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:18:58.226470 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:00.233155 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:02.721275 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:05.217691 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:07.218847 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:09.219194 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:11.719419 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:14.217258 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:16.217380 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:18.218844 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:20.717467 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:22.718186 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:24.719160 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:26.719281 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:29.217887 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:31.218579 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:33.219060 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:35.718230 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:38.225351 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:40.719331 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:43.217600 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:45.223844 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:47.718439 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:50.217767 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:52.217969 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:54.222615 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:56.716910 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:19:58.718254 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:01.219125 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:03.718576 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:06.218355 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:08.225367 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:10.718311 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:13.217352 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:15.218776 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:17.718390 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:19.718569 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:21.719177 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:24.217901 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:26.218818 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:28.218894 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:30.219427 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:32.717896 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:34.718086 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:36.718867 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:38.719593 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:41.218245 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:43.718508 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:45.720622 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:48.226854 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:50.717867 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:52.720266 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:55.217425 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:57.218016 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:20:59.219376 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:21:01.717255 315046 pod_ready.go:102] pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace has status "Ready":"False"
I0701 11:21:01.717299 315046 pod_ready.go:81] duration metric: took 4m0.005839066s for pod "metrics-server-9975d5f86-4zbxq" in "kube-system" namespace to be "Ready" ...
E0701 11:21:01.717309 315046 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0701 11:21:01.717317 315046 pod_ready.go:38] duration metric: took 5m29.979616622s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0701 11:21:01.717341 315046 api_server.go:52] waiting for apiserver process to appear ...
I0701 11:21:01.717427 315046 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0701 11:21:01.738639 315046 logs.go:276] 2 containers: [cd8eafe48e00 c51045b66cf0]
I0701 11:21:01.738717 315046 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0701 11:21:01.759071 315046 logs.go:276] 2 containers: [9a896ea0ddad 29316c971663]
I0701 11:21:01.759159 315046 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0701 11:21:01.784049 315046 logs.go:276] 2 containers: [9d0ed2465f50 0a711fdb4841]
I0701 11:21:01.784130 315046 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0701 11:21:01.812598 315046 logs.go:276] 2 containers: [f51b9c7349c1 f1c05044007f]
I0701 11:21:01.812678 315046 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0701 11:21:01.834227 315046 logs.go:276] 2 containers: [1765ef5cbb5b dbdb63d9a921]
I0701 11:21:01.834374 315046 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0701 11:21:01.854766 315046 logs.go:276] 2 containers: [4dfa46bb0f73 fb83ba4a51dd]
I0701 11:21:01.854855 315046 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0701 11:21:01.885378 315046 logs.go:276] 0 containers: []
W0701 11:21:01.885443 315046 logs.go:278] No container was found matching "kindnet"
I0701 11:21:01.885541 315046 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0701 11:21:01.909331 315046 logs.go:276] 2 containers: [0935d40910f8 397bd2063830]
I0701 11:21:01.909472 315046 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0701 11:21:01.934525 315046 logs.go:276] 1 containers: [f6fed13e2a7b]
I0701 11:21:01.934559 315046 logs.go:123] Gathering logs for kube-apiserver [c51045b66cf0] ...
I0701 11:21:01.934572 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c51045b66cf0"
I0701 11:21:02.061859 315046 logs.go:123] Gathering logs for kube-scheduler [f51b9c7349c1] ...
I0701 11:21:02.061931 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f51b9c7349c1"
I0701 11:21:02.088835 315046 logs.go:123] Gathering logs for kube-proxy [dbdb63d9a921] ...
I0701 11:21:02.088933 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dbdb63d9a921"
I0701 11:21:02.117337 315046 logs.go:123] Gathering logs for kubernetes-dashboard [f6fed13e2a7b] ...
I0701 11:21:02.117368 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6fed13e2a7b"
I0701 11:21:02.140894 315046 logs.go:123] Gathering logs for container status ...
I0701 11:21:02.140969 315046 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0701 11:21:02.216445 315046 logs.go:123] Gathering logs for dmesg ...
I0701 11:21:02.216480 315046 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0701 11:21:02.242478 315046 logs.go:123] Gathering logs for etcd [9a896ea0ddad] ...
I0701 11:21:02.242510 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9a896ea0ddad"
I0701 11:21:02.279533 315046 logs.go:123] Gathering logs for coredns [0a711fdb4841] ...
I0701 11:21:02.279610 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0a711fdb4841"
I0701 11:21:02.308864 315046 logs.go:123] Gathering logs for describe nodes ...
I0701 11:21:02.308893 315046 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0701 11:21:02.488851 315046 logs.go:123] Gathering logs for etcd [29316c971663] ...
I0701 11:21:02.488884 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 29316c971663"
I0701 11:21:02.514998 315046 logs.go:123] Gathering logs for kube-scheduler [f1c05044007f] ...
I0701 11:21:02.515024 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f1c05044007f"
I0701 11:21:02.544553 315046 logs.go:123] Gathering logs for kube-controller-manager [fb83ba4a51dd] ...
I0701 11:21:02.544582 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 fb83ba4a51dd"
I0701 11:21:02.584064 315046 logs.go:123] Gathering logs for storage-provisioner [0935d40910f8] ...
I0701 11:21:02.584100 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0935d40910f8"
I0701 11:21:02.632645 315046 logs.go:123] Gathering logs for Docker ...
I0701 11:21:02.632671 315046 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0701 11:21:02.660356 315046 logs.go:123] Gathering logs for kubelet ...
I0701 11:21:02.660394 315046 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0701 11:21:02.730943 315046 logs.go:138] Found kubelet problem: Jul 01 11:15:31 old-k8s-version-696386 kubelet[1364]: E0701 11:15:31.993117 1364 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-696386" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-696386' and this object
W0701 11:21:02.731165 315046 logs.go:138] Found kubelet problem: Jul 01 11:15:31 old-k8s-version-696386 kubelet[1364]: E0701 11:15:31.993191 1364 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-696386" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-696386' and this object
W0701 11:21:02.731425 315046 logs.go:138] Found kubelet problem: Jul 01 11:15:31 old-k8s-version-696386 kubelet[1364]: E0701 11:15:31.993243 1364 reflector.go:138] object-"kube-system"/"kube-proxy-token-jsm4n": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-jsm4n" is forbidden: User "system:node:old-k8s-version-696386" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-696386' and this object
W0701 11:21:02.731661 315046 logs.go:138] Found kubelet problem: Jul 01 11:15:31 old-k8s-version-696386 kubelet[1364]: E0701 11:15:31.993293 1364 reflector.go:138] object-"kube-system"/"storage-provisioner-token-nspwv": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-nspwv" is forbidden: User "system:node:old-k8s-version-696386" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-696386' and this object
W0701 11:21:02.731877 315046 logs.go:138] Found kubelet problem: Jul 01 11:15:31 old-k8s-version-696386 kubelet[1364]: E0701 11:15:31.993353 1364 reflector.go:138] object-"kube-system"/"coredns-token-6rr8l": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-6rr8l" is forbidden: User "system:node:old-k8s-version-696386" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-696386' and this object
W0701 11:21:02.732093 315046 logs.go:138] Found kubelet problem: Jul 01 11:15:32 old-k8s-version-696386 kubelet[1364]: E0701 11:15:32.011750 1364 reflector.go:138] object-"default"/"default-token-8jrn9": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-8jrn9" is forbidden: User "system:node:old-k8s-version-696386" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-696386' and this object
W0701 11:21:02.738277 315046 logs.go:138] Found kubelet problem: Jul 01 11:15:33 old-k8s-version-696386 kubelet[1364]: E0701 11:15:33.694373 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0701 11:21:02.738776 315046 logs.go:138] Found kubelet problem: Jul 01 11:15:35 old-k8s-version-696386 kubelet[1364]: E0701 11:15:35.343425 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.739747 315046 logs.go:138] Found kubelet problem: Jul 01 11:15:37 old-k8s-version-696386 kubelet[1364]: E0701 11:15:37.383467 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.742523 315046 logs.go:138] Found kubelet problem: Jul 01 11:15:51 old-k8s-version-696386 kubelet[1364]: E0701 11:15:51.604073 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0701 11:21:02.747539 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:00 old-k8s-version-696386 kubelet[1364]: E0701 11:16:00.761776 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0701 11:21:02.747930 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:00 old-k8s-version-696386 kubelet[1364]: E0701 11:16:00.933843 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.748119 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:04 old-k8s-version-696386 kubelet[1364]: E0701 11:16:04.579456 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.748589 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:07 old-k8s-version-696386 kubelet[1364]: E0701 11:16:07.000314 1364 pod_workers.go:191] Error syncing pod 72a05654-8464-4911-a286-4f6d196cd3f8 ("storage-provisioner_kube-system(72a05654-8464-4911-a286-4f6d196cd3f8)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(72a05654-8464-4911-a286-4f6d196cd3f8)"
W0701 11:21:02.751196 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:12 old-k8s-version-696386 kubelet[1364]: E0701 11:16:12.281909 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0701 11:21:02.753280 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:18 old-k8s-version-696386 kubelet[1364]: E0701 11:16:18.653680 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0701 11:21:02.753611 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:24 old-k8s-version-696386 kubelet[1364]: E0701 11:16:24.582852 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.753799 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:33 old-k8s-version-696386 kubelet[1364]: E0701 11:16:33.578761 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.756107 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:40 old-k8s-version-696386 kubelet[1364]: E0701 11:16:40.240718 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0701 11:21:02.756301 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:46 old-k8s-version-696386 kubelet[1364]: E0701 11:16:46.579144 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.756500 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:51 old-k8s-version-696386 kubelet[1364]: E0701 11:16:51.599801 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.756686 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:58 old-k8s-version-696386 kubelet[1364]: E0701 11:16:58.579333 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.756889 315046 logs.go:138] Found kubelet problem: Jul 01 11:17:03 old-k8s-version-696386 kubelet[1364]: E0701 11:17:03.594042 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.759016 315046 logs.go:138] Found kubelet problem: Jul 01 11:17:13 old-k8s-version-696386 kubelet[1364]: E0701 11:17:13.599683 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0701 11:21:02.759220 315046 logs.go:138] Found kubelet problem: Jul 01 11:17:16 old-k8s-version-696386 kubelet[1364]: E0701 11:17:16.579605 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.759415 315046 logs.go:138] Found kubelet problem: Jul 01 11:17:26 old-k8s-version-696386 kubelet[1364]: E0701 11:17:26.586223 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.761657 315046 logs.go:138] Found kubelet problem: Jul 01 11:17:31 old-k8s-version-696386 kubelet[1364]: E0701 11:17:31.211494 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0701 11:21:02.761845 315046 logs.go:138] Found kubelet problem: Jul 01 11:17:41 old-k8s-version-696386 kubelet[1364]: E0701 11:17:41.578917 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.762044 315046 logs.go:138] Found kubelet problem: Jul 01 11:17:42 old-k8s-version-696386 kubelet[1364]: E0701 11:17:42.582124 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.762229 315046 logs.go:138] Found kubelet problem: Jul 01 11:17:56 old-k8s-version-696386 kubelet[1364]: E0701 11:17:56.595465 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.762428 315046 logs.go:138] Found kubelet problem: Jul 01 11:17:57 old-k8s-version-696386 kubelet[1364]: E0701 11:17:57.579158 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.762613 315046 logs.go:138] Found kubelet problem: Jul 01 11:18:08 old-k8s-version-696386 kubelet[1364]: E0701 11:18:08.579091 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.762815 315046 logs.go:138] Found kubelet problem: Jul 01 11:18:12 old-k8s-version-696386 kubelet[1364]: E0701 11:18:12.594147 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.763002 315046 logs.go:138] Found kubelet problem: Jul 01 11:18:19 old-k8s-version-696386 kubelet[1364]: E0701 11:18:19.578665 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.763201 315046 logs.go:138] Found kubelet problem: Jul 01 11:18:26 old-k8s-version-696386 kubelet[1364]: E0701 11:18:26.578760 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.763408 315046 logs.go:138] Found kubelet problem: Jul 01 11:18:33 old-k8s-version-696386 kubelet[1364]: E0701 11:18:33.578719 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.763617 315046 logs.go:138] Found kubelet problem: Jul 01 11:18:40 old-k8s-version-696386 kubelet[1364]: E0701 11:18:40.583371 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.765719 315046 logs.go:138] Found kubelet problem: Jul 01 11:18:48 old-k8s-version-696386 kubelet[1364]: E0701 11:18:48.615321 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0701 11:21:02.768004 315046 logs.go:138] Found kubelet problem: Jul 01 11:18:54 old-k8s-version-696386 kubelet[1364]: E0701 11:18:54.237506 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0701 11:21:02.768193 315046 logs.go:138] Found kubelet problem: Jul 01 11:19:03 old-k8s-version-696386 kubelet[1364]: E0701 11:19:03.590795 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.768395 315046 logs.go:138] Found kubelet problem: Jul 01 11:19:06 old-k8s-version-696386 kubelet[1364]: E0701 11:19:06.579056 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.768583 315046 logs.go:138] Found kubelet problem: Jul 01 11:19:15 old-k8s-version-696386 kubelet[1364]: E0701 11:19:15.578756 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.768790 315046 logs.go:138] Found kubelet problem: Jul 01 11:19:21 old-k8s-version-696386 kubelet[1364]: E0701 11:19:21.596820 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.768976 315046 logs.go:138] Found kubelet problem: Jul 01 11:19:30 old-k8s-version-696386 kubelet[1364]: E0701 11:19:30.578878 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.769176 315046 logs.go:138] Found kubelet problem: Jul 01 11:19:36 old-k8s-version-696386 kubelet[1364]: E0701 11:19:36.582805 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.769362 315046 logs.go:138] Found kubelet problem: Jul 01 11:19:41 old-k8s-version-696386 kubelet[1364]: E0701 11:19:41.578801 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.769561 315046 logs.go:138] Found kubelet problem: Jul 01 11:19:49 old-k8s-version-696386 kubelet[1364]: E0701 11:19:49.578762 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.769746 315046 logs.go:138] Found kubelet problem: Jul 01 11:19:56 old-k8s-version-696386 kubelet[1364]: E0701 11:19:56.578903 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.769946 315046 logs.go:138] Found kubelet problem: Jul 01 11:20:00 old-k8s-version-696386 kubelet[1364]: E0701 11:20:00.585124 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.770132 315046 logs.go:138] Found kubelet problem: Jul 01 11:20:08 old-k8s-version-696386 kubelet[1364]: E0701 11:20:08.582651 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.770332 315046 logs.go:138] Found kubelet problem: Jul 01 11:20:11 old-k8s-version-696386 kubelet[1364]: E0701 11:20:11.578904 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.770519 315046 logs.go:138] Found kubelet problem: Jul 01 11:20:23 old-k8s-version-696386 kubelet[1364]: E0701 11:20:23.578713 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.770716 315046 logs.go:138] Found kubelet problem: Jul 01 11:20:24 old-k8s-version-696386 kubelet[1364]: E0701 11:20:24.587688 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.770918 315046 logs.go:138] Found kubelet problem: Jul 01 11:20:35 old-k8s-version-696386 kubelet[1364]: E0701 11:20:35.578981 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.771117 315046 logs.go:138] Found kubelet problem: Jul 01 11:20:35 old-k8s-version-696386 kubelet[1364]: E0701 11:20:35.579957 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.771326 315046 logs.go:138] Found kubelet problem: Jul 01 11:20:47 old-k8s-version-696386 kubelet[1364]: E0701 11:20:47.578787 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.771513 315046 logs.go:138] Found kubelet problem: Jul 01 11:20:48 old-k8s-version-696386 kubelet[1364]: E0701 11:20:48.582337 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.771713 315046 logs.go:138] Found kubelet problem: Jul 01 11:20:58 old-k8s-version-696386 kubelet[1364]: E0701 11:20:58.580623 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.771898 315046 logs.go:138] Found kubelet problem: Jul 01 11:21:02 old-k8s-version-696386 kubelet[1364]: E0701 11:21:02.591635 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0701 11:21:02.771908 315046 logs.go:123] Gathering logs for kube-apiserver [cd8eafe48e00] ...
I0701 11:21:02.771921 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 cd8eafe48e00"
I0701 11:21:02.815853 315046 logs.go:123] Gathering logs for coredns [9d0ed2465f50] ...
I0701 11:21:02.815885 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9d0ed2465f50"
I0701 11:21:02.848453 315046 logs.go:123] Gathering logs for kube-proxy [1765ef5cbb5b] ...
I0701 11:21:02.848484 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1765ef5cbb5b"
I0701 11:21:02.886483 315046 logs.go:123] Gathering logs for kube-controller-manager [4dfa46bb0f73] ...
I0701 11:21:02.886509 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4dfa46bb0f73"
I0701 11:21:02.957188 315046 logs.go:123] Gathering logs for storage-provisioner [397bd2063830] ...
I0701 11:21:02.957225 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 397bd2063830"
I0701 11:21:02.997779 315046 out.go:304] Setting ErrFile to fd 2...
I0701 11:21:02.997810 315046 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0701 11:21:02.997877 315046 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0701 11:21:02.997895 315046 out.go:239] Jul 01 11:20:35 old-k8s-version-696386 kubelet[1364]: E0701 11:20:35.579957 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jul 01 11:20:35 old-k8s-version-696386 kubelet[1364]: E0701 11:20:35.579957 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.997921 315046 out.go:239] Jul 01 11:20:47 old-k8s-version-696386 kubelet[1364]: E0701 11:20:47.578787 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jul 01 11:20:47 old-k8s-version-696386 kubelet[1364]: E0701 11:20:47.578787 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.997934 315046 out.go:239] Jul 01 11:20:48 old-k8s-version-696386 kubelet[1364]: E0701 11:20:48.582337 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 11:20:48 old-k8s-version-696386 kubelet[1364]: E0701 11:20:48.582337 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.997958 315046 out.go:239] Jul 01 11:20:58 old-k8s-version-696386 kubelet[1364]: E0701 11:20:58.580623 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jul 01 11:20:58 old-k8s-version-696386 kubelet[1364]: E0701 11:20:58.580623 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:02.997966 315046 out.go:239] Jul 01 11:21:02 old-k8s-version-696386 kubelet[1364]: E0701 11:21:02.591635 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 11:21:02 old-k8s-version-696386 kubelet[1364]: E0701 11:21:02.591635 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0701 11:21:02.997978 315046 out.go:304] Setting ErrFile to fd 2...
I0701 11:21:02.997985 315046 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0701 11:21:12.998231 315046 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0701 11:21:13.010772 315046 api_server.go:72] duration metric: took 5m57.439866943s to wait for apiserver process to appear ...
I0701 11:21:13.010810 315046 api_server.go:88] waiting for apiserver healthz status ...
I0701 11:21:13.010909 315046 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0701 11:21:13.031443 315046 logs.go:276] 2 containers: [cd8eafe48e00 c51045b66cf0]
I0701 11:21:13.031527 315046 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0701 11:21:13.048367 315046 logs.go:276] 2 containers: [9a896ea0ddad 29316c971663]
I0701 11:21:13.048446 315046 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0701 11:21:13.068894 315046 logs.go:276] 2 containers: [9d0ed2465f50 0a711fdb4841]
I0701 11:21:13.068976 315046 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0701 11:21:13.090131 315046 logs.go:276] 2 containers: [f51b9c7349c1 f1c05044007f]
I0701 11:21:13.090208 315046 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0701 11:21:13.114611 315046 logs.go:276] 2 containers: [1765ef5cbb5b dbdb63d9a921]
I0701 11:21:13.114695 315046 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0701 11:21:13.134436 315046 logs.go:276] 2 containers: [4dfa46bb0f73 fb83ba4a51dd]
I0701 11:21:13.134550 315046 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0701 11:21:13.154367 315046 logs.go:276] 0 containers: []
W0701 11:21:13.154390 315046 logs.go:278] No container was found matching "kindnet"
I0701 11:21:13.154448 315046 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0701 11:21:13.175580 315046 logs.go:276] 1 containers: [f6fed13e2a7b]
I0701 11:21:13.175661 315046 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0701 11:21:13.195576 315046 logs.go:276] 2 containers: [0935d40910f8 397bd2063830]
I0701 11:21:13.195607 315046 logs.go:123] Gathering logs for describe nodes ...
I0701 11:21:13.195619 315046 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0701 11:21:13.339382 315046 logs.go:123] Gathering logs for kube-proxy [1765ef5cbb5b] ...
I0701 11:21:13.339464 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1765ef5cbb5b"
I0701 11:21:13.362079 315046 logs.go:123] Gathering logs for kube-proxy [dbdb63d9a921] ...
I0701 11:21:13.362108 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dbdb63d9a921"
I0701 11:21:13.383846 315046 logs.go:123] Gathering logs for kube-apiserver [cd8eafe48e00] ...
I0701 11:21:13.383875 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 cd8eafe48e00"
I0701 11:21:13.430429 315046 logs.go:123] Gathering logs for etcd [9a896ea0ddad] ...
I0701 11:21:13.430465 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9a896ea0ddad"
I0701 11:21:13.456976 315046 logs.go:123] Gathering logs for kube-controller-manager [fb83ba4a51dd] ...
I0701 11:21:13.457007 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 fb83ba4a51dd"
I0701 11:21:13.493658 315046 logs.go:123] Gathering logs for storage-provisioner [0935d40910f8] ...
I0701 11:21:13.493692 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0935d40910f8"
I0701 11:21:13.515921 315046 logs.go:123] Gathering logs for container status ...
I0701 11:21:13.515956 315046 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0701 11:21:13.578451 315046 logs.go:123] Gathering logs for Docker ...
I0701 11:21:13.578479 315046 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0701 11:21:13.604752 315046 logs.go:123] Gathering logs for etcd [29316c971663] ...
I0701 11:21:13.604786 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 29316c971663"
I0701 11:21:13.647901 315046 logs.go:123] Gathering logs for coredns [0a711fdb4841] ...
I0701 11:21:13.647931 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0a711fdb4841"
I0701 11:21:13.676187 315046 logs.go:123] Gathering logs for kube-scheduler [f1c05044007f] ...
I0701 11:21:13.676216 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f1c05044007f"
I0701 11:21:13.701830 315046 logs.go:123] Gathering logs for kubernetes-dashboard [f6fed13e2a7b] ...
I0701 11:21:13.701905 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f6fed13e2a7b"
I0701 11:21:13.724805 315046 logs.go:123] Gathering logs for storage-provisioner [397bd2063830] ...
I0701 11:21:13.724874 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 397bd2063830"
I0701 11:21:13.748761 315046 logs.go:123] Gathering logs for kube-controller-manager [4dfa46bb0f73] ...
I0701 11:21:13.748789 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4dfa46bb0f73"
I0701 11:21:13.789722 315046 logs.go:123] Gathering logs for kubelet ...
I0701 11:21:13.789754 315046 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0701 11:21:13.855974 315046 logs.go:138] Found kubelet problem: Jul 01 11:15:31 old-k8s-version-696386 kubelet[1364]: E0701 11:15:31.993117 1364 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-696386" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-696386' and this object
W0701 11:21:13.856199 315046 logs.go:138] Found kubelet problem: Jul 01 11:15:31 old-k8s-version-696386 kubelet[1364]: E0701 11:15:31.993191 1364 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-696386" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-696386' and this object
W0701 11:21:13.856429 315046 logs.go:138] Found kubelet problem: Jul 01 11:15:31 old-k8s-version-696386 kubelet[1364]: E0701 11:15:31.993243 1364 reflector.go:138] object-"kube-system"/"kube-proxy-token-jsm4n": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-jsm4n" is forbidden: User "system:node:old-k8s-version-696386" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-696386' and this object
W0701 11:21:13.856659 315046 logs.go:138] Found kubelet problem: Jul 01 11:15:31 old-k8s-version-696386 kubelet[1364]: E0701 11:15:31.993293 1364 reflector.go:138] object-"kube-system"/"storage-provisioner-token-nspwv": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-nspwv" is forbidden: User "system:node:old-k8s-version-696386" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-696386' and this object
W0701 11:21:13.856872 315046 logs.go:138] Found kubelet problem: Jul 01 11:15:31 old-k8s-version-696386 kubelet[1364]: E0701 11:15:31.993353 1364 reflector.go:138] object-"kube-system"/"coredns-token-6rr8l": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-6rr8l" is forbidden: User "system:node:old-k8s-version-696386" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-696386' and this object
W0701 11:21:13.857083 315046 logs.go:138] Found kubelet problem: Jul 01 11:15:32 old-k8s-version-696386 kubelet[1364]: E0701 11:15:32.011750 1364 reflector.go:138] object-"default"/"default-token-8jrn9": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-8jrn9" is forbidden: User "system:node:old-k8s-version-696386" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-696386' and this object
W0701 11:21:13.863381 315046 logs.go:138] Found kubelet problem: Jul 01 11:15:33 old-k8s-version-696386 kubelet[1364]: E0701 11:15:33.694373 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0701 11:21:13.863882 315046 logs.go:138] Found kubelet problem: Jul 01 11:15:35 old-k8s-version-696386 kubelet[1364]: E0701 11:15:35.343425 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.864881 315046 logs.go:138] Found kubelet problem: Jul 01 11:15:37 old-k8s-version-696386 kubelet[1364]: E0701 11:15:37.383467 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.867637 315046 logs.go:138] Found kubelet problem: Jul 01 11:15:51 old-k8s-version-696386 kubelet[1364]: E0701 11:15:51.604073 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0701 11:21:13.872595 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:00 old-k8s-version-696386 kubelet[1364]: E0701 11:16:00.761776 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0701 11:21:13.872975 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:00 old-k8s-version-696386 kubelet[1364]: E0701 11:16:00.933843 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.873163 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:04 old-k8s-version-696386 kubelet[1364]: E0701 11:16:04.579456 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.873604 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:07 old-k8s-version-696386 kubelet[1364]: E0701 11:16:07.000314 1364 pod_workers.go:191] Error syncing pod 72a05654-8464-4911-a286-4f6d196cd3f8 ("storage-provisioner_kube-system(72a05654-8464-4911-a286-4f6d196cd3f8)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(72a05654-8464-4911-a286-4f6d196cd3f8)"
W0701 11:21:13.876201 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:12 old-k8s-version-696386 kubelet[1364]: E0701 11:16:12.281909 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0701 11:21:13.878275 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:18 old-k8s-version-696386 kubelet[1364]: E0701 11:16:18.653680 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0701 11:21:13.878607 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:24 old-k8s-version-696386 kubelet[1364]: E0701 11:16:24.582852 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.878792 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:33 old-k8s-version-696386 kubelet[1364]: E0701 11:16:33.578761 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.881048 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:40 old-k8s-version-696386 kubelet[1364]: E0701 11:16:40.240718 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0701 11:21:13.881254 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:46 old-k8s-version-696386 kubelet[1364]: E0701 11:16:46.579144 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.881454 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:51 old-k8s-version-696386 kubelet[1364]: E0701 11:16:51.599801 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.881643 315046 logs.go:138] Found kubelet problem: Jul 01 11:16:58 old-k8s-version-696386 kubelet[1364]: E0701 11:16:58.579333 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.881841 315046 logs.go:138] Found kubelet problem: Jul 01 11:17:03 old-k8s-version-696386 kubelet[1364]: E0701 11:17:03.594042 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.883935 315046 logs.go:138] Found kubelet problem: Jul 01 11:17:13 old-k8s-version-696386 kubelet[1364]: E0701 11:17:13.599683 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0701 11:21:13.884158 315046 logs.go:138] Found kubelet problem: Jul 01 11:17:16 old-k8s-version-696386 kubelet[1364]: E0701 11:17:16.579605 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.884349 315046 logs.go:138] Found kubelet problem: Jul 01 11:17:26 old-k8s-version-696386 kubelet[1364]: E0701 11:17:26.586223 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.886587 315046 logs.go:138] Found kubelet problem: Jul 01 11:17:31 old-k8s-version-696386 kubelet[1364]: E0701 11:17:31.211494 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0701 11:21:13.886783 315046 logs.go:138] Found kubelet problem: Jul 01 11:17:41 old-k8s-version-696386 kubelet[1364]: E0701 11:17:41.578917 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.886999 315046 logs.go:138] Found kubelet problem: Jul 01 11:17:42 old-k8s-version-696386 kubelet[1364]: E0701 11:17:42.582124 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.887185 315046 logs.go:138] Found kubelet problem: Jul 01 11:17:56 old-k8s-version-696386 kubelet[1364]: E0701 11:17:56.595465 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.887388 315046 logs.go:138] Found kubelet problem: Jul 01 11:17:57 old-k8s-version-696386 kubelet[1364]: E0701 11:17:57.579158 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.887576 315046 logs.go:138] Found kubelet problem: Jul 01 11:18:08 old-k8s-version-696386 kubelet[1364]: E0701 11:18:08.579091 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.887775 315046 logs.go:138] Found kubelet problem: Jul 01 11:18:12 old-k8s-version-696386 kubelet[1364]: E0701 11:18:12.594147 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.887966 315046 logs.go:138] Found kubelet problem: Jul 01 11:18:19 old-k8s-version-696386 kubelet[1364]: E0701 11:18:19.578665 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.888164 315046 logs.go:138] Found kubelet problem: Jul 01 11:18:26 old-k8s-version-696386 kubelet[1364]: E0701 11:18:26.578760 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.888348 315046 logs.go:138] Found kubelet problem: Jul 01 11:18:33 old-k8s-version-696386 kubelet[1364]: E0701 11:18:33.578719 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.888548 315046 logs.go:138] Found kubelet problem: Jul 01 11:18:40 old-k8s-version-696386 kubelet[1364]: E0701 11:18:40.583371 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.890617 315046 logs.go:138] Found kubelet problem: Jul 01 11:18:48 old-k8s-version-696386 kubelet[1364]: E0701 11:18:48.615321 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0701 11:21:13.892886 315046 logs.go:138] Found kubelet problem: Jul 01 11:18:54 old-k8s-version-696386 kubelet[1364]: E0701 11:18:54.237506 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0701 11:21:13.893073 315046 logs.go:138] Found kubelet problem: Jul 01 11:19:03 old-k8s-version-696386 kubelet[1364]: E0701 11:19:03.590795 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.893271 315046 logs.go:138] Found kubelet problem: Jul 01 11:19:06 old-k8s-version-696386 kubelet[1364]: E0701 11:19:06.579056 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.893456 315046 logs.go:138] Found kubelet problem: Jul 01 11:19:15 old-k8s-version-696386 kubelet[1364]: E0701 11:19:15.578756 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.893657 315046 logs.go:138] Found kubelet problem: Jul 01 11:19:21 old-k8s-version-696386 kubelet[1364]: E0701 11:19:21.596820 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.893842 315046 logs.go:138] Found kubelet problem: Jul 01 11:19:30 old-k8s-version-696386 kubelet[1364]: E0701 11:19:30.578878 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.894042 315046 logs.go:138] Found kubelet problem: Jul 01 11:19:36 old-k8s-version-696386 kubelet[1364]: E0701 11:19:36.582805 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.894227 315046 logs.go:138] Found kubelet problem: Jul 01 11:19:41 old-k8s-version-696386 kubelet[1364]: E0701 11:19:41.578801 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.894426 315046 logs.go:138] Found kubelet problem: Jul 01 11:19:49 old-k8s-version-696386 kubelet[1364]: E0701 11:19:49.578762 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.894611 315046 logs.go:138] Found kubelet problem: Jul 01 11:19:56 old-k8s-version-696386 kubelet[1364]: E0701 11:19:56.578903 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.894814 315046 logs.go:138] Found kubelet problem: Jul 01 11:20:00 old-k8s-version-696386 kubelet[1364]: E0701 11:20:00.585124 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.894999 315046 logs.go:138] Found kubelet problem: Jul 01 11:20:08 old-k8s-version-696386 kubelet[1364]: E0701 11:20:08.582651 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.895197 315046 logs.go:138] Found kubelet problem: Jul 01 11:20:11 old-k8s-version-696386 kubelet[1364]: E0701 11:20:11.578904 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.895388 315046 logs.go:138] Found kubelet problem: Jul 01 11:20:23 old-k8s-version-696386 kubelet[1364]: E0701 11:20:23.578713 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.895588 315046 logs.go:138] Found kubelet problem: Jul 01 11:20:24 old-k8s-version-696386 kubelet[1364]: E0701 11:20:24.587688 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.895776 315046 logs.go:138] Found kubelet problem: Jul 01 11:20:35 old-k8s-version-696386 kubelet[1364]: E0701 11:20:35.578981 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.895973 315046 logs.go:138] Found kubelet problem: Jul 01 11:20:35 old-k8s-version-696386 kubelet[1364]: E0701 11:20:35.579957 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.896171 315046 logs.go:138] Found kubelet problem: Jul 01 11:20:47 old-k8s-version-696386 kubelet[1364]: E0701 11:20:47.578787 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.896355 315046 logs.go:138] Found kubelet problem: Jul 01 11:20:48 old-k8s-version-696386 kubelet[1364]: E0701 11:20:48.582337 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.896554 315046 logs.go:138] Found kubelet problem: Jul 01 11:20:58 old-k8s-version-696386 kubelet[1364]: E0701 11:20:58.580623 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.896738 315046 logs.go:138] Found kubelet problem: Jul 01 11:21:02 old-k8s-version-696386 kubelet[1364]: E0701 11:21:02.591635 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:13.896936 315046 logs.go:138] Found kubelet problem: Jul 01 11:21:11 old-k8s-version-696386 kubelet[1364]: E0701 11:21:11.578589 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
I0701 11:21:13.896948 315046 logs.go:123] Gathering logs for dmesg ...
I0701 11:21:13.896962 315046 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0701 11:21:13.917004 315046 logs.go:123] Gathering logs for kube-apiserver [c51045b66cf0] ...
I0701 11:21:13.917033 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c51045b66cf0"
I0701 11:21:14.018855 315046 logs.go:123] Gathering logs for coredns [9d0ed2465f50] ...
I0701 11:21:14.018898 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9d0ed2465f50"
I0701 11:21:14.041907 315046 logs.go:123] Gathering logs for kube-scheduler [f51b9c7349c1] ...
I0701 11:21:14.041937 315046 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f51b9c7349c1"
I0701 11:21:14.068430 315046 out.go:304] Setting ErrFile to fd 2...
I0701 11:21:14.068458 315046 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0701 11:21:14.068508 315046 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0701 11:21:14.068522 315046 out.go:239] Jul 01 11:20:47 old-k8s-version-696386 kubelet[1364]: E0701 11:20:47.578787 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jul 01 11:20:47 old-k8s-version-696386 kubelet[1364]: E0701 11:20:47.578787 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:14.068539 315046 out.go:239] Jul 01 11:20:48 old-k8s-version-696386 kubelet[1364]: E0701 11:20:48.582337 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 11:20:48 old-k8s-version-696386 kubelet[1364]: E0701 11:20:48.582337 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:14.068546 315046 out.go:239] Jul 01 11:20:58 old-k8s-version-696386 kubelet[1364]: E0701 11:20:58.580623 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jul 01 11:20:58 old-k8s-version-696386 kubelet[1364]: E0701 11:20:58.580623 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0701 11:21:14.068559 315046 out.go:239] Jul 01 11:21:02 old-k8s-version-696386 kubelet[1364]: E0701 11:21:02.591635 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 11:21:02 old-k8s-version-696386 kubelet[1364]: E0701 11:21:02.591635 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0701 11:21:14.068565 315046 out.go:239] Jul 01 11:21:11 old-k8s-version-696386 kubelet[1364]: E0701 11:21:11.578589 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jul 01 11:21:11 old-k8s-version-696386 kubelet[1364]: E0701 11:21:11.578589 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
I0701 11:21:14.068575 315046 out.go:304] Setting ErrFile to fd 2...
I0701 11:21:14.068581 315046 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0701 11:21:24.070093 315046 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0701 11:21:24.081624 315046 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0701 11:21:24.091960 315046 out.go:177]
W0701 11:21:24.093944 315046 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0701 11:21:24.093997 315046 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0701 11:21:24.094016 315046 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0701 11:21:24.094021 315046 out.go:239] *
*
W0701 11:21:24.096460 315046 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0701 11:21:24.098671 315046 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-696386 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=docker --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-696386
helpers_test.go:235: (dbg) docker inspect old-k8s-version-696386:
-- stdout --
[
{
"Id": "22a026e5ff33effb00c681671000cfb9b7a5b9a0ce5f71a82e02c30b416ecac9",
"Created": "2024-07-01T11:12:19.013550574Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 315274,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-07-01T11:15:06.637078082Z",
"FinishedAt": "2024-07-01T11:15:05.245755992Z"
},
"Image": "sha256:59cf53f54b1bed0b432ebf08c6ac817bec062867b90e25c5452b8e7c3276a7ff",
"ResolvConfPath": "/var/lib/docker/containers/22a026e5ff33effb00c681671000cfb9b7a5b9a0ce5f71a82e02c30b416ecac9/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/22a026e5ff33effb00c681671000cfb9b7a5b9a0ce5f71a82e02c30b416ecac9/hostname",
"HostsPath": "/var/lib/docker/containers/22a026e5ff33effb00c681671000cfb9b7a5b9a0ce5f71a82e02c30b416ecac9/hosts",
"LogPath": "/var/lib/docker/containers/22a026e5ff33effb00c681671000cfb9b7a5b9a0ce5f71a82e02c30b416ecac9/22a026e5ff33effb00c681671000cfb9b7a5b9a0ce5f71a82e02c30b416ecac9-json.log",
"Name": "/old-k8s-version-696386",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-696386:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-696386",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/514e392cda63e91d8c3d2e9e058afcb745572364821fe1b061c0f63f96c3dad5-init/diff:/var/lib/docker/overlay2/e2acd239da47561f1d9e6fd001d862cb4e9126743685e90d21bf67d89013d8ee/diff",
"MergedDir": "/var/lib/docker/overlay2/514e392cda63e91d8c3d2e9e058afcb745572364821fe1b061c0f63f96c3dad5/merged",
"UpperDir": "/var/lib/docker/overlay2/514e392cda63e91d8c3d2e9e058afcb745572364821fe1b061c0f63f96c3dad5/diff",
"WorkDir": "/var/lib/docker/overlay2/514e392cda63e91d8c3d2e9e058afcb745572364821fe1b061c0f63f96c3dad5/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-696386",
"Source": "/var/lib/docker/volumes/old-k8s-version-696386/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-696386",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-696386",
"name.minikube.sigs.k8s.io": "old-k8s-version-696386",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "48bce464080b06502bbd29b84440b73cbc9a3b644f92ec8f61558217fa8258a5",
"SandboxKey": "/var/run/docker/netns/48bce464080b",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33078"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33079"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33082"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33080"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33081"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-696386": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:55:02",
"DriverOpts": null,
"NetworkID": "dff9f0a9cb550f55339e147da641b58ece0f5eb9d945ec0c88de7e74677aee69",
"EndpointID": "209356e3da3e6a70a415132ee5a2338c0211c644f3842c2090bb9e3efdc88efd",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-696386",
"22a026e5ff33"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-696386 -n old-k8s-version-696386
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-696386 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-696386 logs -n 25: (2.353332682s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| ssh | docker-flags-323113 ssh | docker-flags-323113 | jenkins | v1.33.1 | 01 Jul 24 11:11 UTC | 01 Jul 24 11:11 UTC |
| | sudo systemctl show docker | | | | | |
| | --property=Environment | | | | | |
| | --no-pager | | | | | |
| ssh | docker-flags-323113 ssh | docker-flags-323113 | jenkins | v1.33.1 | 01 Jul 24 11:11 UTC | 01 Jul 24 11:11 UTC |
| | sudo systemctl show docker | | | | | |
| | --property=ExecStart | | | | | |
| | --no-pager | | | | | |
| delete | -p docker-flags-323113 | docker-flags-323113 | jenkins | v1.33.1 | 01 Jul 24 11:11 UTC | 01 Jul 24 11:11 UTC |
| start | -p cert-options-728533 | cert-options-728533 | jenkins | v1.33.1 | 01 Jul 24 11:11 UTC | 01 Jul 24 11:12 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| ssh | cert-options-728533 ssh | cert-options-728533 | jenkins | v1.33.1 | 01 Jul 24 11:12 UTC | 01 Jul 24 11:12 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-728533 -- sudo | cert-options-728533 | jenkins | v1.33.1 | 01 Jul 24 11:12 UTC | 01 Jul 24 11:12 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-728533 | cert-options-728533 | jenkins | v1.33.1 | 01 Jul 24 11:12 UTC | 01 Jul 24 11:12 UTC |
| start | -p old-k8s-version-696386 | old-k8s-version-696386 | jenkins | v1.33.1 | 01 Jul 24 11:12 UTC | 01 Jul 24 11:14 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-985735 | cert-expiration-985735 | jenkins | v1.33.1 | 01 Jul 24 11:14 UTC | 01 Jul 24 11:14 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| delete | -p cert-expiration-985735 | cert-expiration-985735 | jenkins | v1.33.1 | 01 Jul 24 11:14 UTC | 01 Jul 24 11:14 UTC |
| addons | enable metrics-server -p old-k8s-version-696386 | old-k8s-version-696386 | jenkins | v1.33.1 | 01 Jul 24 11:14 UTC | 01 Jul 24 11:14 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| start | -p no-preload-578590 | no-preload-578590 | jenkins | v1.33.1 | 01 Jul 24 11:14 UTC | 01 Jul 24 11:16 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --kubernetes-version=v1.30.2 | | | | | |
| stop | -p old-k8s-version-696386 | old-k8s-version-696386 | jenkins | v1.33.1 | 01 Jul 24 11:14 UTC | 01 Jul 24 11:15 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-696386 | old-k8s-version-696386 | jenkins | v1.33.1 | 01 Jul 24 11:15 UTC | 01 Jul 24 11:15 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-696386 | old-k8s-version-696386 | jenkins | v1.33.1 | 01 Jul 24 11:15 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-578590 | no-preload-578590 | jenkins | v1.33.1 | 01 Jul 24 11:16 UTC | 01 Jul 24 11:16 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-578590 | no-preload-578590 | jenkins | v1.33.1 | 01 Jul 24 11:16 UTC | 01 Jul 24 11:16 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-578590 | no-preload-578590 | jenkins | v1.33.1 | 01 Jul 24 11:16 UTC | 01 Jul 24 11:16 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-578590 | no-preload-578590 | jenkins | v1.33.1 | 01 Jul 24 11:16 UTC | 01 Jul 24 11:21 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --kubernetes-version=v1.30.2 | | | | | |
| image | no-preload-578590 image list | no-preload-578590 | jenkins | v1.33.1 | 01 Jul 24 11:21 UTC | 01 Jul 24 11:21 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-578590 | no-preload-578590 | jenkins | v1.33.1 | 01 Jul 24 11:21 UTC | 01 Jul 24 11:21 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-578590 | no-preload-578590 | jenkins | v1.33.1 | 01 Jul 24 11:21 UTC | 01 Jul 24 11:21 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-578590 | no-preload-578590 | jenkins | v1.33.1 | 01 Jul 24 11:21 UTC | 01 Jul 24 11:21 UTC |
| delete | -p no-preload-578590 | no-preload-578590 | jenkins | v1.33.1 | 01 Jul 24 11:21 UTC | 01 Jul 24 11:21 UTC |
| start | -p embed-certs-799897 | embed-certs-799897 | jenkins | v1.33.1 | 01 Jul 24 11:21 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --kubernetes-version=v1.30.2 | | | | | |
|---------|--------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/07/01 11:21:21
Running on machine: ip-172-31-30-239
Binary: Built with gc go1.22.4 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0701 11:21:21.275552 330809 out.go:291] Setting OutFile to fd 1 ...
I0701 11:21:21.275997 330809 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0701 11:21:21.276033 330809 out.go:304] Setting ErrFile to fd 2...
I0701 11:21:21.276055 330809 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0701 11:21:21.276571 330809 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19162-2194/.minikube/bin
I0701 11:21:21.277052 330809 out.go:298] Setting JSON to false
I0701 11:21:21.278191 330809 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":3823,"bootTime":1719829059,"procs":229,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1063-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
I0701 11:21:21.278291 330809 start.go:139] virtualization:
I0701 11:21:21.281385 330809 out.go:177] * [embed-certs-799897] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0701 11:21:21.283309 330809 out.go:177] - MINIKUBE_LOCATION=19162
I0701 11:21:21.283356 330809 notify.go:220] Checking for updates...
I0701 11:21:21.286680 330809 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0701 11:21:21.288191 330809 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19162-2194/kubeconfig
I0701 11:21:21.289717 330809 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19162-2194/.minikube
I0701 11:21:21.291357 330809 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0701 11:21:21.292966 330809 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0701 11:21:21.295034 330809 config.go:182] Loaded profile config "old-k8s-version-696386": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0
I0701 11:21:21.295129 330809 driver.go:392] Setting default libvirt URI to qemu:///system
I0701 11:21:21.317421 330809 docker.go:122] docker version: linux-27.0.3:Docker Engine - Community
I0701 11:21:21.317554 330809 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0701 11:21:21.381150 330809 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:33 OomKillDisable:true NGoroutines:51 SystemTime:2024-07-01 11:21:21.371827457 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1063-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae71819c4f5e67bb4d5ae76a6b735f29cc25774e Expected:ae71819c4f5e67bb4d5ae76a6b735f29cc25774e} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
I0701 11:21:21.381297 330809 docker.go:295] overlay module found
I0701 11:21:21.383296 330809 out.go:177] * Using the docker driver based on user configuration
I0701 11:21:21.385084 330809 start.go:297] selected driver: docker
I0701 11:21:21.385102 330809 start.go:901] validating driver "docker" against <nil>
I0701 11:21:21.385117 330809 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0701 11:21:21.385753 330809 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0701 11:21:21.447985 330809 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:33 OomKillDisable:true NGoroutines:51 SystemTime:2024-07-01 11:21:21.43883266 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1063-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae71819c4f5e67bb4d5ae76a6b735f29cc25774e Expected:ae71819c4f5e67bb4d5ae76a6b735f29cc25774e} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
I0701 11:21:21.448204 330809 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0701 11:21:21.448436 330809 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0701 11:21:21.450043 330809 out.go:177] * Using Docker driver with root privileges
I0701 11:21:21.451559 330809 cni.go:84] Creating CNI manager for ""
I0701 11:21:21.451591 330809 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0701 11:21:21.451604 330809 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0701 11:21:21.451684 330809 start.go:340] cluster config:
{Name:embed-certs-799897 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:embed-certs-799897 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSH
AuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0701 11:21:21.453625 330809 out.go:177] * Starting "embed-certs-799897" primary control-plane node in "embed-certs-799897" cluster
I0701 11:21:21.455192 330809 cache.go:121] Beginning downloading kic base image for docker with docker
I0701 11:21:21.457197 330809 out.go:177] * Pulling base image v0.0.44-1719413016-19142 ...
I0701 11:21:21.458798 330809 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime docker
I0701 11:21:21.458858 330809 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19162-2194/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-docker-overlay2-arm64.tar.lz4
I0701 11:21:21.458871 330809 cache.go:56] Caching tarball of preloaded images
I0701 11:21:21.458882 330809 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d in local docker daemon
I0701 11:21:21.458951 330809 preload.go:173] Found /home/jenkins/minikube-integration/19162-2194/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
I0701 11:21:21.458962 330809 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on docker
I0701 11:21:21.459067 330809 profile.go:143] Saving config to /home/jenkins/minikube-integration/19162-2194/.minikube/profiles/embed-certs-799897/config.json ...
I0701 11:21:21.459084 330809 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19162-2194/.minikube/profiles/embed-certs-799897/config.json: {Name:mk4af2cf9adb29b1b64be629c91de615aac033d0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0701 11:21:21.475015 330809 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d in local docker daemon, skipping pull
I0701 11:21:21.475047 330809 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d exists in daemon, skipping load
I0701 11:21:21.475063 330809 cache.go:194] Successfully downloaded all kic artifacts
I0701 11:21:21.475098 330809 start.go:360] acquireMachinesLock for embed-certs-799897: {Name:mk303d74046ea4ac6bb3127d241fe9438a2cf5db Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0701 11:21:21.475813 330809 start.go:364] duration metric: took 688.429µs to acquireMachinesLock for "embed-certs-799897"
I0701 11:21:21.475852 330809 start.go:93] Provisioning new machine with config: &{Name:embed-certs-799897 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:embed-certs-799897 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:f
alse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true}
I0701 11:21:21.475948 330809 start.go:125] createHost starting for "" (driver="docker")
I0701 11:21:24.070093 315046 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0701 11:21:24.081624 315046 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0701 11:21:24.091960 315046 out.go:177]
W0701 11:21:24.093944 315046 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0701 11:21:24.093997 315046 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0701 11:21:24.094016 315046 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0701 11:21:24.094021 315046 out.go:239] *
W0701 11:21:24.096460 315046 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0701 11:21:24.098671 315046 out.go:177]
==> Docker <==
Jul 01 11:16:11 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:16:11.956756382Z" level=warning msg="reference for unknown type: application/vnd.docker.distribution.manifest.v1+prettyjws" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4"
Jul 01 11:16:12 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:16:12.279215435Z" level=warning msg="Error persisting manifest" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" error="error committing manifest to content store: commit failed: unexpected commit digest sha256:eaee4c452b076cdb05b391ed7e75e1ad0aca136665875ab5d7e2f3d9f4675769, expected sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb: failed precondition" remote="registry.k8s.io/echoserver:1.4"
Jul 01 11:16:12 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:16:12.279327547Z" level=warning msg="[DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4"
Jul 01 11:16:12 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:16:12.279359054Z" level=info msg="Attempting next endpoint for pull after error: [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
Jul 01 11:16:18 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:16:18.651001110Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Jul 01 11:16:18 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:16:18.651051939Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Jul 01 11:16:18 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:16:18.652953586Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Jul 01 11:16:39 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:16:39.915991396Z" level=warning msg="reference for unknown type: application/vnd.docker.distribution.manifest.v1+prettyjws" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4"
Jul 01 11:16:40 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:16:40.232822886Z" level=warning msg="Error persisting manifest" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" error="error committing manifest to content store: commit failed: unexpected commit digest sha256:eaee4c452b076cdb05b391ed7e75e1ad0aca136665875ab5d7e2f3d9f4675769, expected sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb: failed precondition" remote="registry.k8s.io/echoserver:1.4"
Jul 01 11:16:40 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:16:40.232960779Z" level=warning msg="[DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4"
Jul 01 11:16:40 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:16:40.232993730Z" level=info msg="Attempting next endpoint for pull after error: [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
Jul 01 11:17:13 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:17:13.596146510Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Jul 01 11:17:13 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:17:13.596194263Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Jul 01 11:17:13 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:17:13.598307466Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Jul 01 11:17:30 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:17:30.917286120Z" level=warning msg="reference for unknown type: application/vnd.docker.distribution.manifest.v1+prettyjws" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4"
Jul 01 11:17:31 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:17:31.208514497Z" level=warning msg="Error persisting manifest" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" error="error committing manifest to content store: commit failed: unexpected commit digest sha256:eaee4c452b076cdb05b391ed7e75e1ad0aca136665875ab5d7e2f3d9f4675769, expected sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb: failed precondition" remote="registry.k8s.io/echoserver:1.4"
Jul 01 11:17:31 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:17:31.208643815Z" level=warning msg="[DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4"
Jul 01 11:17:31 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:17:31.208674575Z" level=info msg="Attempting next endpoint for pull after error: [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
Jul 01 11:18:48 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:18:48.599389026Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Jul 01 11:18:48 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:18:48.599454609Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Jul 01 11:18:48 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:18:48.602108666Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Jul 01 11:18:53 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:18:53.939288107Z" level=warning msg="reference for unknown type: application/vnd.docker.distribution.manifest.v1+prettyjws" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4"
Jul 01 11:18:54 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:18:54.234746225Z" level=warning msg="Error persisting manifest" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" error="error committing manifest to content store: commit failed: unexpected commit digest sha256:eaee4c452b076cdb05b391ed7e75e1ad0aca136665875ab5d7e2f3d9f4675769, expected sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb: failed precondition" remote="registry.k8s.io/echoserver:1.4"
Jul 01 11:18:54 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:18:54.234858715Z" level=warning msg="[DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4"
Jul 01 11:18:54 old-k8s-version-696386 dockerd[1073]: time="2024-07-01T11:18:54.234891009Z" level=info msg="Attempting next endpoint for pull after error: [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
0935d40910f81 ba04bb24b9575 5 minutes ago Running storage-provisioner 2 5fcfbb8050144 storage-provisioner
f6fed13e2a7b3 kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93 5 minutes ago Running kubernetes-dashboard 0 c5467f5f384ea kubernetes-dashboard-cd95d586-4b4tc
9d0ed2465f508 db91994f4ee8f 5 minutes ago Running coredns 1 4ee9a5b49409e coredns-74ff55c5b-sbfhj
7dd1d36931311 1611cd07b61d5 5 minutes ago Running busybox 1 c15ac145a5fb6 busybox
1765ef5cbb5b1 25a5233254979 5 minutes ago Running kube-proxy 1 d51e89f9de900 kube-proxy-hmgpt
397bd20638302 ba04bb24b9575 5 minutes ago Exited storage-provisioner 1 5fcfbb8050144 storage-provisioner
f51b9c7349c14 e7605f88f17d6 6 minutes ago Running kube-scheduler 1 ef191523c691b kube-scheduler-old-k8s-version-696386
9a896ea0ddad4 05b738aa1bc63 6 minutes ago Running etcd 1 788d5294894fa etcd-old-k8s-version-696386
4dfa46bb0f73f 1df8a2b116bd1 6 minutes ago Running kube-controller-manager 1 d752bf64a2b57 kube-controller-manager-old-k8s-version-696386
cd8eafe48e002 2c08bbbc02d3a 6 minutes ago Running kube-apiserver 1 1b4968fa05f4a kube-apiserver-old-k8s-version-696386
1caae387d8ca9 gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e 6 minutes ago Exited busybox 0 1042c3770e9ed busybox
0a711fdb48413 db91994f4ee8f 8 minutes ago Exited coredns 0 9f78bb2fbadf4 coredns-74ff55c5b-sbfhj
dbdb63d9a9215 25a5233254979 8 minutes ago Exited kube-proxy 0 8598868736e05 kube-proxy-hmgpt
fb83ba4a51dd3 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 226e30dc77043 kube-controller-manager-old-k8s-version-696386
f1c05044007f1 e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 507ece0d20d2c kube-scheduler-old-k8s-version-696386
c51045b66cf09 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 a1287db28c77e kube-apiserver-old-k8s-version-696386
29316c9716632 05b738aa1bc63 8 minutes ago Exited etcd 0 bd7c7c0920cf5 etcd-old-k8s-version-696386
==> coredns [0a711fdb4841] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] Reloading
[INFO] plugin/health: Going into lameduck mode for 5s
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
[INFO] Reloading complete
[INFO] 127.0.0.1:44416 - 14296 "HINFO IN 3921284542881386040.8713089908680954821. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.032980522s
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
I0701 11:13:44.891827 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-01 11:13:14.891135504 +0000 UTC m=+0.045518158) (total time: 30.000584455s):
Trace[2019727887]: [30.000584455s] [30.000584455s] END
E0701 11:13:44.891865 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0701 11:13:44.892201 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-01 11:13:14.891328287 +0000 UTC m=+0.045710941) (total time: 30.000856836s):
Trace[939984059]: [30.000856836s] [30.000856836s] END
E0701 11:13:44.892217 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0701 11:13:44.892361 1 trace.go:116] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-01 11:13:14.891366178 +0000 UTC m=+0.045748832) (total time: 30.000943529s):
Trace[911902081]: [30.000943529s] [30.000943529s] END
E0701 11:13:44.892379 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> coredns [9d0ed2465f50] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:45872 - 20818 "HINFO IN 3087319677440709235.8174270400940393686. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.02916688s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I0701 11:16:06.839824 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-01 11:15:36.839187139 +0000 UTC m=+0.058290300) (total time: 30.000542548s):
Trace[2019727887]: [30.000542548s] [30.000542548s] END
E0701 11:16:06.840926 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0701 11:16:06.840422 1 trace.go:116] Trace[1427131847]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-01 11:15:36.837146213 +0000 UTC m=+0.056249415) (total time: 30.003257773s):
Trace[1427131847]: [30.003257773s] [30.003257773s] END
E0701 11:16:06.841150 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0701 11:16:06.840898 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-01 11:15:36.840403015 +0000 UTC m=+0.059506168) (total time: 30.000478852s):
Trace[939984059]: [30.000478852s] [30.000478852s] END
E0701 11:16:06.841304 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> describe nodes <==
Name: old-k8s-version-696386
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-696386
kubernetes.io/os=linux
minikube.k8s.io/commit=d5b534308abe5dfb86f36450c6d9ededa442aa16
minikube.k8s.io/name=old-k8s-version-696386
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_07_01T11_12_57_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 01 Jul 2024 11:12:54 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-696386
AcquireTime: <unset>
RenewTime: Mon, 01 Jul 2024 11:21:24 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 01 Jul 2024 11:21:24 +0000 Mon, 01 Jul 2024 11:12:48 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 01 Jul 2024 11:21:24 +0000 Mon, 01 Jul 2024 11:12:48 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 01 Jul 2024 11:21:24 +0000 Mon, 01 Jul 2024 11:12:48 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 01 Jul 2024 11:21:24 +0000 Mon, 01 Jul 2024 11:13:11 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.85.2
Hostname: old-k8s-version-696386
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022360Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022360Ki
pods: 110
System Info:
Machine ID: ecbcc66682f447228c9f061d3fc6b380
System UUID: b6e8c1ed-1d89-462a-88b0-08df7a7c004c
Boot ID: e944fe94-bfb0-4f20-a252-c89fe729a0a3
Kernel Version: 5.15.0-1063-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: docker://27.0.1
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m43s
kube-system coredns-74ff55c5b-sbfhj 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m13s
kube-system etcd-old-k8s-version-696386 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m25s
kube-system kube-apiserver-old-k8s-version-696386 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m25s
kube-system kube-controller-manager-old-k8s-version-696386 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m25s
kube-system kube-proxy-hmgpt 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m13s
kube-system kube-scheduler-old-k8s-version-696386 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m25s
kube-system metrics-server-9975d5f86-4zbxq 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m32s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m11s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-jwslt 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m34s
kubernetes-dashboard kubernetes-dashboard-cd95d586-4b4tc 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m34s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (42%!)(MISSING) 0 (0%!)(MISSING)
memory 370Mi (4%!)(MISSING) 170Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m39s (x4 over 8m40s) kubelet Node old-k8s-version-696386 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m39s (x4 over 8m40s) kubelet Node old-k8s-version-696386 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m39s (x4 over 8m40s) kubelet Node old-k8s-version-696386 status is now: NodeHasSufficientPID
Normal Starting 8m25s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m25s kubelet Node old-k8s-version-696386 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m25s kubelet Node old-k8s-version-696386 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m25s kubelet Node old-k8s-version-696386 status is now: NodeHasSufficientPID
Normal NodeNotReady 8m25s kubelet Node old-k8s-version-696386 status is now: NodeNotReady
Normal NodeAllocatableEnforced 8m25s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m15s kubelet Node old-k8s-version-696386 status is now: NodeReady
Normal Starting 8m12s kube-proxy Starting kube-proxy.
Normal Starting 6m8s kubelet Starting kubelet.
Normal NodeHasSufficientPID 6m8s (x7 over 6m8s) kubelet Node old-k8s-version-696386 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 6m8s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 6m7s (x8 over 6m8s) kubelet Node old-k8s-version-696386 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m7s (x8 over 6m8s) kubelet Node old-k8s-version-696386 status is now: NodeHasNoDiskPressure
Normal Starting 5m50s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.000701] FS-Cache: N-cookie c=0000000c [p=00000003 fl=2 nc=0 na=1]
[ +0.000976] FS-Cache: N-cookie d=0000000091a8837e{9p.inode} n=00000000b473c4e6
[ +0.001032] FS-Cache: N-key=[8] '976ced0000000000'
[ +0.002950] FS-Cache: Duplicate cookie detected
[ +0.000680] FS-Cache: O-cookie c=00000006 [p=00000003 fl=226 nc=0 na=1]
[ +0.000956] FS-Cache: O-cookie d=0000000091a8837e{9p.inode} n=0000000090b22721
[ +0.001031] FS-Cache: O-key=[8] '976ced0000000000'
[ +0.000686] FS-Cache: N-cookie c=0000000d [p=00000003 fl=2 nc=0 na=1]
[ +0.000945] FS-Cache: N-cookie d=0000000091a8837e{9p.inode} n=00000000b485ff60
[ +0.001020] FS-Cache: N-key=[8] '976ced0000000000'
[ +2.539570] FS-Cache: Duplicate cookie detected
[ +0.000819] FS-Cache: O-cookie c=00000004 [p=00000003 fl=226 nc=0 na=1]
[ +0.001003] FS-Cache: O-cookie d=0000000091a8837e{9p.inode} n=00000000533e1647
[ +0.001058] FS-Cache: O-key=[8] '966ced0000000000'
[ +0.000753] FS-Cache: N-cookie c=0000000f [p=00000003 fl=2 nc=0 na=1]
[ +0.000970] FS-Cache: N-cookie d=0000000091a8837e{9p.inode} n=00000000192bf55d
[ +0.001110] FS-Cache: N-key=[8] '966ced0000000000'
[ +0.286827] FS-Cache: Duplicate cookie detected
[ +0.000752] FS-Cache: O-cookie c=00000009 [p=00000003 fl=226 nc=0 na=1]
[ +0.000983] FS-Cache: O-cookie d=0000000091a8837e{9p.inode} n=0000000062c62c1a
[ +0.001089] FS-Cache: O-key=[8] '9e6ced0000000000'
[ +0.000766] FS-Cache: N-cookie c=00000010 [p=00000003 fl=2 nc=0 na=1]
[ +0.000991] FS-Cache: N-cookie d=0000000091a8837e{9p.inode} n=00000000b473c4e6
[ +0.001096] FS-Cache: N-key=[8] '9e6ced0000000000'
[Jul 1 11:04] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
==> etcd [29316c971663] <==
raft2024/07/01 11:12:48 INFO: 9f0758e1c58a86ed became leader at term 2
raft2024/07/01 11:12:48 INFO: raft.node: 9f0758e1c58a86ed elected leader 9f0758e1c58a86ed at term 2
2024-07-01 11:12:48.476174 I | etcdserver: published {Name:old-k8s-version-696386 ClientURLs:[https://192.168.85.2:2379]} to cluster 68eaea490fab4e05
2024-07-01 11:12:48.476404 I | embed: ready to serve client requests
2024-07-01 11:12:48.478169 I | embed: serving client requests on 127.0.0.1:2379
2024-07-01 11:12:48.478283 I | etcdserver: setting up the initial cluster version to 3.4
2024-07-01 11:12:48.508283 N | etcdserver/membership: set the initial cluster version to 3.4
2024-07-01 11:12:48.508492 I | etcdserver/api: enabled capabilities for version 3.4
2024-07-01 11:12:48.508523 I | embed: ready to serve client requests
2024-07-01 11:12:48.528332 I | embed: serving client requests on 192.168.85.2:2379
2024-07-01 11:13:06.844886 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:13:12.111799 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:13:22.111683 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:13:32.111829 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:13:42.111840 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:13:52.111664 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:14:02.111737 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:14:12.111749 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:14:22.111820 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:14:32.111530 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:14:42.119726 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:14:52.111647 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:14:54.751761 N | pkg/osutil: received terminated signal, shutting down...
WARNING: 2024/07/01 11:14:54 grpc: addrConn.createTransport failed to connect to {127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
2024-07-01 11:14:54.817993 I | etcdserver: skipped leadership transfer for single voting member cluster
==> etcd [9a896ea0ddad] <==
2024-07-01 11:17:25.178322 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:17:35.178101 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:17:45.182559 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:17:55.178588 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:18:05.178336 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:18:15.178303 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:18:25.178093 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:18:35.178076 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:18:45.181554 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:18:55.178202 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:19:05.178086 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:19:15.178234 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:19:25.178121 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:19:35.178190 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:19:45.179493 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:19:55.178330 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:20:05.178174 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:20:15.178134 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:20:25.178440 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:20:35.178250 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:20:45.178586 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:20:55.178273 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:21:05.178157 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:21:15.178196 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-01 11:21:25.178021 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
11:21:26 up 1:03, 0 users, load average: 0.77, 1.92, 2.76
Linux old-k8s-version-696386 5.15.0-1063-aws #69~20.04.1-Ubuntu SMP Fri May 10 19:21:30 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kube-apiserver [c51045b66cf0] <==
W0701 11:15:04.048714 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.060121 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.075193 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.129320 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.178137 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.178322 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.227226 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.248323 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.289936 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.328974 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.369528 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.375968 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.453652 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.476477 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.610866 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.645501 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.662264 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.742228 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.781285 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.811750 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.817724 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.887017 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.927761 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:04.996856 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0701 11:15:05.006335 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
==> kube-apiserver [cd8eafe48e00] <==
I0701 11:18:10.530718 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0701 11:18:10.530746 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0701 11:18:36.133534 1 handler_proxy.go:102] no RequestInfo found in the context
E0701 11:18:36.133623 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0701 11:18:36.133635 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0701 11:18:43.143680 1 client.go:360] parsed scheme: "passthrough"
I0701 11:18:43.143726 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0701 11:18:43.143734 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0701 11:19:25.156721 1 client.go:360] parsed scheme: "passthrough"
I0701 11:19:25.156779 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0701 11:19:25.156789 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0701 11:20:06.242741 1 client.go:360] parsed scheme: "passthrough"
I0701 11:20:06.242784 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0701 11:20:06.242793 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0701 11:20:32.985532 1 handler_proxy.go:102] no RequestInfo found in the context
E0701 11:20:32.985595 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0701 11:20:32.985605 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0701 11:20:43.943555 1 client.go:360] parsed scheme: "passthrough"
I0701 11:20:43.943603 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0701 11:20:43.943612 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0701 11:21:16.405382 1 client.go:360] parsed scheme: "passthrough"
I0701 11:21:16.405428 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0701 11:21:16.405437 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [4dfa46bb0f73] <==
W0701 11:16:58.409281 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0701 11:17:24.454440 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0701 11:17:30.059787 1 request.go:655] Throttling request took 1.048186459s, request: GET:https://192.168.85.2:8443/apis/coordination.k8s.io/v1beta1?timeout=32s
W0701 11:17:30.911460 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0701 11:17:54.956317 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0701 11:18:02.561863 1 request.go:655] Throttling request took 1.048455156s, request: GET:https://192.168.85.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
W0701 11:18:03.413306 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0701 11:18:25.458135 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0701 11:18:35.063769 1 request.go:655] Throttling request took 1.04781136s, request: GET:https://192.168.85.2:8443/apis/scheduling.k8s.io/v1beta1?timeout=32s
W0701 11:18:35.915321 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0701 11:18:55.959900 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0701 11:19:07.565735 1 request.go:655] Throttling request took 1.048315002s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0701 11:19:08.417182 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0701 11:19:26.461731 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0701 11:19:40.021048 1 request.go:655] Throttling request took 1.001131165s, request: GET:https://192.168.85.2:8443/apis/networking.k8s.io/v1beta1?timeout=32s
W0701 11:19:40.919163 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0701 11:19:56.963741 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0701 11:20:12.569621 1 request.go:655] Throttling request took 1.048321386s, request: GET:https://192.168.85.2:8443/apis/autoscaling/v1?timeout=32s
W0701 11:20:13.421039 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0701 11:20:27.465745 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0701 11:20:45.026938 1 request.go:655] Throttling request took 1.003500621s, request: GET:https://192.168.85.2:8443/apis/networking.k8s.io/v1beta1?timeout=32s
W0701 11:20:45.923076 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0701 11:20:57.967617 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0701 11:21:17.573672 1 request.go:655] Throttling request took 1.04152431s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0701 11:21:18.425501 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-controller-manager [fb83ba4a51dd] <==
I0701 11:13:13.289486 1 event.go:291] "Event occurred" object="old-k8s-version-696386" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node old-k8s-version-696386 event: Registered Node old-k8s-version-696386 in Controller"
I0701 11:13:13.292810 1 shared_informer.go:247] Caches are synced for ClusterRoleAggregator
I0701 11:13:13.303377 1 shared_informer.go:247] Caches are synced for TTL
I0701 11:13:13.320819 1 shared_informer.go:247] Caches are synced for PVC protection
I0701 11:13:13.324233 1 shared_informer.go:247] Caches are synced for daemon sets
I0701 11:13:13.345591 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-74ff55c5b to 2"
I0701 11:13:13.351766 1 shared_informer.go:247] Caches are synced for stateful set
I0701 11:13:13.387127 1 shared_informer.go:247] Caches are synced for disruption
I0701 11:13:13.387147 1 disruption.go:339] Sending events to api server.
I0701 11:13:13.419143 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-chqgj"
I0701 11:13:13.440167 1 shared_informer.go:247] Caches are synced for resource quota
I0701 11:13:13.443331 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-sbfhj"
I0701 11:13:13.443501 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-hmgpt"
I0701 11:13:13.445815 1 shared_informer.go:247] Caches are synced for attach detach
I0701 11:13:13.478648 1 shared_informer.go:247] Caches are synced for job
I0701 11:13:13.480164 1 shared_informer.go:247] Caches are synced for resource quota
I0701 11:13:13.651809 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0701 11:13:13.951991 1 shared_informer.go:247] Caches are synced for garbage collector
I0701 11:13:13.979877 1 shared_informer.go:247] Caches are synced for garbage collector
I0701 11:13:13.979899 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0701 11:13:15.341294 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0701 11:13:15.362079 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-chqgj"
I0701 11:14:53.448597 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
E0701 11:14:53.546729 1 clusterroleaggregation_controller.go:181] view failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "view": the object has been modified; please apply your changes to the latest version and try again
I0701 11:14:54.542898 1 event.go:291] "Event occurred" object="kube-system/metrics-server-9975d5f86" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: metrics-server-9975d5f86-4zbxq"
==> kube-proxy [1765ef5cbb5b] <==
I0701 11:15:36.946112 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0701 11:15:36.946190 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0701 11:15:36.996800 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0701 11:15:36.996887 1 server_others.go:185] Using iptables Proxier.
I0701 11:15:36.997087 1 server.go:650] Version: v1.20.0
I0701 11:15:36.997860 1 config.go:315] Starting service config controller
I0701 11:15:36.997868 1 shared_informer.go:240] Waiting for caches to sync for service config
I0701 11:15:36.997885 1 config.go:224] Starting endpoint slice config controller
I0701 11:15:36.997888 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0701 11:15:37.098438 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0701 11:15:37.098646 1 shared_informer.go:247] Caches are synced for service config
==> kube-proxy [dbdb63d9a921] <==
I0701 11:13:14.861495 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0701 11:13:14.861610 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0701 11:13:14.911713 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0701 11:13:14.911830 1 server_others.go:185] Using iptables Proxier.
I0701 11:13:14.912301 1 server.go:650] Version: v1.20.0
I0701 11:13:14.913053 1 config.go:315] Starting service config controller
I0701 11:13:14.913062 1 shared_informer.go:240] Waiting for caches to sync for service config
I0701 11:13:14.913099 1 config.go:224] Starting endpoint slice config controller
I0701 11:13:14.913103 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0701 11:13:15.013170 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0701 11:13:15.013174 1 shared_informer.go:247] Caches are synced for service config
==> kube-scheduler [f1c05044007f] <==
W0701 11:12:54.699817 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0701 11:12:54.700030 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0701 11:12:54.700110 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0701 11:12:54.700188 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0701 11:12:54.798359 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0701 11:12:54.803536 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0701 11:12:54.803774 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0701 11:12:54.805241 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0701 11:12:54.857761 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0701 11:12:54.858106 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0701 11:12:54.858828 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0701 11:12:54.859211 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0701 11:12:54.859433 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0701 11:12:54.859630 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0701 11:12:54.859835 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0701 11:12:54.860033 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0701 11:12:54.860216 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0701 11:12:54.860406 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0701 11:12:54.860534 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0701 11:12:54.860914 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0701 11:12:55.691263 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0701 11:12:55.720730 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0701 11:12:55.720981 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0701 11:12:55.725845 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
I0701 11:12:58.505354 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [f51b9c7349c1] <==
I0701 11:15:26.031120 1 serving.go:331] Generated self-signed cert in-memory
W0701 11:15:31.626031 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0701 11:15:31.626064 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0701 11:15:31.626076 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0701 11:15:31.626081 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0701 11:15:31.919594 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0701 11:15:31.923376 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0701 11:15:31.923389 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0701 11:15:31.923405 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0701 11:15:31.949509 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0701 11:15:31.949616 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0701 11:15:31.949710 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0701 11:15:31.949795 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0701 11:15:31.949875 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0701 11:15:31.949955 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0701 11:15:31.950047 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0701 11:15:31.950124 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0701 11:15:31.950203 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0701 11:15:31.950280 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0701 11:15:31.950356 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0701 11:15:31.976857 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
I0701 11:15:33.031326 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Jul 01 11:18:54 old-k8s-version-696386 kubelet[1364]: E0701 11:18:54.237471 1364 kuberuntime_manager.go:829] container &Container{Name:dashboard-metrics-scraper,Image:registry.k8s.io/echoserver:1.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:,HostPort:0,ContainerPort:8000,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-volume,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:kubernetes-dashboard-token-6q54j,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/,Port:{0 8000 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:30,TimeoutSeconds:30,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:nil,Lifecycle:nil,Terminatio
nMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1001,RunAsNonRoot:nil,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:*false,RunAsGroup:*2001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db): ErrImagePull: rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/
Jul 01 11:18:54 old-k8s-version-696386 kubelet[1364]: E0701 11:18:54.237506 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
Jul 01 11:19:03 old-k8s-version-696386 kubelet[1364]: E0701 11:19:03.590795 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 11:19:06 old-k8s-version-696386 kubelet[1364]: E0701 11:19:06.579056 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jul 01 11:19:15 old-k8s-version-696386 kubelet[1364]: E0701 11:19:15.578756 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 11:19:21 old-k8s-version-696386 kubelet[1364]: E0701 11:19:21.596820 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jul 01 11:19:30 old-k8s-version-696386 kubelet[1364]: E0701 11:19:30.578878 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 11:19:36 old-k8s-version-696386 kubelet[1364]: E0701 11:19:36.582805 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jul 01 11:19:41 old-k8s-version-696386 kubelet[1364]: E0701 11:19:41.578801 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 11:19:49 old-k8s-version-696386 kubelet[1364]: E0701 11:19:49.578762 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jul 01 11:19:56 old-k8s-version-696386 kubelet[1364]: E0701 11:19:56.578903 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 11:20:00 old-k8s-version-696386 kubelet[1364]: E0701 11:20:00.585124 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jul 01 11:20:08 old-k8s-version-696386 kubelet[1364]: E0701 11:20:08.582651 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 11:20:11 old-k8s-version-696386 kubelet[1364]: E0701 11:20:11.578904 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jul 01 11:20:23 old-k8s-version-696386 kubelet[1364]: E0701 11:20:23.578713 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 11:20:24 old-k8s-version-696386 kubelet[1364]: E0701 11:20:24.587688 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jul 01 11:20:35 old-k8s-version-696386 kubelet[1364]: E0701 11:20:35.578981 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 11:20:35 old-k8s-version-696386 kubelet[1364]: E0701 11:20:35.579957 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jul 01 11:20:47 old-k8s-version-696386 kubelet[1364]: E0701 11:20:47.578787 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jul 01 11:20:48 old-k8s-version-696386 kubelet[1364]: E0701 11:20:48.582337 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 11:20:58 old-k8s-version-696386 kubelet[1364]: E0701 11:20:58.580623 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jul 01 11:21:02 old-k8s-version-696386 kubelet[1364]: E0701 11:21:02.591635 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 11:21:11 old-k8s-version-696386 kubelet[1364]: E0701 11:21:11.578589 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jul 01 11:21:17 old-k8s-version-696386 kubelet[1364]: E0701 11:21:17.578843 1364 pod_workers.go:191] Error syncing pod b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa ("metrics-server-9975d5f86-4zbxq_kube-system(b0b8ed11-29ba-40a0-8dc2-594eb0d7e0aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 01 11:21:25 old-k8s-version-696386 kubelet[1364]: E0701 11:21:25.586278 1364 pod_workers.go:191] Error syncing pod 1c812d49-e550-4e4c-b9a7-aad23fb0f2db ("dashboard-metrics-scraper-8d5bb5db8-jwslt_kubernetes-dashboard(1c812d49-e550-4e4c-b9a7-aad23fb0f2db)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
==> kubernetes-dashboard [f6fed13e2a7b] <==
2024/07/01 11:16:00 Using namespace: kubernetes-dashboard
2024/07/01 11:16:00 Using in-cluster config to connect to apiserver
2024/07/01 11:16:00 Using secret token for csrf signing
2024/07/01 11:16:00 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/07/01 11:16:00 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/07/01 11:16:00 Successful initial request to the apiserver, version: v1.20.0
2024/07/01 11:16:00 Generating JWE encryption key
2024/07/01 11:16:00 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/07/01 11:16:00 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/07/01 11:16:01 Initializing JWE encryption key from synchronized object
2024/07/01 11:16:01 Creating in-cluster Sidecar client
2024/07/01 11:16:01 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/01 11:16:01 Serving insecurely on HTTP port: 9090
2024/07/01 11:16:31 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/01 11:17:01 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/01 11:17:31 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/01 11:18:01 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/01 11:18:31 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/01 11:19:01 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/01 11:19:31 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/01 11:20:01 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/01 11:20:31 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/01 11:21:01 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/01 11:16:00 Starting overwatch
==> storage-provisioner [0935d40910f8] <==
I0701 11:16:19.723345 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0701 11:16:19.746836 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0701 11:16:19.746883 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0701 11:16:37.271572 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0701 11:16:37.273122 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-696386_a44ec216-4a64-4ed8-97b1-c962132c0ea4!
I0701 11:16:37.277193 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"dbd7374a-4fb6-484e-a8a9-59d5e8e73844", APIVersion:"v1", ResourceVersion:"822", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-696386_a44ec216-4a64-4ed8-97b1-c962132c0ea4 became leader
I0701 11:16:37.379108 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-696386_a44ec216-4a64-4ed8-97b1-c962132c0ea4!
==> storage-provisioner [397bd2063830] <==
I0701 11:15:36.231181 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0701 11:16:06.236702 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-696386 -n old-k8s-version-696386
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-696386 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-4zbxq dashboard-metrics-scraper-8d5bb5db8-jwslt
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-696386 describe pod metrics-server-9975d5f86-4zbxq dashboard-metrics-scraper-8d5bb5db8-jwslt
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-696386 describe pod metrics-server-9975d5f86-4zbxq dashboard-metrics-scraper-8d5bb5db8-jwslt: exit status 1 (157.129145ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-4zbxq" not found
Error from server (NotFound): pods "dashboard-metrics-scraper-8d5bb5db8-jwslt" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-696386 describe pod metrics-server-9975d5f86-4zbxq dashboard-metrics-scraper-8d5bb5db8-jwslt: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (382.50s)